-- Logs begin at Thu 2022-10-13 12:30:34 UTC, end at Thu 2022-10-13 13:29:45 UTC. -- Oct 13 13:01:17.254180 dv-cinder-826607-8-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Oct 13 13:01:17.262816 dv-cinder-826607-8-iscsi devstack@n-api.service[103789]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Oct 13 13:01:17.264805 dv-cinder-826607-8-iscsi devstack@n-api.service[103789]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Oct 13 13:01:17 2022] *** Oct 13 13:01:17.264805 dv-cinder-826607-8-iscsi devstack@n-api.service[103789]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Oct 13 13:01:17.264805 dv-cinder-826607-8-iscsi devstack@n-api.service[103789]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Oct 13 13:01:17.264805 dv-cinder-826607-8-iscsi devstack@n-api.service[103789]: nodename: dv-cinder-826607-8-iscsi Oct 13 13:01:17.264805 dv-cinder-826607-8-iscsi devstack@n-api.service[103789]: machine: x86_64 Oct 13 13:01:17.264805 dv-cinder-826607-8-iscsi devstack@n-api.service[103789]: clock source: unix Oct 13 13:01:17.264805 dv-cinder-826607-8-iscsi devstack@n-api.service[103789]: pcre jit disabled Oct 13 13:01:17.264805 dv-cinder-826607-8-iscsi devstack@n-api.service[103789]: detected number of CPU cores: 4 Oct 13 13:01:17.264805 dv-cinder-826607-8-iscsi devstack@n-api.service[103789]: current working directory: / Oct 13 13:01:17.264805 dv-cinder-826607-8-iscsi devstack@n-api.service[103789]: detected binary path: /usr/bin/uwsgi-core Oct 13 13:01:17.264805 dv-cinder-826607-8-iscsi devstack@n-api.service[103789]: your processes number limit is 47680 Oct 13 13:01:17.264805 dv-cinder-826607-8-iscsi devstack@n-api.service[103789]: your memory page size is 4096 bytes Oct 13 13:01:17.264805 dv-cinder-826607-8-iscsi devstack@n-api.service[103789]: detected max file descriptor number: 2048 Oct 13 13:01:17.264805 dv-cinder-826607-8-iscsi devstack@n-api.service[103789]: lock engine: pthread robust mutexes Oct 13 13:01:17.265811 dv-cinder-826607-8-iscsi devstack@n-api.service[103789]: thunder lock: enabled Oct 13 13:01:17.265811 dv-cinder-826607-8-iscsi devstack@n-api.service[103789]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Oct 13 13:01:17.265811 dv-cinder-826607-8-iscsi devstack@n-api.service[103789]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Oct 13 13:01:17.303740 dv-cinder-826607-8-iscsi devstack@n-api.service[103789]: Python main interpreter initialized at 0x5589bdbd89c0 Oct 13 13:01:17.303740 dv-cinder-826607-8-iscsi devstack@n-api.service[103789]: python threads support enabled Oct 13 13:01:17.303740 dv-cinder-826607-8-iscsi devstack@n-api.service[103789]: your server socket listen backlog is limited to 100 connections Oct 13 13:01:17.303740 dv-cinder-826607-8-iscsi devstack@n-api.service[103789]: your mercy for graceful operations on workers is 90 seconds Oct 13 13:01:17.304086 dv-cinder-826607-8-iscsi devstack@n-api.service[103789]: mapped 403077 bytes (393 KB) for 2 cores Oct 13 13:01:17.304165 dv-cinder-826607-8-iscsi devstack@n-api.service[103789]: *** Operational MODE: preforking *** Oct 13 13:01:17.304386 dv-cinder-826607-8-iscsi devstack@n-api.service[103789]: *** uWSGI is running in multiple interpreter mode *** Oct 13 13:01:17.304386 dv-cinder-826607-8-iscsi devstack@n-api.service[103789]: spawned uWSGI master process (pid: 103789) Oct 13 13:01:17.304567 dv-cinder-826607-8-iscsi systemd[1]: Started Devstack devstack@n-api.service. Oct 13 13:01:17.311097 dv-cinder-826607-8-iscsi devstack@n-api.service[103789]: spawned uWSGI worker 1 (pid: 103790, cores: 1) Oct 13 13:01:17.311097 dv-cinder-826607-8-iscsi devstack@n-api.service[103789]: spawned uWSGI worker 2 (pid: 103791, cores: 1) Oct 13 13:01:17.311097 dv-cinder-826607-8-iscsi devstack@n-api.service[103789]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Oct 13 13:01:17.970027 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 13 13:01:17.970606 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 13 13:01:19.062879 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 13 13:01:19.062879 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: from cryptography.utils import int_from_bytes Oct 13 13:01:19.063497 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 13 13:01:19.063497 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: from cryptography.utils import int_from_bytes Oct 13 13:01:19.063646 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 13 13:01:19.063646 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: from cryptography.utils import int_from_bytes Oct 13 13:01:19.064019 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 13 13:01:19.064019 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: from cryptography.utils import int_from_bytes Oct 13 13:01:21.542268 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 13 13:01:21.542933 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 13 13:01:21.543083 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 13 13:01:21.543299 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 13 13:01:21.543680 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 13 13:01:21.543766 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 13 13:01:21.543855 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 13 13:01:21.544067 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:01:21.544166 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 13 13:01:21.544396 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:01:21.544482 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 13 13:01:21.544669 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 13 13:01:21.544755 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:01:21.545024 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:01:21.545110 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:01:21.545357 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:01:21.545449 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:01:21.545671 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:01:21.545768 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:01:21.545987 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:01:21.546071 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:01:21.546305 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:01:21.546388 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:01:21.547195 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:01:21.547302 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:01:21.547464 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:01:21.547554 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:01:21.547783 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:01:21.547866 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:01:21.548109 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-826607-8-iscsi {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:01:21.548195 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:01:21.548388 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:01:21.548482 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:01:21.548703 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:01:21.548787 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:01:21.549024 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:01:21.549119 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-826607-8-iscsi {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:01:21.549340 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:01:21.549431 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:01:21.549644 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:01:21.549728 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:01:21.549956 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:01:21.550048 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:01:21.550273 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:01:21.550398 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:01:21.550581 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:01:21.550770 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:01:21.550934 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:01:21.551229 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:01:21.551351 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:01:21.551535 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:01:21.551729 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:01:21.551866 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:01:21.552045 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:01:21.552169 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:01:21.552352 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:01:21.552478 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:01:21.552664 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:01:21.552797 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:01:21.553000 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:01:21.553117 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:01:21.553316 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:01:21.553442 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:01:21.553626 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:01:21.553759 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:01:21.553945 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:01:21.554074 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:01:21.554254 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:01:21.554380 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-826607-8-iscsi {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:01:21.554575 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:01:21.554700 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:01:21.554887 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:01:21.555020 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:01:21.555267 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:01:21.555426 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-826607-8-iscsi {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:01:21.555605 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:01:21.555736 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:01:21.555918 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:01:21.556042 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:01:21.556232 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:01:21.556366 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:01:21.556552 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:01:21.556676 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:01:21.556874 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:01:21.556998 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:01:21.557182 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:01:21.557321 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:01:21.557509 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:01:21.557634 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:01:21.558069 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:01:21.558198 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:01:21.558391 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:01:21.558533 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:01:21.558708 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:01:21.558850 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:01:21.559010 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:01:21.559160 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:01:21.559342 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:01:21.559481 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:01:21.559649 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:01:21.559773 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:01:21.559961 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:01:21.560087 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:01:21.560261 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:01:21.560393 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:01:21.560566 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:01:21.560692 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:01:21.560827 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:01:21.560955 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:01:21.561109 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:01:21.561325 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:01:21.561452 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:01:21.561575 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:01:21.561696 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:01:21.561816 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:01:21.561993 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:01:21.562124 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:01:21.562297 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:01:21.562423 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:01:21.562543 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:01:21.562751 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:01:21.562885 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:01:21.563007 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:01:21.563175 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:01:21.563298 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:01:21.563459 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:01:21.563586 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:01:21.563766 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:01:21.563889 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:01:21.564072 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:01:21.564198 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:01:21.564378 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:01:21.564512 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:01:21.564680 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:01:21.564804 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:01:21.564982 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:01:21.565115 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:01:21.565286 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:01:21.565404 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:01:21.565587 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:01:21.565716 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:01:21.565889 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:01:21.566012 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:01:21.566194 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:01:21.566320 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:01:21.566498 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:01:21.566625 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:01:21.566799 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:01:21.566932 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:01:21.567138 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:01:21.567266 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:01:21.567459 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:01:21.567582 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.23 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:01:21.567765 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:01:21.567909 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.23 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:01:21.568069 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:01:21.568193 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:01:21.568408 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:01:21.568543 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.23 {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:01:21.568707 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.23 {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:01:21.568844 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:01:21.569014 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:01:21.569139 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:01:21.569326 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:01:21.569450 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:01:21.569649 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:01:21.569787 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:01:21.569953 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:01:21.570084 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:01:21.570255 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:01:21.570378 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:01:21.570564 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:01:21.570690 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:01:21.570878 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:01:21.571011 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:01:21.571210 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:01:21.571359 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:01:21.571697 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:01:21.571835 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:01:21.571835 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:01:21.572066 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:01:21.572187 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:01:21.572307 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:01:21.572436 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:01:21.572567 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:01:21.572697 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:01:21.572819 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:01:21.572940 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:01:21.573060 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:01:21.573231 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:01:21.573358 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:01:21.573537 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:01:21.573664 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:01:21.573837 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:01:21.573977 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:01:21.574141 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:01:21.574266 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:01:21.574443 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:01:21.574568 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:01:21.574740 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:01:21.574874 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:01:21.575041 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:01:21.575197 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:01:21.575366 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:01:21.575491 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:01:21.575670 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:01:21.575815 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:01:21.575975 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:01:21.576099 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:01:21.576276 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:01:21.576415 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:01:21.576579 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:01:21.576716 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:01:21.576881 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:01:21.577004 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:01:21.577188 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:01:21.577320 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:01:21.577493 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:01:21.578133 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:01:21.578332 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:01:21.578455 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:01:21.578639 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:01:21.578772 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:01:21.578944 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:01:21.579111 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:01:21.579256 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:01:21.579379 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:01:21.579577 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:01:21.579709 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:01:21.579882 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:01:21.580016 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:01:21.580187 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:01:21.580312 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:01:21.580507 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:01:21.580631 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:01:21.580812 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:01:21.580944 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:01:21.581116 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:01:21.581240 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:01:21.581433 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:01:21.581559 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:01:21.581762 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:01:21.581902 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:01:21.582026 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:01:21.582153 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:01:21.582332 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:01:21.582458 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:01:21.582630 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:01:21.582757 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:01:21.582933 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:01:21.583084 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:01:21.583270 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:01:21.583395 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:01:21.583571 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:01:21.583696 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:01:21.583877 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:01:21.584003 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:01:21.584176 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:01:21.584300 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:01:21.584478 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:01:21.584604 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:01:21.584779 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:01:21.584911 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:01:21.585080 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:01:21.585205 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:01:21.585439 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:01:21.585562 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:01:21.585674 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:01:21.585793 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:01:21.585954 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:01:21.586088 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:01:21.586253 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:01:21.586389 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:01:21.586555 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:01:21.586681 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:01:21.586855 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:01:21.586993 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:01:21.587180 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:01:21.587306 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:01:21.587484 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:01:21.587609 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:01:21.587794 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:01:21.587932 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:01:21.588102 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:01:21.588228 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.588406 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:01:21.588538 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.588724 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:01:21.588867 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.589059 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.589186 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.589391 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.589516 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.589714 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.589838 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.590030 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.590163 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.590343 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.590469 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.590657 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.590784 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.590982 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.591125 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.591320 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.591445 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.591634 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.591759 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.591966 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.592090 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.592247 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.592382 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.592557 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.592688 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.592870 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.593006 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.593184 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.593337 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.594065 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.594208 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.594385 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.594516 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.594701 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.594836 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.595019 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.595210 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.595367 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.595506 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.595683 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.595818 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.595996 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.596127 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.596325 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.596450 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.596651 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.596786 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.596969 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.597094 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.597290 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.597414 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.597613 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.597748 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.597926 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.598059 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.598237 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.598373 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.598551 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.598678 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.598860 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.598991 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.599198 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.599327 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.599512 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.599640 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.599827 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.599959 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.600140 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.600265 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.600457 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.600582 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.600767 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.600891 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.601078 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.601205 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.601389 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.601516 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.601699 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.601824 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.602026 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.602158 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.602296 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.602419 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.602610 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.602735 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.602922 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.603101 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.603260 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.603386 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.603574 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.603700 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.603893 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.604032 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.604209 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.604336 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.604518 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.604645 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.604830 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.604965 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.605138 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.605264 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.605443 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.605568 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.605750 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.605876 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.606051 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.606175 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.606353 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.606484 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.606655 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.606782 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.606965 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.607112 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.607295 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.607421 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.607617 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.607752 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.607922 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.608047 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.608236 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.608362 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.608551 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.608670 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.608858 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.609013 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.609188 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.609313 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.609503 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.609631 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.609813 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.609939 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.610117 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.610250 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.610428 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.610552 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.610741 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.610867 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.611048 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.611211 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.611395 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.611521 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.611704 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.611839 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.612009 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.612245 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.612372 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.612492 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.612613 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.612741 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.612918 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.613130 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.613263 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.613384 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.613528 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.613655 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.613842 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.613977 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.614156 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.614282 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.614465 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.614590 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.614786 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.614920 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.615122 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.615251 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.615437 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.615561 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.615765 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.615900 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.616092 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.616218 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.616396 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.616521 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.616703 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.616829 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.617016 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.617143 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.617321 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.617460 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.617628 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.617753 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.617931 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.618064 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.618233 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.618366 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.618535 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.618659 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.618838 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.618962 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.619172 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.619312 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.619479 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.619604 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.619782 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.619914 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.620092 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.620228 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.620399 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.620525 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.620699 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.620823 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.621005 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.621132 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.621310 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.621436 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.621613 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.621744 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.621918 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.622045 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.622269 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.622405 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.622562 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.622691 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.622869 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.622996 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.623221 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.623346 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.623536 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.623661 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.623853 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.623980 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.624170 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.624295 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.624480 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.624634 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.624813 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.624938 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.625124 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.625248 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.625437 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.625571 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.625744 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.625869 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.626054 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.626179 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.626359 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.626492 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.626671 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.626796 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.626978 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.627118 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.627313 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.627447 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.627615 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.627739 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.627931 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.628055 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.628245 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.628378 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.628552 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.628686 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.628869 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.628995 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.629195 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.629326 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.629506 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.629632 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.629821 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.629945 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.630132 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.630264 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.630441 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.630565 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.630748 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.630872 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.631074 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.631203 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.631391 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.631526 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.631697 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.631822 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.632006 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.632131 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.632382 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.632516 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.632639 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.632758 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.632927 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.633061 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.633240 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.633365 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.633542 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.633675 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.633856 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.633983 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.634173 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.634300 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.634480 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.634620 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.634796 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.634922 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.635132 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.635260 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.635458 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.635597 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.635773 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.635898 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.636081 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.636206 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.636394 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.636528 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.636699 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.636826 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.637005 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.637132 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.637314 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.637439 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.637623 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.637756 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.637929 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.638064 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.638235 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.638360 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.638540 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.638665 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.638847 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.638971 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.639174 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.639294 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.639478 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.639603 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.639778 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.639909 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.640089 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.640722 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.640915 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.641042 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.641220 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.641364 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.641538 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.641669 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.641858 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.641983 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.642163 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.642368 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.642568 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.642693 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.642814 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.642935 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.643074 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.643216 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.643380 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.643506 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.643682 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.643809 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.643985 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.644119 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.644289 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.644414 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.644596 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.644729 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.644900 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.645028 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.645228 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.645353 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.645537 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.645676 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.645844 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.645971 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.646154 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.646270 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.646466 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.646592 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.646774 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.646899 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.647108 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.647237 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.647423 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.647550 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.647730 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.647855 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.648040 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.648169 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.648351 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.648484 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.648658 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.648782 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.648965 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.649081 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.649276 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.649411 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.649583 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.649719 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.649892 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.650016 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.650199 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.650332 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.650504 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.650630 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.650811 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.650944 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.651147 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.651287 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.651455 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.651713 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.651848 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.652046 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.652180 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.652363 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.652627 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.652762 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.652959 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.653095 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.653279 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.653415 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.653602 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.653735 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.653946 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.654087 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.654257 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.654382 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.654571 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.654705 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.654880 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.655006 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.655212 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.655340 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.655519 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.655646 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.656369 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.656508 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.656684 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.656811 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.656990 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.657117 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.657292 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.657416 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.657600 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.657727 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.657901 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.658034 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.658205 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.658330 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.658504 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.658638 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.658810 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.658935 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.659124 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.659249 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.659433 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.659576 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.659742 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.659866 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.660047 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.660174 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.660351 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.660484 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.660664 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.660798 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.660965 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.661096 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.661270 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.661405 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.661575 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.661707 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.661881 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.662005 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.662188 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.662434 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.662569 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.662706 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.662895 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.663021 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.663180 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.663314 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.663469 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.663597 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.663785 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.663910 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.664110 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.664238 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.664417 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.664551 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.664720 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.664845 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.665020 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.665145 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.665330 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.665456 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.665632 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.665764 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.665931 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.666063 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.666239 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.666364 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.666545 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.666742 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.666866 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.666999 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.667175 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.667297 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.667459 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.667598 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.667769 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.667895 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.668072 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.668216 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.668372 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.668505 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.668678 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.668805 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.668979 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.669104 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.669279 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.669412 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.669588 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.669707 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.669890 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.670014 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.670190 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.670315 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.670498 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.670624 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.670797 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.670921 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.671119 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.671257 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.671490 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.671621 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.671744 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.671864 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.672042 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.672169 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.672351 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.672475 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.672657 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.672783 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.672993 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.673127 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.673249 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.673369 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.673558 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.673694 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.673857 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.673983 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.674162 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.674288 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.674471 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.674606 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.674773 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.674905 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.675098 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.675238 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.675406 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.675539 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.675712 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.675838 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.676017 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.676143 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.676317 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.676450 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.676627 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.676752 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.676930 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.677056 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.677232 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.677357 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.677532 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.677657 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.677833 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.677959 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.678132 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.678257 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.678434 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.678558 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.678730 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.678854 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.679031 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.679173 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.679355 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.679479 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.679653 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.679781 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.679956 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.680087 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.680259 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.680386 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.680558 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.680698 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.680860 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.680986 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.681161 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.681293 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.681466 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.681601 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.681774 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.681900 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.682118 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.682245 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.682425 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.682560 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.682743 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.683219 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.683346 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.683469 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.683629 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.683768 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.683942 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.684075 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.684248 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.684375 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.684556 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.684688 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.684864 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.684988 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.685165 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.685291 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.685451 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.685575 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.685753 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.685885 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.686072 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.686195 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.686378 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.686510 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.686664 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.686790 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.686984 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.687142 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.687346 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.687472 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.687658 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.687784 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.687958 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.688081 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.688268 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.688401 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.688579 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.688704 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.688884 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.689018 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.689193 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.689317 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.689501 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.689625 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.689808 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.689932 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.690116 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.690240 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.690426 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.690551 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.690735 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.690869 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.691045 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.691214 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.691373 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.691498 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.691686 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.691828 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.691995 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.692120 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.692298 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.692422 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.692607 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.692733 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.692918 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.693045 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.693265 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.693405 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.693537 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.693659 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.693815 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.693940 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.694126 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.694249 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.694427 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.694559 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.694730 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.694855 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.695046 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.695274 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.695389 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.695509 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.695787 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.695912 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.696098 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.696235 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.696408 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.696532 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.696712 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.696830 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.697026 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.697161 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.697330 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.697454 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.697645 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.697769 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.697961 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.698096 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.698267 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.698394 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.698641 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.698766 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.698949 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.699120 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.699280 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.699406 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.699593 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.699719 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.699897 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.700023 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.700203 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.700330 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.700506 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.700631 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.700811 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.700938 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.701115 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.701240 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.701421 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.701561 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.701731 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.701858 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.702054 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.702181 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.702358 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.702483 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.703229 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.703443 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.703652 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.703778 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.703969 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.704107 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.704278 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.704403 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.704602 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.704728 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.704927 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.705063 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.705258 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.705397 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.705566 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.705692 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.705882 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.706008 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.706195 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.706396 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.706520 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.706641 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.706806 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.706925 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.707143 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.707280 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.707460 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.707571 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.707770 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.707882 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.708082 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.708202 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.708401 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.708514 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.708705 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.708821 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.709022 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.709150 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.709330 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.709463 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.709641 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.709768 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.709965 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.710086 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.710346 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.710472 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.710673 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.710807 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.710982 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.711122 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.711312 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.711451 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.711625 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.711761 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.711931 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.712064 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.712236 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.712362 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.712546 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.712681 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.712853 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.712978 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.713156 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.713281 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.713484 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.713626 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.713758 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.713881 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.714058 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.714193 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.714363 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.714498 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.714671 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.714796 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.714977 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.715151 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.715309 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.715449 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.715626 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.715751 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.715929 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.716054 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.716254 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.716382 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.716556 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.716689 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.716877 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.717009 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.717186 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.717311 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.717490 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.717615 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.717793 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.717918 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.718100 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.718227 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.718456 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.718582 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.718774 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.718903 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.719086 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.719216 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.719435 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.719569 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.719740 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.719877 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.720062 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.720179 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.720392 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.720515 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.720715 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.720848 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.721025 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.721148 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.721334 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.721458 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.721657 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.721790 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.721981 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.722106 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.722286 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.722416 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.722591 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.722724 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.722902 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.723029 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.723230 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.723356 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.723603 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.723739 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.723862 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.723991 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.724137 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.724292 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.724508 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.724817 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.725153 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.725278 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.725460 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.725587 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.725768 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.725904 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.726074 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.726213 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.726399 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.726536 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.726707 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.726838 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.727031 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.727191 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.727366 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.727507 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.727674 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.727801 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.727980 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.728107 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.728287 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.728429 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.728632 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.728758 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.728941 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.729067 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.729271 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.729408 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.729585 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.729707 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.729904 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.730041 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.730222 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.730347 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.730540 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.730723 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.730857 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.731190 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.731382 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.731510 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.731631 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.731817 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.731951 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.732130 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.732266 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.732450 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.732576 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.732762 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.732887 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.733080 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.733214 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.733396 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.733607 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.733810 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.734466 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.734767 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.734903 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.735102 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.735230 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.735423 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.735561 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.735741 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.735868 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.736051 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.736176 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.736365 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.736489 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.736692 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.736817 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.736971 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.737362 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.737468 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.737570 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.737570 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.737810 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.737933 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.738055 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.738208 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.738344 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.738534 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.738670 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.738850 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.738978 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.739195 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.739336 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.739515 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.739642 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.739834 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.739960 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.740154 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.740281 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.740474 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.740600 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.740787 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.740915 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.741107 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.741235 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.741426 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.741560 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.741742 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.741881 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.742054 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.742178 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.742366 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.742491 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.742680 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.742813 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.742991 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.743143 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.743330 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.743464 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.743643 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.743794 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.743984 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.744117 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.744241 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.744363 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.744551 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.744679 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.744869 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.744996 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.745194 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.745320 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.745506 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.745632 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.745821 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.745948 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.746137 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.746262 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.746452 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.746660 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.746796 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.746979 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.747299 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.747440 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.747615 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.747742 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.747950 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.748084 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.748265 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.748399 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.748586 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.748713 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.748901 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.749026 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.749210 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.749345 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.749596 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.750214 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.750367 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.750495 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.750679 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.750816 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.750988 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.751141 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.751337 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.751465 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.751642 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.751768 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.751947 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.752072 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.752263 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.752395 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.752573 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.752701 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.752898 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.753106 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.753233 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.753465 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.753733 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.753861 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.754085 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.754221 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.754406 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.754533 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.754730 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.754856 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.755041 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.755186 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.755386 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.755521 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.755696 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.755829 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.756008 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.756136 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.756314 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.756459 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.756623 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.756751 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.756936 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.757062 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.757245 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.757386 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.757550 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.757675 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.757858 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.757993 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.758162 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.758300 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.758472 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.758597 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.758777 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.758902 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.759106 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.759236 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.759415 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.759541 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.759721 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.759847 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.760032 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.760160 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.760338 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.760470 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.760644 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.760768 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.760953 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.761080 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.761257 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.761381 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.761560 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.761685 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.761865 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.761992 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.762170 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.762297 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.762478 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.762611 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.762781 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.762907 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.763113 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.763252 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.763422 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.763556 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.763735 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.763862 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.764062 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.764264 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.764389 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.764524 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.764681 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.764816 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.764989 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.765136 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.765319 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.765446 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.765627 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.765753 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.765946 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.766072 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.766267 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.766391 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.766566 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.766693 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.766880 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.767006 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.767219 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.767348 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.767567 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.767762 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.767910 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.768164 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.768410 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.768536 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.768745 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.768870 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.769071 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.769198 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.769379 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.769505 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.769691 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.769817 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.770000 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.770135 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.770316 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.770441 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.770625 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.770752 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.770937 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.771095 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.771277 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.771403 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.771573 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.771696 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.771883 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.772019 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.772192 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.772317 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.772500 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.772624 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.772813 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.772941 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.773121 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.773245 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.773429 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.773554 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.773737 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.773863 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.774041 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.774165 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.774353 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.774496 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.774658 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.774791 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.774966 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.775147 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.775300 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.775440 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.775617 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.775744 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.775943 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.776067 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.776265 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.776399 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.776581 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.776706 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.776894 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.777022 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.777208 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.777343 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.777517 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.777650 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.777825 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.777950 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.778200 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.778343 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.778475 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.778599 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.778730 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.778853 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.779070 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.779199 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.779388 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.779695 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.779822 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.780046 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.780361 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.780489 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.780682 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.780825 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.781022 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.781148 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.781346 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.781472 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.781662 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.781797 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.781974 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.782109 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.782299 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.782425 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.782611 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.782736 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.782932 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.783088 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.783287 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.783414 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.783615 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.783740 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.783945 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.784084 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.784255 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.784382 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.784563 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.784698 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.784871 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.785006 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.785175 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.785300 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.785478 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.785607 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.785787 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.785913 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.786095 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.786220 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.786403 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.786527 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.786710 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.786847 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.787012 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.787175 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.787356 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.787481 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.787616 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.787740 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.787918 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.788053 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.788220 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.788438 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.788564 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.788685 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.788807 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.788928 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.789097 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.789233 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.789399 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.789524 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.789698 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.789823 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.789999 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.790133 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.790304 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.790430 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.790604 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.790729 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.790910 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.791043 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.791236 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.791361 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.791540 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.791664 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.791840 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.791972 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.792141 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.792266 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.792490 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.792622 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.792783 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.792911 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.793105 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.793229 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.793418 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.793543 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.793740 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.793865 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.794047 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.794172 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.794368 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.794503 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.794681 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.794808 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.794996 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.795144 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.795342 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.795551 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.795676 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.795798 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.795954 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.796088 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.796277 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.796914 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.797101 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.797237 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.797413 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.797539 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.797722 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.797855 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.798032 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.798156 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.798340 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.798543 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.798680 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.798804 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.798964 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.799119 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.799315 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.799439 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.799625 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.799754 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.799945 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.800069 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.800261 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.800386 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.800574 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.800701 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.800891 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.801008 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.801204 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.801338 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.801516 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.801643 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.801829 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.801963 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.802136 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.802276 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.802445 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.802571 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.802753 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.802879 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.803140 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.803283 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.803408 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.803529 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.803698 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.803826 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.804012 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.804140 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.804330 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.804456 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.804651 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.804777 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.804961 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.805087 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.805290 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.805416 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.805600 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.805725 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.805929 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.806065 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.806258 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.806383 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.806601 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.806733 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.806912 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.807038 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.807264 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.807389 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.807582 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.807721 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.808143 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.808273 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.808396 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 13 13:01:21.808532 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.808757 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:01:21.809005 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 13 13:01:21.961053 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: INFO dbcounter [None req-66c1fe34-4ad2-4a58-868c-6c5af9f23946 None None] Registered counter for database nova_api Oct 13 13:01:21.961993 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: INFO dbcounter [None req-3421e5f5-4b54-43eb-857c-71a8c3f92aa3 None None] Registered counter for database nova_api Oct 13 13:01:21.981523 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG oslo_db.sqlalchemy.engines [None req-66c1fe34-4ad2-4a58-868c-6c5af9f23946 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103791) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 13 13:01:21.983394 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG oslo_db.sqlalchemy.engines [None req-3421e5f5-4b54-43eb-857c-71a8c3f92aa3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103790) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 13 13:01:21.988740 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG dbcounter [-] [103791] Writer thread running {{(pid=103791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 13 13:01:21.990522 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG dbcounter [-] [103790] Writer thread running {{(pid=103790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 13 13:01:22.045703 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.context [None req-66c1fe34-4ad2-4a58-868c-6c5af9f23946 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),0819204c-42d8-4282-8b98-8f0b36a44d37(cell1) {{(pid=103791) load_cells /opt/stack/nova/nova/context.py:464}} Oct 13 13:01:22.046031 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.context [None req-3421e5f5-4b54-43eb-857c-71a8c3f92aa3 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),0819204c-42d8-4282-8b98-8f0b36a44d37(cell1) {{(pid=103790) load_cells /opt/stack/nova/nova/context.py:464}} Oct 13 13:01:22.050145 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG oslo_concurrency.lockutils [None req-66c1fe34-4ad2-4a58-868c-6c5af9f23946 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:01:22.050480 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG oslo_concurrency.lockutils [None req-3421e5f5-4b54-43eb-857c-71a8c3f92aa3 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:01:22.050617 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG oslo_concurrency.lockutils [None req-66c1fe34-4ad2-4a58-868c-6c5af9f23946 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=103791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:01:22.050966 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG oslo_concurrency.lockutils [None req-3421e5f5-4b54-43eb-857c-71a8c3f92aa3 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=103790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:01:22.052214 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG oslo_concurrency.lockutils [None req-66c1fe34-4ad2-4a58-868c-6c5af9f23946 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:01:22.052547 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG oslo_concurrency.lockutils [None req-3421e5f5-4b54-43eb-857c-71a8c3f92aa3 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:01:22.052940 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG oslo_concurrency.lockutils [None req-66c1fe34-4ad2-4a58-868c-6c5af9f23946 None None] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:01:22.053272 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG oslo_concurrency.lockutils [None req-3421e5f5-4b54-43eb-857c-71a8c3f92aa3 None None] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:01:22.053390 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG oslo_concurrency.lockutils [None req-66c1fe34-4ad2-4a58-868c-6c5af9f23946 None None] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:01:22.053726 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG oslo_concurrency.lockutils [None req-3421e5f5-4b54-43eb-857c-71a8c3f92aa3 None None] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:01:22.055393 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG oslo_concurrency.lockutils [None req-66c1fe34-4ad2-4a58-868c-6c5af9f23946 None None] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:01:22.055732 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG oslo_concurrency.lockutils [None req-3421e5f5-4b54-43eb-857c-71a8c3f92aa3 None None] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:01:22.057365 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: INFO dbcounter [None req-66c1fe34-4ad2-4a58-868c-6c5af9f23946 None None] Registered counter for database nova_cell0 Oct 13 13:01:22.057716 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: INFO dbcounter [None req-3421e5f5-4b54-43eb-857c-71a8c3f92aa3 None None] Registered counter for database nova_cell0 Oct 13 13:01:22.061821 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: INFO dbcounter [None req-66c1fe34-4ad2-4a58-868c-6c5af9f23946 None None] Registered counter for database nova_cell1 Oct 13 13:01:22.061927 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: INFO dbcounter [None req-3421e5f5-4b54-43eb-857c-71a8c3f92aa3 None None] Registered counter for database nova_cell1 Oct 13 13:01:22.069082 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG oslo_db.sqlalchemy.engines [None req-3421e5f5-4b54-43eb-857c-71a8c3f92aa3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103790) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 13 13:01:22.072771 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG oslo_db.sqlalchemy.engines [None req-3421e5f5-4b54-43eb-857c-71a8c3f92aa3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103790) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 13 13:01:22.074748 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG oslo_db.sqlalchemy.engines [None req-66c1fe34-4ad2-4a58-868c-6c5af9f23946 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103791) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 13 13:01:22.074873 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG dbcounter [-] [103790] Writer thread running {{(pid=103790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 13 13:01:22.076576 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG oslo_db.sqlalchemy.engines [None req-66c1fe34-4ad2-4a58-868c-6c5af9f23946 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103791) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 13 13:01:22.082445 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG dbcounter [-] [103791] Writer thread running {{(pid=103791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 13 13:01:22.087827 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG dbcounter [-] [103791] Writer thread running {{(pid=103791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 13 13:01:22.215286 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG dbcounter [-] [103790] Writer thread running {{(pid=103790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 13 13:01:22.224386 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: INFO dbcounter [None req-3421e5f5-4b54-43eb-857c-71a8c3f92aa3 None None] Registered counter for database nova_cell0 Oct 13 13:01:22.232053 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: INFO dbcounter [None req-66c1fe34-4ad2-4a58-868c-6c5af9f23946 None None] Registered counter for database nova_cell0 Oct 13 13:01:22.233090 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG oslo_db.sqlalchemy.engines [None req-3421e5f5-4b54-43eb-857c-71a8c3f92aa3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103790) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 13 13:01:22.238512 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG dbcounter [-] [103790] Writer thread running {{(pid=103790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 13 13:01:22.239629 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG oslo_db.sqlalchemy.engines [None req-66c1fe34-4ad2-4a58-868c-6c5af9f23946 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103791) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 13 13:01:22.244317 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG dbcounter [-] [103791] Writer thread running {{(pid=103791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 13 13:01:22.576499 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: WARNING keystonemiddleware.auth_token [None req-3421e5f5-4b54-43eb-857c-71a8c3f92aa3 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 13 13:01:22.577048 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: WARNING keystonemiddleware.auth_token [None req-66c1fe34-4ad2-4a58-868c-6c5af9f23946 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 13 13:01:22.584695 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: WARNING keystonemiddleware.auth_token [None req-66c1fe34-4ad2-4a58-868c-6c5af9f23946 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 13 13:01:22.584833 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: WARNING keystonemiddleware.auth_token [None req-3421e5f5-4b54-43eb-857c-71a8c3f92aa3 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 13 13:01:22.926075 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: WARNING keystonemiddleware.auth_token [None req-66c1fe34-4ad2-4a58-868c-6c5af9f23946 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 13 13:01:22.926207 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: WARNING keystonemiddleware.auth_token [None req-3421e5f5-4b54-43eb-857c-71a8c3f92aa3 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 13 13:01:22.932106 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: WARNING keystonemiddleware.auth_token [None req-66c1fe34-4ad2-4a58-868c-6c5af9f23946 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 13 13:01:22.932217 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: WARNING keystonemiddleware.auth_token [None req-3421e5f5-4b54-43eb-857c-71a8c3f92aa3 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 13 13:01:22.938240 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5589bdbd89c0 pid: 103791 (default app) Oct 13 13:01:22.938428 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5589bdbd89c0 pid: 103790 (default app) Oct 13 13:01:22.940533 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi [None req-66c1fe34-4ad2-4a58-868c-6c5af9f23946 None None] Calling method '>' {{(pid=103791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:01:22.941737 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: INFO nova.api.openstack.requestlog [None req-66c1fe34-4ad2-4a58-868c-6c5af9f23946 None None] 10.222.0.23 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001947 Oct 13 13:01:22.942159 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: [pid: 103791|app: 0|req: 1/1] 10.222.0.23 () {50 vars in 788 bytes} [Thu Oct 13 13:01:22 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 13:02:43.505905 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi [None req-3421e5f5-4b54-43eb-857c-71a8c3f92aa3 None None] Calling method '>' {{(pid=103790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:02:43.507803 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: INFO nova.api.openstack.requestlog [None req-3421e5f5-4b54-43eb-857c-71a8c3f92aa3 None None] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002712 Oct 13 13:02:43.508400 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: [pid: 103790|app: 0|req: 1/2] 10.222.0.23 () {54 vars in 931 bytes} [Thu Oct 13 13:02:43 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 13:02:43.519798 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG dbcounter [-] [103791] Writing DB stats nova_api:SELECT=3 {{(pid=103791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:02:43.520933 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG dbcounter [-] [103791] Writing DB stats nova_cell1:SELECT=3 {{(pid=103791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:02:43.523134 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG dbcounter [-] [103791] Writing DB stats nova_cell0:SELECT=3 {{(pid=103791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:02:43.523909 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG dbcounter [-] [103791] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:02:44.400113 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi [None req-2a466951-f568-43a3-a6cc-627a8d7eb131 admin admin] Calling method '>' {{(pid=103791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:02:44.433838 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: INFO nova.api.openstack.requestlog [None req-2a466951-f568-43a3-a6cc-627a8d7eb131 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.918760 Oct 13 13:02:44.434797 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: [pid: 103791|app: 0|req: 2/3] 10.222.0.23 () {60 vars in 1292 bytes} [Thu Oct 13 13:02:43 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 921 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:02:47.062591 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi [None req-3421e5f5-4b54-43eb-857c-71a8c3f92aa3 None None] Calling method '>' {{(pid=103790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:02:47.063656 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: INFO nova.api.openstack.requestlog [None req-3421e5f5-4b54-43eb-857c-71a8c3f92aa3 None None] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001465 Oct 13 13:02:47.064203 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: [pid: 103790|app: 0|req: 2/4] 10.222.0.23 () {54 vars in 931 bytes} [Thu Oct 13 13:02:47 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 13:02:47.522442 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi [None req-3a95b7ed-7a79-48e7-a791-558bb7fd87a0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "name": "cirros256", "os-flavor-access:is_public": true, "ram": 256, "rxtx_factor": 1.0, "disk": 1, "id": "c1", "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=103791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 13:02:47.571286 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: INFO nova.api.openstack.requestlog [None req-3a95b7ed-7a79-48e7-a791-558bb7fd87a0 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.501225 Oct 13 13:02:47.571842 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: [pid: 103791|app: 0|req: 3/5] 10.222.0.23 () {64 vars in 1283 bytes} [Thu Oct 13 13:02:47 2022] POST /compute/v2.1/flavors => generated 407 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 13 13:02:47.588769 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG dbcounter [-] [103790] Writing DB stats nova_api:SELECT=3 {{(pid=103790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:02:47.590330 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG dbcounter [-] [103790] Writing DB stats nova_cell0:SELECT=3 {{(pid=103790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:02:47.593402 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG dbcounter [-] [103790] Writing DB stats nova_cell1:SELECT=3 {{(pid=103790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:02:47.594383 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG dbcounter [-] [103790] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:02:47.800883 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi [None req-9144ec4f-e1ee-4e41-8293-e0a11418bf29 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 13:02:47.869774 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: INFO nova.api.openstack.requestlog [None req-9144ec4f-e1ee-4e41-8293-e0a11418bf29 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.288860 Oct 13 13:02:47.870366 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: [pid: 103790|app: 0|req: 3/6] 10.222.0.23 () {64 vars in 1336 bytes} [Thu Oct 13 13:02:47 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:02:50.461267 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi [None req-3a95b7ed-7a79-48e7-a791-558bb7fd87a0 admin admin] Calling method '>' {{(pid=103791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:02:50.462287 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: INFO nova.api.openstack.requestlog [None req-3a95b7ed-7a79-48e7-a791-558bb7fd87a0 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001464 Oct 13 13:02:50.462708 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: [pid: 103791|app: 0|req: 4/7] 10.222.0.23 () {54 vars in 931 bytes} [Thu Oct 13 13:02:50 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 13:02:51.136595 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi [None req-90616786-47e0-4131-a491-65a06e814d23 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 5, "id": "d1", "os-flavor-access:is_public": true, "name": "ds512M", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "vcpus": 1, "ram": 512, "swap": 0}} {{(pid=103790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 13:02:51.180920 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: INFO nova.api.openstack.requestlog [None req-90616786-47e0-4131-a491-65a06e814d23 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.711589 Oct 13 13:02:51.182581 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: [pid: 103790|app: 0|req: 4/8] 10.222.0.23 () {64 vars in 1283 bytes} [Thu Oct 13 13:02:50 2022] POST /compute/v2.1/flavors => generated 404 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 13 13:02:51.195061 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi [None req-354e7dfd-9948-471f-870a-6153dab7ce26 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 13:02:51.236213 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: INFO nova.api.openstack.requestlog [None req-354e7dfd-9948-471f-870a-6153dab7ce26 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.044838 Oct 13 13:02:51.236914 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: [pid: 103791|app: 0|req: 5/9] 10.222.0.23 () {64 vars in 1336 bytes} [Thu Oct 13 13:02:51 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:02:53.843541 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi [None req-90616786-47e0-4131-a491-65a06e814d23 admin admin] Calling method '>' {{(pid=103790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:02:53.844616 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: INFO nova.api.openstack.requestlog [None req-90616786-47e0-4131-a491-65a06e814d23 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001544 Oct 13 13:02:53.845199 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: [pid: 103790|app: 0|req: 5/10] 10.222.0.23 () {54 vars in 931 bytes} [Thu Oct 13 13:02:53 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 13:02:54.256601 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi [None req-9ad2901f-30a6-4bf4-a913-65acc9219593 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds1G", "swap": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 10, "vcpus": 1, "ram": 1024, "id": "d2"}} {{(pid=103791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 13:02:54.275194 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: INFO nova.api.openstack.requestlog [None req-9ad2901f-30a6-4bf4-a913-65acc9219593 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.423349 Oct 13 13:02:54.275760 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: [pid: 103791|app: 0|req: 6/11] 10.222.0.23 () {64 vars in 1283 bytes} [Thu Oct 13 13:02:53 2022] POST /compute/v2.1/flavors => generated 404 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 13 13:02:54.288556 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi [None req-809fd53c-da7c-4ef8-9b4d-473e45faf037 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 13:02:54.320163 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: INFO nova.api.openstack.requestlog [None req-809fd53c-da7c-4ef8-9b4d-473e45faf037 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.035402 Oct 13 13:02:54.320754 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: [pid: 103790|app: 0|req: 6/12] 10.222.0.23 () {64 vars in 1336 bytes} [Thu Oct 13 13:02:54 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:02:56.943588 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi [None req-9ad2901f-30a6-4bf4-a913-65acc9219593 admin admin] Calling method '>' {{(pid=103791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:02:56.944616 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: INFO nova.api.openstack.requestlog [None req-9ad2901f-30a6-4bf4-a913-65acc9219593 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001479 Oct 13 13:02:56.945026 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: [pid: 103791|app: 0|req: 7/13] 10.222.0.23 () {54 vars in 931 bytes} [Thu Oct 13 13:02:56 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 13:02:57.373568 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi [None req-98d3628b-f49a-44c2-ba37-7b3b8cd31b02 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 2, "swap": 0, "disk": 10, "id": "d3", "name": "ds2G", "ram": 2048, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=103790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 13:02:57.393155 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: INFO nova.api.openstack.requestlog [None req-98d3628b-f49a-44c2-ba37-7b3b8cd31b02 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.441928 Oct 13 13:02:57.393804 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: [pid: 103790|app: 0|req: 7/14] 10.222.0.23 () {64 vars in 1283 bytes} [Thu Oct 13 13:02:56 2022] POST /compute/v2.1/flavors => generated 404 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 13 13:02:57.406482 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi [None req-9821df1b-d998-4bcf-be5f-a1ad1129d330 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 13:02:57.435113 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: INFO nova.api.openstack.requestlog [None req-9821df1b-d998-4bcf-be5f-a1ad1129d330 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032161 Oct 13 13:02:57.435684 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: [pid: 103791|app: 0|req: 8/15] 10.222.0.23 () {64 vars in 1336 bytes} [Thu Oct 13 13:02:57 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:03:00.110703 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi [None req-98d3628b-f49a-44c2-ba37-7b3b8cd31b02 admin admin] Calling method '>' {{(pid=103790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:03:00.111816 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: INFO nova.api.openstack.requestlog [None req-98d3628b-f49a-44c2-ba37-7b3b8cd31b02 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001513 Oct 13 13:03:00.112431 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: [pid: 103790|app: 0|req: 8/16] 10.222.0.23 () {54 vars in 931 bytes} [Thu Oct 13 13:03:00 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 13:03:00.533532 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi [None req-63257fb4-c757-440a-ad8b-4404b229dcda admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "id": "d4", "name": "ds4G", "disk": 20, "vcpus": 4, "rxtx_factor": 1.0, "swap": 0, "ram": 4096, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=103791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 13:03:00.553211 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: INFO nova.api.openstack.requestlog [None req-63257fb4-c757-440a-ad8b-4404b229dcda admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.434203 Oct 13 13:03:00.553882 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: [pid: 103791|app: 0|req: 9/17] 10.222.0.23 () {64 vars in 1283 bytes} [Thu Oct 13 13:03:00 2022] POST /compute/v2.1/flavors => generated 404 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 13 13:03:00.567889 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi [None req-dbab362e-ae33-404d-a56e-39dbbc50d18c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 13:03:00.595449 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: INFO nova.api.openstack.requestlog [None req-dbab362e-ae33-404d-a56e-39dbbc50d18c admin admin] 10.222.0.23 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031621 Oct 13 13:03:00.596232 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: [pid: 103790|app: 0|req: 9/18] 10.222.0.23 () {64 vars in 1336 bytes} [Thu Oct 13 13:03:00 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:03:03.184864 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi [None req-63257fb4-c757-440a-ad8b-4404b229dcda admin admin] Calling method '>' {{(pid=103791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:03:03.185838 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: INFO nova.api.openstack.requestlog [None req-63257fb4-c757-440a-ad8b-4404b229dcda admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001707 Oct 13 13:03:03.186292 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: [pid: 103791|app: 0|req: 10/19] 10.222.0.23 () {54 vars in 931 bytes} [Thu Oct 13 13:03:03 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 13:03:03.607383 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi [None req-4325c042-0c0c-48d8-b738-8f1b5f914876 admin admin] Calling method '>' {{(pid=103790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:03:03.631905 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: INFO nova.api.openstack.requestlog [None req-4325c042-0c0c-48d8-b738-8f1b5f914876 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.438859 Oct 13 13:03:03.632464 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: [pid: 103790|app: 0|req: 10/20] 10.222.0.23 () {60 vars in 1292 bytes} [Thu Oct 13 13:03:03 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 13 13:03:06.228725 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi [None req-63257fb4-c757-440a-ad8b-4404b229dcda admin admin] Calling method '>' {{(pid=103791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:03:06.230317 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: INFO nova.api.openstack.requestlog [None req-63257fb4-c757-440a-ad8b-4404b229dcda admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001472 Oct 13 13:03:06.230730 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: [pid: 103791|app: 0|req: 11/21] 10.222.0.23 () {54 vars in 931 bytes} [Thu Oct 13 13:03:06 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 13:03:06.693339 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi [None req-a980dcfa-468e-42e6-be8b-f0af8a08342d admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "disk": 1, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "ram": 512, "id": "1", "swap": 0, "name": "m1.tiny"}} {{(pid=103790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 13:03:06.715548 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: INFO nova.api.openstack.requestlog [None req-a980dcfa-468e-42e6-be8b-f0af8a08342d admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.478649 Oct 13 13:03:06.716104 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: [pid: 103790|app: 0|req: 11/22] 10.222.0.23 () {64 vars in 1283 bytes} [Thu Oct 13 13:03:06 2022] POST /compute/v2.1/flavors => generated 402 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 13 13:03:06.728024 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi [None req-c29b755c-f6b2-4002-b80a-36b759f299f6 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 13:03:06.756819 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: INFO nova.api.openstack.requestlog [None req-c29b755c-f6b2-4002-b80a-36b759f299f6 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032388 Oct 13 13:03:06.757404 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: [pid: 103791|app: 0|req: 12/23] 10.222.0.23 () {64 vars in 1333 bytes} [Thu Oct 13 13:03:06 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 13:03:09.653427 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi [None req-a980dcfa-468e-42e6-be8b-f0af8a08342d admin admin] Calling method '>' {{(pid=103790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:03:09.654465 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: INFO nova.api.openstack.requestlog [None req-a980dcfa-468e-42e6-be8b-f0af8a08342d admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001484 Oct 13 13:03:09.654868 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: [pid: 103790|app: 0|req: 12/24] 10.222.0.23 () {54 vars in 931 bytes} [Thu Oct 13 13:03:09 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 13:03:10.073700 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi [None req-d4a02699-62bb-4b58-852d-ea743f3d8659 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.small", "OS-FLV-EXT-DATA:ephemeral": 0, "id": "2", "disk": 20, "os-flavor-access:is_public": true, "swap": 0, "ram": 2048, "vcpus": 1, "rxtx_factor": 1.0}} {{(pid=103791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 13:03:10.094030 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: INFO nova.api.openstack.requestlog [None req-d4a02699-62bb-4b58-852d-ea743f3d8659 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.432959 Oct 13 13:03:10.094902 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: [pid: 103791|app: 0|req: 13/25] 10.222.0.23 () {64 vars in 1283 bytes} [Thu Oct 13 13:03:09 2022] POST /compute/v2.1/flavors => generated 405 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 13 13:03:10.107390 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi [None req-ee67c71b-fa7d-413a-92cc-b6d3a73359bd admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 13:03:10.130962 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: INFO nova.api.openstack.requestlog [None req-ee67c71b-fa7d-413a-92cc-b6d3a73359bd admin admin] 10.222.0.23 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027989 Oct 13 13:03:10.131665 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: [pid: 103790|app: 0|req: 13/26] 10.222.0.23 () {64 vars in 1333 bytes} [Thu Oct 13 13:03:10 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:03:12.705233 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi [None req-d4a02699-62bb-4b58-852d-ea743f3d8659 admin admin] Calling method '>' {{(pid=103791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:03:12.706262 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: INFO nova.api.openstack.requestlog [None req-d4a02699-62bb-4b58-852d-ea743f3d8659 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001504 Oct 13 13:03:12.706688 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: [pid: 103791|app: 0|req: 14/27] 10.222.0.23 () {54 vars in 931 bytes} [Thu Oct 13 13:03:12 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 13:03:13.089996 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi [None req-5362fd22-cde8-4f51-9e5d-674e99f1cca2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "vcpus": 2, "name": "m1.medium", "swap": 0, "id": "3", "ram": 4096, "disk": 40, "os-flavor-access:is_public": true}} {{(pid=103790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 13:03:13.112827 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: INFO nova.api.openstack.requestlog [None req-5362fd22-cde8-4f51-9e5d-674e99f1cca2 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.399057 Oct 13 13:03:13.113508 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: [pid: 103790|app: 0|req: 14/28] 10.222.0.23 () {64 vars in 1283 bytes} [Thu Oct 13 13:03:12 2022] POST /compute/v2.1/flavors => generated 406 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 13 13:03:13.126843 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi [None req-bfc83548-397f-4fff-a689-2dbd3604e103 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 13:03:13.154137 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: INFO nova.api.openstack.requestlog [None req-bfc83548-397f-4fff-a689-2dbd3604e103 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031215 Oct 13 13:03:13.154715 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: [pid: 103791|app: 0|req: 15/29] 10.222.0.23 () {64 vars in 1333 bytes} [Thu Oct 13 13:03:13 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:03:15.765427 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi [None req-5362fd22-cde8-4f51-9e5d-674e99f1cca2 admin admin] Calling method '>' {{(pid=103790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:03:15.767297 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: INFO nova.api.openstack.requestlog [None req-5362fd22-cde8-4f51-9e5d-674e99f1cca2 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002267 Oct 13 13:03:15.767920 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: [pid: 103790|app: 0|req: 15/30] 10.222.0.23 () {54 vars in 931 bytes} [Thu Oct 13 13:03:15 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 13:03:16.201980 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi [None req-6689361a-f820-4c50-9644-8d44e6c516cc admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "id": "4", "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 8192, "rxtx_factor": 1.0, "vcpus": 4, "swap": 0, "name": "m1.large", "disk": 80}} {{(pid=103791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 13:03:16.211339 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG dbcounter [-] [103791] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=8,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=103791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:03:16.224239 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: INFO nova.api.openstack.requestlog [None req-6689361a-f820-4c50-9644-8d44e6c516cc admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.450233 Oct 13 13:03:16.225029 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: [pid: 103791|app: 0|req: 16/31] 10.222.0.23 () {64 vars in 1283 bytes} [Thu Oct 13 13:03:15 2022] POST /compute/v2.1/flavors => generated 405 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 13 13:03:16.237208 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi [None req-0e913668-8ae9-4784-b865-074bbf0b8003 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 13:03:16.262046 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: INFO nova.api.openstack.requestlog [None req-0e913668-8ae9-4784-b865-074bbf0b8003 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028541 Oct 13 13:03:16.262631 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: [pid: 103790|app: 0|req: 16/32] 10.222.0.23 () {64 vars in 1333 bytes} [Thu Oct 13 13:03:16 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 13:03:18.882836 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi [None req-6689361a-f820-4c50-9644-8d44e6c516cc admin admin] Calling method '>' {{(pid=103791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:03:18.884005 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: INFO nova.api.openstack.requestlog [None req-6689361a-f820-4c50-9644-8d44e6c516cc admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001607 Oct 13 13:03:18.884660 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: [pid: 103791|app: 0|req: 17/33] 10.222.0.23 () {54 vars in 931 bytes} [Thu Oct 13 13:03:18 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 13:03:19.336452 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi [None req-92f33f6a-aa65-4358-b759-be702e2d6e3a admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "disk": 160, "vcpus": 8, "id": "5", "swap": 0, "rxtx_factor": 1.0, "name": "m1.xlarge", "ram": 16384}} {{(pid=103790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 13:03:19.342953 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG dbcounter [-] [103790] Writing DB stats nova_api:SELECT=45,nova_api:SAVEPOINT=5,nova_api:INSERT=9,nova_api:RELEASE=5 {{(pid=103790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:03:19.358381 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: INFO nova.api.openstack.requestlog [None req-92f33f6a-aa65-4358-b759-be702e2d6e3a admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.467264 Oct 13 13:03:19.359378 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: [pid: 103790|app: 0|req: 17/34] 10.222.0.23 () {64 vars in 1283 bytes} [Thu Oct 13 13:03:18 2022] POST /compute/v2.1/flavors => generated 408 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 13 13:03:19.374234 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi [None req-67b15da6-ff8d-48b2-a149-4091f5db5df0 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 13:03:19.398332 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: INFO nova.api.openstack.requestlog [None req-67b15da6-ff8d-48b2-a149-4091f5db5df0 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030819 Oct 13 13:03:19.399108 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: [pid: 103791|app: 0|req: 18/35] 10.222.0.23 () {64 vars in 1333 bytes} [Thu Oct 13 13:03:19 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 13:03:40.030890 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi [None req-92f33f6a-aa65-4358-b759-be702e2d6e3a admin admin] Calling method '>' {{(pid=103790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:03:40.031940 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: INFO nova.api.openstack.requestlog [None req-92f33f6a-aa65-4358-b759-be702e2d6e3a admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001518 Oct 13 13:03:40.032352 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: [pid: 103790|app: 0|req: 18/36] 10.222.0.23 () {54 vars in 931 bytes} [Thu Oct 13 13:03:40 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 13:03:40.043401 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG dbcounter [-] [103791] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=8,nova_api:SAVEPOINT=1,nova_api:RELEASE=1 {{(pid=103791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:03:40.410479 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi [None req-28654ecd-d453-4c1e-adb2-22af7de1dc2a admin admin] Calling method '>' {{(pid=103791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:03:40.428721 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: INFO nova.api.openstack.requestlog [None req-28654ecd-d453-4c1e-adb2-22af7de1dc2a admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.390367 Oct 13 13:03:40.429252 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: [pid: 103791|app: 0|req: 19/37] 10.222.0.23 () {60 vars in 1292 bytes} [Thu Oct 13 13:03:40 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 13:03:41.722410 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi [None req-92f33f6a-aa65-4358-b759-be702e2d6e3a admin admin] Calling method '>' {{(pid=103790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:03:41.723496 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: INFO nova.api.openstack.requestlog [None req-92f33f6a-aa65-4358-b759-be702e2d6e3a admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001468 Oct 13 13:03:41.723901 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: [pid: 103790|app: 0|req: 19/38] 10.222.0.23 () {56 vars in 1074 bytes} [Thu Oct 13 13:03:41 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 13 13:03:42.239514 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi [None req-3d46592a-cbca-4444-98a5-131fb796a1bc admin admin] Calling method '>' {{(pid=103791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:03:42.245270 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: INFO nova.api.openstack.wsgi [None req-3d46592a-cbca-4444-98a5-131fb796a1bc admin admin] HTTP exception thrown: Flavor 42 could not be found. Oct 13 13:03:42.248694 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi [None req-3d46592a-cbca-4444-98a5-131fb796a1bc admin admin] Request method failure captured: Oct 13 13:03:42.248694 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Oct 13 13:03:42.248694 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: Accept: application/json Oct 13 13:03:42.248694 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: Accept-Encoding: gzip, deflate Oct 13 13:03:42.248694 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: Connection: keep-alive Oct 13 13:03:42.248694 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: Content-Length: 0 Oct 13 13:03:42.248694 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: Host: 10.222.0.23 Oct 13 13:03:42.248694 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: Openstack-Api-Version: compute 2.92 Oct 13 13:03:42.248694 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: Openstack-System-Scope: None Oct 13 13:03:42.248694 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: User-Agent: python-novaclient Oct 13 13:03:42.248694 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: X-Auth-Token: gAAAAABjSAytcLmBmb7iQ3HpproWfXmsq5eExwyro6jLoKLVZGnCVYVskrarfM0tylxVd4pv_qP2Kdpytd8ZMO6oCLcXc-SvcuRf1zEnU6xS5gOBRLG1mlULX06weL9Kfs-jFWHekB5NslZKzVQTTKpN0y4_GBRZcj_4tYTcaGjiY6X_hOzyzjk Oct 13 13:03:42.248694 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: X-Domain-Id: None Oct 13 13:03:42.248694 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: X-Domain-Name: None Oct 13 13:03:42.248694 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: X-Identity-Status: Confirmed Oct 13 13:03:42.248694 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: X-Is-Admin-Project: True Oct 13 13:03:42.248694 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: X-Openstack-Nova-Api-Version: 2.92 Oct 13 13:03:42.248694 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: X-Project-Domain-Id: default Oct 13 13:03:42.248694 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: X-Project-Domain-Name: Default Oct 13 13:03:42.248694 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: X-Project-Id: 9cb9d18ca96e4beea199d190db853658 Oct 13 13:03:42.248694 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: X-Project-Name: admin Oct 13 13:03:42.248694 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: X-Role: reader,member,admin Oct 13 13:03:42.248694 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: X-Roles: reader,member,admin Oct 13 13:03:42.250267 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_9cb9d18ca96e4beea199d190db853658"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/9cb9d18ca96e4beea199d190db853658"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/9cb9d18ca96e4beea199d190db853658"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/9cb9d18ca96e4beea199d190db853658"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}] Oct 13 13:03:42.250267 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: X-Tenant: admin Oct 13 13:03:42.250267 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: X-Tenant-Id: 9cb9d18ca96e4beea199d190db853658 Oct 13 13:03:42.250267 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: X-Tenant-Name: admin Oct 13 13:03:42.250267 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: X-User: admin Oct 13 13:03:42.250267 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: X-User-Domain-Id: default Oct 13 13:03:42.250267 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: X-User-Domain-Name: Default Oct 13 13:03:42.250267 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: X-User-Id: 22269fc49ecd49a7b97d86f5937fc2dc Oct 13 13:03:42.250267 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: X-User-Name: admin Oct 13 13:03:42.250267 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: method: > Oct 13 13:03:42.250267 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: exception: Flavor 42 could not be found. Oct 13 13:03:42.250267 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: action_args: {'id': '42'} Oct 13 13:03:42.250267 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: {{(pid=103791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 13:03:42.250267 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 13:03:42.251147 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 13 13:03:42.251147 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 13 13:03:42.251147 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 13 13:03:42.251147 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 13 13:03:42.251147 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 13 13:03:42.251147 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 13 13:03:42.251147 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 13 13:03:42.251147 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 13 13:03:42.251147 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 13 13:03:42.251147 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 13:03:42.251147 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 13 13:03:42.251147 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 13 13:03:42.251147 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Oct 13 13:03:42.251147 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: ERROR nova.api.openstack.wsgi Oct 13 13:03:42.251147 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 13:03:42.251147 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: ERROR nova.api.openstack.wsgi Oct 13 13:03:42.251147 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 13:03:42.251147 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 13:03:42.251147 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 13:03:42.252362 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 13:03:42.252362 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 13:03:42.252362 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 13:03:42.252362 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 13:03:42.252362 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 13 13:03:42.252362 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 13 13:03:42.252362 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Oct 13 13:03:42.252362 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: ERROR nova.api.openstack.wsgi Oct 13 13:03:42.252362 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 13:03:42.252362 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: ERROR nova.api.openstack.wsgi Oct 13 13:03:42.252362 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 13:03:42.252362 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 13:03:42.252362 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 13:03:42.252362 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 13:03:42.252362 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 13:03:42.252362 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Oct 13 13:03:42.252362 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: ERROR nova.api.openstack.wsgi Oct 13 13:03:42.252362 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi [None req-3d46592a-cbca-4444-98a5-131fb796a1bc admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103791) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 13:03:42.253378 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: INFO nova.api.openstack.requestlog [None req-3d46592a-cbca-4444-98a5-131fb796a1bc admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.387896 Oct 13 13:03:42.253378 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: [pid: 103791|app: 0|req: 20/39] 10.222.0.23 () {60 vars in 1190 bytes} [Thu Oct 13 13:03:41 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 389 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 13 13:03:42.261208 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi [None req-31e74dc0-fa7e-455f-a946-a6d5c2751697 admin admin] Calling method '>' {{(pid=103790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:03:42.284552 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: INFO nova.api.openstack.requestlog [None req-31e74dc0-fa7e-455f-a946-a6d5c2751697 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.027931 Oct 13 13:03:42.285062 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: [pid: 103790|app: 0|req: 20/40] 10.222.0.23 () {60 vars in 1210 bytes} [Thu Oct 13 13:03:42 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 13:03:42.295972 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi [None req-cb4e5312-7724-4c8b-a170-10896a17119f admin admin] Calling method '>' {{(pid=103791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:03:42.317724 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: INFO nova.api.openstack.requestlog [None req-cb4e5312-7724-4c8b-a170-10896a17119f admin admin] 10.222.0.23 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.026130 Oct 13 13:03:42.318249 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: [pid: 103791|app: 0|req: 21/41] 10.222.0.23 () {60 vars in 1210 bytes} [Thu Oct 13 13:03:42 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 13:03:42.327314 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi [None req-ae88f4c7-1a58-41df-b9b8-f19786ae51dd admin admin] Calling method '>' {{(pid=103790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:03:42.332608 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: INFO nova.api.openstack.wsgi [None req-ae88f4c7-1a58-41df-b9b8-f19786ae51dd admin admin] HTTP exception thrown: Flavor 42 could not be found. Oct 13 13:03:42.335863 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi [None req-ae88f4c7-1a58-41df-b9b8-f19786ae51dd admin admin] Request method failure captured: Oct 13 13:03:42.335863 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Oct 13 13:03:42.335863 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: Accept: application/json Oct 13 13:03:42.335863 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: Accept-Encoding: gzip, deflate Oct 13 13:03:42.335863 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: Connection: keep-alive Oct 13 13:03:42.335863 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: Content-Length: 0 Oct 13 13:03:42.335863 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: Host: 10.222.0.23 Oct 13 13:03:42.335863 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: Openstack-Api-Version: compute 2.92 Oct 13 13:03:42.335863 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: Openstack-System-Scope: None Oct 13 13:03:42.335863 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: User-Agent: python-novaclient Oct 13 13:03:42.335863 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: X-Auth-Token: gAAAAABjSAytcLmBmb7iQ3HpproWfXmsq5eExwyro6jLoKLVZGnCVYVskrarfM0tylxVd4pv_qP2Kdpytd8ZMO6oCLcXc-SvcuRf1zEnU6xS5gOBRLG1mlULX06weL9Kfs-jFWHekB5NslZKzVQTTKpN0y4_GBRZcj_4tYTcaGjiY6X_hOzyzjk Oct 13 13:03:42.335863 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: X-Domain-Id: None Oct 13 13:03:42.335863 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: X-Domain-Name: None Oct 13 13:03:42.335863 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: X-Identity-Status: Confirmed Oct 13 13:03:42.335863 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: X-Is-Admin-Project: True Oct 13 13:03:42.335863 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: X-Openstack-Nova-Api-Version: 2.92 Oct 13 13:03:42.335863 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: X-Project-Domain-Id: default Oct 13 13:03:42.335863 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: X-Project-Domain-Name: Default Oct 13 13:03:42.335863 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: X-Project-Id: 9cb9d18ca96e4beea199d190db853658 Oct 13 13:03:42.335863 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: X-Project-Name: admin Oct 13 13:03:42.335863 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: X-Role: reader,member,admin Oct 13 13:03:42.335863 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: X-Roles: reader,member,admin Oct 13 13:03:42.338048 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_9cb9d18ca96e4beea199d190db853658"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/9cb9d18ca96e4beea199d190db853658"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/9cb9d18ca96e4beea199d190db853658"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/9cb9d18ca96e4beea199d190db853658"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}] Oct 13 13:03:42.338048 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: X-Tenant: admin Oct 13 13:03:42.338048 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: X-Tenant-Id: 9cb9d18ca96e4beea199d190db853658 Oct 13 13:03:42.338048 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: X-Tenant-Name: admin Oct 13 13:03:42.338048 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: X-User: admin Oct 13 13:03:42.338048 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: X-User-Domain-Id: default Oct 13 13:03:42.338048 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: X-User-Domain-Name: Default Oct 13 13:03:42.338048 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: X-User-Id: 22269fc49ecd49a7b97d86f5937fc2dc Oct 13 13:03:42.338048 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: X-User-Name: admin Oct 13 13:03:42.338048 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: method: > Oct 13 13:03:42.338048 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: exception: Flavor 42 could not be found. Oct 13 13:03:42.338048 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: action_args: {'id': '42'} Oct 13 13:03:42.338048 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: {{(pid=103790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 13:03:42.338048 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 13:03:42.338918 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 13 13:03:42.338918 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 13 13:03:42.338918 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 13 13:03:42.338918 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 13 13:03:42.338918 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 13 13:03:42.338918 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 13 13:03:42.338918 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 13 13:03:42.338918 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 13 13:03:42.338918 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 13 13:03:42.338918 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 13:03:42.338918 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 13 13:03:42.338918 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 13 13:03:42.338918 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Oct 13 13:03:42.338918 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: ERROR nova.api.openstack.wsgi Oct 13 13:03:42.338918 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 13:03:42.338918 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: ERROR nova.api.openstack.wsgi Oct 13 13:03:42.338918 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 13:03:42.338918 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 13:03:42.338918 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 13:03:42.340289 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 13:03:42.340289 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 13:03:42.340289 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 13:03:42.340289 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 13:03:42.340289 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 13 13:03:42.340289 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 13 13:03:42.340289 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Oct 13 13:03:42.340289 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: ERROR nova.api.openstack.wsgi Oct 13 13:03:42.340289 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 13:03:42.340289 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: ERROR nova.api.openstack.wsgi Oct 13 13:03:42.340289 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 13:03:42.340289 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 13:03:42.340289 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 13:03:42.340289 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 13:03:42.340289 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 13:03:42.340289 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Oct 13 13:03:42.340289 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: ERROR nova.api.openstack.wsgi Oct 13 13:03:42.340289 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi [None req-ae88f4c7-1a58-41df-b9b8-f19786ae51dd admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103790) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 13:03:42.341483 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: INFO nova.api.openstack.requestlog [None req-ae88f4c7-1a58-41df-b9b8-f19786ae51dd admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.013434 Oct 13 13:03:42.341483 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: [pid: 103790|app: 0|req: 21/42] 10.222.0.23 () {60 vars in 1190 bytes} [Thu Oct 13 13:03:42 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Oct 13 13:03:43.542163 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi [None req-cb4e5312-7724-4c8b-a170-10896a17119f admin admin] Calling method '>' {{(pid=103791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:03:43.543223 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: INFO nova.api.openstack.requestlog [None req-cb4e5312-7724-4c8b-a170-10896a17119f admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001447 Oct 13 13:03:43.543633 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: [pid: 103791|app: 0|req: 22/43] 10.222.0.23 () {56 vars in 1074 bytes} [Thu Oct 13 13:03:43 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 13:03:44.055908 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi [None req-d08ce847-65b5-460c-923d-fd437ebee8e0 admin admin] Calling method '>' {{(pid=103790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:03:44.061758 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: INFO nova.api.openstack.wsgi [None req-d08ce847-65b5-460c-923d-fd437ebee8e0 admin admin] HTTP exception thrown: Flavor 84 could not be found. Oct 13 13:03:44.063338 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi [None req-d08ce847-65b5-460c-923d-fd437ebee8e0 admin admin] Request method failure captured: Oct 13 13:03:44.063338 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Oct 13 13:03:44.063338 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: Accept: application/json Oct 13 13:03:44.063338 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: Accept-Encoding: gzip, deflate Oct 13 13:03:44.063338 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: Connection: keep-alive Oct 13 13:03:44.063338 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: Content-Length: 0 Oct 13 13:03:44.063338 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: Host: 10.222.0.23 Oct 13 13:03:44.063338 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: Openstack-Api-Version: compute 2.92 Oct 13 13:03:44.063338 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: Openstack-System-Scope: None Oct 13 13:03:44.063338 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: User-Agent: python-novaclient Oct 13 13:03:44.063338 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: X-Auth-Token: gAAAAABjSAyv0DAfUzGQNRUZRFAARgCIdbwCCKu-4e2jU1gvffTfuYPTilj5rG2jG0lUzy-37B53e-LhYyTmDGNIxwgGJTLTE1ZJe8s42301aY6gsTiu_F6vzqQ731EyRhepc9pWOnJs8_GoHh3Y7NKVB-kLBdA_em50VWNmqvlVOcLdoTEzwtU Oct 13 13:03:44.063338 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: X-Domain-Id: None Oct 13 13:03:44.063338 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: X-Domain-Name: None Oct 13 13:03:44.063338 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: X-Identity-Status: Confirmed Oct 13 13:03:44.063338 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: X-Is-Admin-Project: True Oct 13 13:03:44.063338 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: X-Openstack-Nova-Api-Version: 2.92 Oct 13 13:03:44.063338 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: X-Project-Domain-Id: default Oct 13 13:03:44.063338 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: X-Project-Domain-Name: Default Oct 13 13:03:44.063338 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: X-Project-Id: 9cb9d18ca96e4beea199d190db853658 Oct 13 13:03:44.063338 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: X-Project-Name: admin Oct 13 13:03:44.063338 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: X-Role: reader,member,admin Oct 13 13:03:44.063338 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: X-Roles: reader,member,admin Oct 13 13:03:44.064946 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_9cb9d18ca96e4beea199d190db853658"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/9cb9d18ca96e4beea199d190db853658"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/9cb9d18ca96e4beea199d190db853658"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/9cb9d18ca96e4beea199d190db853658"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}] Oct 13 13:03:44.064946 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: X-Tenant: admin Oct 13 13:03:44.064946 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: X-Tenant-Id: 9cb9d18ca96e4beea199d190db853658 Oct 13 13:03:44.064946 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: X-Tenant-Name: admin Oct 13 13:03:44.064946 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: X-User: admin Oct 13 13:03:44.064946 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: X-User-Domain-Id: default Oct 13 13:03:44.064946 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: X-User-Domain-Name: Default Oct 13 13:03:44.064946 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: X-User-Id: 22269fc49ecd49a7b97d86f5937fc2dc Oct 13 13:03:44.064946 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: X-User-Name: admin Oct 13 13:03:44.064946 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: method: > Oct 13 13:03:44.064946 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: exception: Flavor 84 could not be found. Oct 13 13:03:44.064946 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: action_args: {'id': '84'} Oct 13 13:03:44.064946 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: {{(pid=103790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 13:03:44.064946 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 13:03:44.065906 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 13 13:03:44.065906 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 13 13:03:44.065906 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 13 13:03:44.065906 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 13 13:03:44.065906 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 13 13:03:44.065906 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 13 13:03:44.065906 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 13 13:03:44.065906 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 13 13:03:44.065906 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 13 13:03:44.065906 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 13:03:44.065906 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 13 13:03:44.065906 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 13 13:03:44.065906 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Oct 13 13:03:44.065906 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: ERROR nova.api.openstack.wsgi Oct 13 13:03:44.065906 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 13:03:44.065906 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: ERROR nova.api.openstack.wsgi Oct 13 13:03:44.065906 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 13:03:44.065906 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 13:03:44.065906 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 13:03:44.067001 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 13:03:44.067001 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 13:03:44.067001 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 13:03:44.067001 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 13:03:44.067001 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 13 13:03:44.067001 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 13 13:03:44.067001 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Oct 13 13:03:44.067001 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: ERROR nova.api.openstack.wsgi Oct 13 13:03:44.067001 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 13:03:44.067001 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: ERROR nova.api.openstack.wsgi Oct 13 13:03:44.067001 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 13:03:44.067001 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 13:03:44.067001 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 13:03:44.067001 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 13:03:44.067001 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 13:03:44.067001 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Oct 13 13:03:44.067001 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: ERROR nova.api.openstack.wsgi Oct 13 13:03:44.067001 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi [None req-d08ce847-65b5-460c-923d-fd437ebee8e0 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103790) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 13:03:44.068024 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: INFO nova.api.openstack.requestlog [None req-d08ce847-65b5-460c-923d-fd437ebee8e0 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.384634 Oct 13 13:03:44.068024 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: [pid: 103790|app: 0|req: 22/44] 10.222.0.23 () {60 vars in 1190 bytes} [Thu Oct 13 13:03:43 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 386 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 13 13:03:44.074504 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi [None req-d39d7fee-5476-4ac8-8415-e7acba7612b2 admin admin] Calling method '>' {{(pid=103791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:03:44.089322 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: INFO nova.api.openstack.requestlog [None req-d39d7fee-5476-4ac8-8415-e7acba7612b2 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018374 Oct 13 13:03:44.089879 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: [pid: 103791|app: 0|req: 23/45] 10.222.0.23 () {60 vars in 1210 bytes} [Thu Oct 13 13:03:44 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 13:03:44.099070 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi [None req-1c9be624-e599-436f-98a6-bfa75f325f68 admin admin] Calling method '>' {{(pid=103790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:03:44.114684 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: INFO nova.api.openstack.requestlog [None req-1c9be624-e599-436f-98a6-bfa75f325f68 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019090 Oct 13 13:03:44.115226 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: [pid: 103790|app: 0|req: 23/46] 10.222.0.23 () {60 vars in 1210 bytes} [Thu Oct 13 13:03:44 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 13:03:44.124660 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi [None req-fe2d0915-7f33-4378-a702-ec587c0dcc9e admin admin] Calling method '>' {{(pid=103791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:03:44.129482 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: INFO nova.api.openstack.wsgi [None req-fe2d0915-7f33-4378-a702-ec587c0dcc9e admin admin] HTTP exception thrown: Flavor 84 could not be found. Oct 13 13:03:44.130974 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi [None req-fe2d0915-7f33-4378-a702-ec587c0dcc9e admin admin] Request method failure captured: Oct 13 13:03:44.130974 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Oct 13 13:03:44.130974 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: Accept: application/json Oct 13 13:03:44.130974 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: Accept-Encoding: gzip, deflate Oct 13 13:03:44.130974 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: Connection: keep-alive Oct 13 13:03:44.130974 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: Content-Length: 0 Oct 13 13:03:44.130974 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: Host: 10.222.0.23 Oct 13 13:03:44.130974 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: Openstack-Api-Version: compute 2.92 Oct 13 13:03:44.130974 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: Openstack-System-Scope: None Oct 13 13:03:44.130974 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: User-Agent: python-novaclient Oct 13 13:03:44.130974 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: X-Auth-Token: gAAAAABjSAyv0DAfUzGQNRUZRFAARgCIdbwCCKu-4e2jU1gvffTfuYPTilj5rG2jG0lUzy-37B53e-LhYyTmDGNIxwgGJTLTE1ZJe8s42301aY6gsTiu_F6vzqQ731EyRhepc9pWOnJs8_GoHh3Y7NKVB-kLBdA_em50VWNmqvlVOcLdoTEzwtU Oct 13 13:03:44.130974 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: X-Domain-Id: None Oct 13 13:03:44.130974 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: X-Domain-Name: None Oct 13 13:03:44.130974 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: X-Identity-Status: Confirmed Oct 13 13:03:44.130974 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: X-Is-Admin-Project: True Oct 13 13:03:44.130974 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: X-Openstack-Nova-Api-Version: 2.92 Oct 13 13:03:44.130974 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: X-Project-Domain-Id: default Oct 13 13:03:44.130974 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: X-Project-Domain-Name: Default Oct 13 13:03:44.130974 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: X-Project-Id: 9cb9d18ca96e4beea199d190db853658 Oct 13 13:03:44.130974 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: X-Project-Name: admin Oct 13 13:03:44.130974 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: X-Role: reader,member,admin Oct 13 13:03:44.130974 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: X-Roles: reader,member,admin Oct 13 13:03:44.132369 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_9cb9d18ca96e4beea199d190db853658"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/9cb9d18ca96e4beea199d190db853658"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/9cb9d18ca96e4beea199d190db853658"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/9cb9d18ca96e4beea199d190db853658"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}] Oct 13 13:03:44.132369 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: X-Tenant: admin Oct 13 13:03:44.132369 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: X-Tenant-Id: 9cb9d18ca96e4beea199d190db853658 Oct 13 13:03:44.132369 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: X-Tenant-Name: admin Oct 13 13:03:44.132369 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: X-User: admin Oct 13 13:03:44.132369 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: X-User-Domain-Id: default Oct 13 13:03:44.132369 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: X-User-Domain-Name: Default Oct 13 13:03:44.132369 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: X-User-Id: 22269fc49ecd49a7b97d86f5937fc2dc Oct 13 13:03:44.132369 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: X-User-Name: admin Oct 13 13:03:44.132369 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: method: > Oct 13 13:03:44.132369 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: exception: Flavor 84 could not be found. Oct 13 13:03:44.132369 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: action_args: {'id': '84'} Oct 13 13:03:44.132369 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: {{(pid=103791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 13:03:44.132369 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 13:03:44.133171 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 13 13:03:44.133171 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 13 13:03:44.133171 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 13 13:03:44.133171 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 13 13:03:44.133171 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 13 13:03:44.133171 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 13 13:03:44.133171 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 13 13:03:44.133171 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 13 13:03:44.133171 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 13 13:03:44.133171 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 13:03:44.133171 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 13 13:03:44.133171 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 13 13:03:44.133171 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Oct 13 13:03:44.133171 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: ERROR nova.api.openstack.wsgi Oct 13 13:03:44.133171 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 13:03:44.133171 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: ERROR nova.api.openstack.wsgi Oct 13 13:03:44.133171 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 13:03:44.133171 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 13:03:44.133171 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 13:03:44.134207 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 13:03:44.134207 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 13:03:44.134207 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 13:03:44.134207 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 13:03:44.134207 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 13 13:03:44.134207 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 13 13:03:44.134207 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Oct 13 13:03:44.134207 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: ERROR nova.api.openstack.wsgi Oct 13 13:03:44.134207 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 13:03:44.134207 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: ERROR nova.api.openstack.wsgi Oct 13 13:03:44.134207 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 13:03:44.134207 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 13:03:44.134207 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 13:03:44.134207 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 13:03:44.134207 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 13:03:44.134207 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Oct 13 13:03:44.134207 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: ERROR nova.api.openstack.wsgi Oct 13 13:03:44.134207 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi [None req-fe2d0915-7f33-4378-a702-ec587c0dcc9e admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103791) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 13:03:44.135214 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: INFO nova.api.openstack.requestlog [None req-fe2d0915-7f33-4378-a702-ec587c0dcc9e admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.011153 Oct 13 13:03:44.135214 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: [pid: 103791|app: 0|req: 24/47] 10.222.0.23 () {60 vars in 1190 bytes} [Thu Oct 13 13:03:44 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 13 13:03:45.354341 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi [None req-1c9be624-e599-436f-98a6-bfa75f325f68 admin admin] Calling method '>' {{(pid=103790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:03:45.355391 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: INFO nova.api.openstack.requestlog [None req-1c9be624-e599-436f-98a6-bfa75f325f68 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001992 Oct 13 13:03:45.355786 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: [pid: 103790|app: 0|req: 24/48] 10.222.0.23 () {56 vars in 1074 bytes} [Thu Oct 13 13:03:45 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 13:03:45.876531 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi [None req-de8e860d-da10-4830-8560-2d6e56ded36e admin admin] Calling method '>' {{(pid=103791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:03:45.882241 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: INFO nova.api.openstack.wsgi [None req-de8e860d-da10-4830-8560-2d6e56ded36e admin admin] HTTP exception thrown: Flavor 451 could not be found. Oct 13 13:03:45.883778 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi [None req-de8e860d-da10-4830-8560-2d6e56ded36e admin admin] Request method failure captured: Oct 13 13:03:45.883778 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Oct 13 13:03:45.883778 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: Accept: application/json Oct 13 13:03:45.883778 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: Accept-Encoding: gzip, deflate Oct 13 13:03:45.883778 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: Connection: keep-alive Oct 13 13:03:45.883778 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: Content-Length: 0 Oct 13 13:03:45.883778 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: Host: 10.222.0.23 Oct 13 13:03:45.883778 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: Openstack-Api-Version: compute 2.92 Oct 13 13:03:45.883778 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: Openstack-System-Scope: None Oct 13 13:03:45.883778 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: User-Agent: python-novaclient Oct 13 13:03:45.883778 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: X-Auth-Token: gAAAAABjSAyx8w6L-PylCOAgODL5XS6D9UAtQR5Hl36oqR7ZGu6p-66n5xU47tpa5fQiikOLMgR-33bQ6X-Oj9X1zrD34QBpUi5ahwD3xN75f0OODXIU9G28EcsviPHzMNaxxo8X7cGgLoJDejQWB89UTxyxCc8W8JYNlrHbeUsfRX41IwO7DuA Oct 13 13:03:45.883778 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: X-Domain-Id: None Oct 13 13:03:45.883778 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: X-Domain-Name: None Oct 13 13:03:45.883778 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: X-Identity-Status: Confirmed Oct 13 13:03:45.883778 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: X-Is-Admin-Project: True Oct 13 13:03:45.883778 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: X-Openstack-Nova-Api-Version: 2.92 Oct 13 13:03:45.883778 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: X-Project-Domain-Id: default Oct 13 13:03:45.883778 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: X-Project-Domain-Name: Default Oct 13 13:03:45.883778 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: X-Project-Id: 9cb9d18ca96e4beea199d190db853658 Oct 13 13:03:45.883778 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: X-Project-Name: admin Oct 13 13:03:45.883778 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: X-Role: reader,member,admin Oct 13 13:03:45.883778 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: X-Roles: reader,member,admin Oct 13 13:03:45.885379 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_9cb9d18ca96e4beea199d190db853658"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/9cb9d18ca96e4beea199d190db853658"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/9cb9d18ca96e4beea199d190db853658"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/9cb9d18ca96e4beea199d190db853658"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}] Oct 13 13:03:45.885379 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: X-Tenant: admin Oct 13 13:03:45.885379 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: X-Tenant-Id: 9cb9d18ca96e4beea199d190db853658 Oct 13 13:03:45.885379 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: X-Tenant-Name: admin Oct 13 13:03:45.885379 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: X-User: admin Oct 13 13:03:45.885379 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: X-User-Domain-Id: default Oct 13 13:03:45.885379 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: X-User-Domain-Name: Default Oct 13 13:03:45.885379 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: X-User-Id: 22269fc49ecd49a7b97d86f5937fc2dc Oct 13 13:03:45.885379 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: X-User-Name: admin Oct 13 13:03:45.885379 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: method: > Oct 13 13:03:45.885379 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: exception: Flavor 451 could not be found. Oct 13 13:03:45.885379 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: action_args: {'id': '451'} Oct 13 13:03:45.885379 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: {{(pid=103791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 13:03:45.885379 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 13:03:45.886475 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 13 13:03:45.886475 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 13 13:03:45.886475 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 13 13:03:45.886475 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 13 13:03:45.886475 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 13 13:03:45.886475 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 13 13:03:45.886475 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 13 13:03:45.886475 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 13 13:03:45.886475 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 13 13:03:45.886475 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 13:03:45.886475 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 13 13:03:45.886475 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 13 13:03:45.886475 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Oct 13 13:03:45.886475 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: ERROR nova.api.openstack.wsgi Oct 13 13:03:45.886475 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 13:03:45.886475 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: ERROR nova.api.openstack.wsgi Oct 13 13:03:45.886475 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 13:03:45.886475 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 13:03:45.886475 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 13:03:45.887908 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 13:03:45.887908 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 13:03:45.887908 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 13:03:45.887908 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 13:03:45.887908 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 13 13:03:45.887908 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 13 13:03:45.887908 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Oct 13 13:03:45.887908 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: ERROR nova.api.openstack.wsgi Oct 13 13:03:45.887908 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 13:03:45.887908 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: ERROR nova.api.openstack.wsgi Oct 13 13:03:45.887908 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 13:03:45.887908 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 13:03:45.887908 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 13:03:45.887908 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 13:03:45.887908 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 13:03:45.887908 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Oct 13 13:03:45.887908 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: ERROR nova.api.openstack.wsgi Oct 13 13:03:45.887908 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi [None req-de8e860d-da10-4830-8560-2d6e56ded36e admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103791) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 13:03:45.889159 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: INFO nova.api.openstack.requestlog [None req-de8e860d-da10-4830-8560-2d6e56ded36e admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.392868 Oct 13 13:03:45.889159 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: [pid: 103791|app: 0|req: 25/49] 10.222.0.23 () {60 vars in 1193 bytes} [Thu Oct 13 13:03:45 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 394 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 13 13:03:45.894822 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi [None req-5bd5dc4d-ba06-481c-9046-4d2bf3c400a6 admin admin] Calling method '>' {{(pid=103790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:03:45.910232 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: INFO nova.api.openstack.requestlog [None req-5bd5dc4d-ba06-481c-9046-4d2bf3c400a6 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018912 Oct 13 13:03:45.910751 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: [pid: 103790|app: 0|req: 25/50] 10.222.0.23 () {60 vars in 1210 bytes} [Thu Oct 13 13:03:45 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 13:03:45.921126 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi [None req-0941719e-9984-4a70-a67e-ed91eb67b88c admin admin] Calling method '>' {{(pid=103791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:03:45.936169 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: INFO nova.api.openstack.requestlog [None req-0941719e-9984-4a70-a67e-ed91eb67b88c admin admin] 10.222.0.23 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018667 Oct 13 13:03:45.936713 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: [pid: 103791|app: 0|req: 26/51] 10.222.0.23 () {60 vars in 1210 bytes} [Thu Oct 13 13:03:45 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 13:03:45.946023 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi [None req-eafa4244-b1a6-437c-983f-5f85fd7fa26f admin admin] Calling method '>' {{(pid=103790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:03:45.951095 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: INFO nova.api.openstack.wsgi [None req-eafa4244-b1a6-437c-983f-5f85fd7fa26f admin admin] HTTP exception thrown: Flavor 451 could not be found. Oct 13 13:03:45.952599 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi [None req-eafa4244-b1a6-437c-983f-5f85fd7fa26f admin admin] Request method failure captured: Oct 13 13:03:45.952599 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Oct 13 13:03:45.952599 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: Accept: application/json Oct 13 13:03:45.952599 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: Accept-Encoding: gzip, deflate Oct 13 13:03:45.952599 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: Connection: keep-alive Oct 13 13:03:45.952599 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: Content-Length: 0 Oct 13 13:03:45.952599 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: Host: 10.222.0.23 Oct 13 13:03:45.952599 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: Openstack-Api-Version: compute 2.92 Oct 13 13:03:45.952599 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: Openstack-System-Scope: None Oct 13 13:03:45.952599 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: User-Agent: python-novaclient Oct 13 13:03:45.952599 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: X-Auth-Token: gAAAAABjSAyx8w6L-PylCOAgODL5XS6D9UAtQR5Hl36oqR7ZGu6p-66n5xU47tpa5fQiikOLMgR-33bQ6X-Oj9X1zrD34QBpUi5ahwD3xN75f0OODXIU9G28EcsviPHzMNaxxo8X7cGgLoJDejQWB89UTxyxCc8W8JYNlrHbeUsfRX41IwO7DuA Oct 13 13:03:45.952599 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: X-Domain-Id: None Oct 13 13:03:45.952599 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: X-Domain-Name: None Oct 13 13:03:45.952599 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: X-Identity-Status: Confirmed Oct 13 13:03:45.952599 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: X-Is-Admin-Project: True Oct 13 13:03:45.952599 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: X-Openstack-Nova-Api-Version: 2.92 Oct 13 13:03:45.952599 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: X-Project-Domain-Id: default Oct 13 13:03:45.952599 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: X-Project-Domain-Name: Default Oct 13 13:03:45.952599 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: X-Project-Id: 9cb9d18ca96e4beea199d190db853658 Oct 13 13:03:45.952599 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: X-Project-Name: admin Oct 13 13:03:45.952599 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: X-Role: reader,member,admin Oct 13 13:03:45.952599 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: X-Roles: reader,member,admin Oct 13 13:03:45.954101 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_9cb9d18ca96e4beea199d190db853658"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/9cb9d18ca96e4beea199d190db853658"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/9cb9d18ca96e4beea199d190db853658"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/9cb9d18ca96e4beea199d190db853658"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}] Oct 13 13:03:45.954101 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: X-Tenant: admin Oct 13 13:03:45.954101 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: X-Tenant-Id: 9cb9d18ca96e4beea199d190db853658 Oct 13 13:03:45.954101 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: X-Tenant-Name: admin Oct 13 13:03:45.954101 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: X-User: admin Oct 13 13:03:45.954101 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: X-User-Domain-Id: default Oct 13 13:03:45.954101 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: X-User-Domain-Name: Default Oct 13 13:03:45.954101 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: X-User-Id: 22269fc49ecd49a7b97d86f5937fc2dc Oct 13 13:03:45.954101 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: X-User-Name: admin Oct 13 13:03:45.954101 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: method: > Oct 13 13:03:45.954101 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: exception: Flavor 451 could not be found. Oct 13 13:03:45.954101 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: action_args: {'id': '451'} Oct 13 13:03:45.954101 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: {{(pid=103790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 13:03:45.954101 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 13:03:45.955093 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 13 13:03:45.955093 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 13 13:03:45.955093 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 13 13:03:45.955093 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 13 13:03:45.955093 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 13 13:03:45.955093 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 13 13:03:45.955093 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 13 13:03:45.955093 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 13 13:03:45.955093 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 13 13:03:45.955093 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 13:03:45.955093 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 13 13:03:45.955093 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 13 13:03:45.955093 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Oct 13 13:03:45.955093 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: ERROR nova.api.openstack.wsgi Oct 13 13:03:45.955093 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 13:03:45.955093 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: ERROR nova.api.openstack.wsgi Oct 13 13:03:45.955093 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 13:03:45.955093 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 13:03:45.955093 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 13:03:45.956295 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 13:03:45.956295 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 13:03:45.956295 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 13:03:45.956295 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 13:03:45.956295 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 13 13:03:45.956295 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 13 13:03:45.956295 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Oct 13 13:03:45.956295 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: ERROR nova.api.openstack.wsgi Oct 13 13:03:45.956295 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 13:03:45.956295 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: ERROR nova.api.openstack.wsgi Oct 13 13:03:45.956295 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 13:03:45.956295 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 13:03:45.956295 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 13:03:45.956295 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 13:03:45.956295 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 13:03:45.956295 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Oct 13 13:03:45.956295 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: ERROR nova.api.openstack.wsgi Oct 13 13:03:45.956295 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi [None req-eafa4244-b1a6-437c-983f-5f85fd7fa26f admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103790) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 13:03:45.957603 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: INFO nova.api.openstack.requestlog [None req-eafa4244-b1a6-437c-983f-5f85fd7fa26f admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.011477 Oct 13 13:03:45.957603 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: [pid: 103790|app: 0|req: 26/52] 10.222.0.23 () {60 vars in 1193 bytes} [Thu Oct 13 13:03:45 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 13 13:03:47.180231 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi [None req-0941719e-9984-4a70-a67e-ed91eb67b88c admin admin] Calling method '>' {{(pid=103791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:03:47.181641 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: INFO nova.api.openstack.requestlog [None req-0941719e-9984-4a70-a67e-ed91eb67b88c admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001447 Oct 13 13:03:47.182061 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: [pid: 103791|app: 0|req: 27/53] 10.222.0.23 () {56 vars in 1074 bytes} [Thu Oct 13 13:03:47 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 13:03:47.701265 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi [None req-a9035866-9bc0-4bab-95f3-1777022a7d72 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 13:03:47.720219 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: INFO nova.api.openstack.requestlog [None req-a9035866-9bc0-4bab-95f3-1777022a7d72 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.92 time: 0.401304 Oct 13 13:03:47.720695 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: [pid: 103790|app: 0|req: 27/54] 10.222.0.23 () {64 vars in 1235 bytes} [Thu Oct 13 13:03:47 2022] POST /compute/v2.1/flavors => generated 404 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 13 13:03:48.938693 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi [None req-0941719e-9984-4a70-a67e-ed91eb67b88c admin admin] Calling method '>' {{(pid=103791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:03:48.939749 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: INFO nova.api.openstack.requestlog [None req-0941719e-9984-4a70-a67e-ed91eb67b88c admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001495 Oct 13 13:03:48.940169 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: [pid: 103791|app: 0|req: 28/55] 10.222.0.23 () {56 vars in 1074 bytes} [Thu Oct 13 13:03:48 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 13:03:49.456694 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi [None req-677606cc-8d27-4e35-9829-bd1066f863a9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 13:03:49.474767 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: INFO nova.api.openstack.requestlog [None req-677606cc-8d27-4e35-9829-bd1066f863a9 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.92 time: 0.399222 Oct 13 13:03:49.475352 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: [pid: 103790|app: 0|req: 28/56] 10.222.0.23 () {64 vars in 1235 bytes} [Thu Oct 13 13:03:49 2022] POST /compute/v2.1/flavors => generated 405 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 13 13:03:50.701574 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi [None req-0941719e-9984-4a70-a67e-ed91eb67b88c admin admin] Calling method '>' {{(pid=103791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:03:50.702581 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: INFO nova.api.openstack.requestlog [None req-0941719e-9984-4a70-a67e-ed91eb67b88c admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001425 Oct 13 13:03:50.702977 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: [pid: 103791|app: 0|req: 29/57] 10.222.0.23 () {56 vars in 1074 bytes} [Thu Oct 13 13:03:50 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 13:03:51.217383 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi [None req-261d3f8d-b241-4427-8318-111a3b15ff97 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 13:03:51.235621 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: INFO nova.api.openstack.requestlog [None req-261d3f8d-b241-4427-8318-111a3b15ff97 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.92 time: 0.397373 Oct 13 13:03:51.236153 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: [pid: 103790|app: 0|req: 29/58] 10.222.0.23 () {64 vars in 1235 bytes} [Thu Oct 13 13:03:50 2022] POST /compute/v2.1/flavors => generated 407 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 13 13:03:52.445013 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi [None req-0941719e-9984-4a70-a67e-ed91eb67b88c admin admin] Calling method '>' {{(pid=103791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:03:52.446052 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: INFO nova.api.openstack.requestlog [None req-0941719e-9984-4a70-a67e-ed91eb67b88c admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001460 Oct 13 13:03:52.446448 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: [pid: 103791|app: 0|req: 30/59] 10.222.0.23 () {56 vars in 1074 bytes} [Thu Oct 13 13:03:52 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 13:03:52.968756 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi [None req-62431438-1228-4702-964d-fcb1a15f6bfd admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 13:03:52.987643 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: INFO nova.api.openstack.requestlog [None req-62431438-1228-4702-964d-fcb1a15f6bfd admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.92 time: 0.398743 Oct 13 13:03:52.988192 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: [pid: 103790|app: 0|req: 30/60] 10.222.0.23 () {64 vars in 1235 bytes} [Thu Oct 13 13:03:52 2022] POST /compute/v2.1/flavors => generated 409 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 13 13:03:54.191901 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi [None req-0941719e-9984-4a70-a67e-ed91eb67b88c admin admin] Calling method '>' {{(pid=103791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:03:54.192906 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: INFO nova.api.openstack.requestlog [None req-0941719e-9984-4a70-a67e-ed91eb67b88c admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001453 Oct 13 13:03:54.193337 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: [pid: 103791|app: 0|req: 31/61] 10.222.0.23 () {56 vars in 1074 bytes} [Thu Oct 13 13:03:54 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 13:03:54.701575 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi [None req-db0bd575-61fb-41d0-9b36-c56a0014a46a admin admin] Calling method '>' {{(pid=103790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:03:54.722061 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: INFO nova.api.openstack.requestlog [None req-db0bd575-61fb-41d0-9b36-c56a0014a46a admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.92 time: 0.394310 Oct 13 13:03:54.722596 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: [pid: 103790|app: 0|req: 31/62] 10.222.0.23 () {60 vars in 1202 bytes} [Thu Oct 13 13:03:54 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 13:04:50.686889 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi [None req-0941719e-9984-4a70-a67e-ed91eb67b88c admin admin] Calling method '>' {{(pid=103791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:04:50.687922 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: INFO nova.api.openstack.requestlog [None req-0941719e-9984-4a70-a67e-ed91eb67b88c admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001470 Oct 13 13:04:50.688352 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: [pid: 103791|app: 0|req: 32/63] 10.222.0.23 () {54 vars in 931 bytes} [Thu Oct 13 13:04:50 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 13:04:50.699237 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG dbcounter [-] [103790] Writing DB stats nova_api:INSERT=5,nova_api:SELECT=28 {{(pid=103790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:04:51.077490 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi [None req-0c106da2-4cb9-4e47-8c98-f0c7f5fe352d admin admin] Calling method '>' {{(pid=103790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:04:51.097390 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: INFO nova.api.openstack.requestlog [None req-0c106da2-4cb9-4e47-8c98-f0c7f5fe352d admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.402732 Oct 13 13:04:51.097922 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: [pid: 103790|app: 0|req: 32/64] 10.222.0.23 () {60 vars in 1292 bytes} [Thu Oct 13 13:04:50 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 13:04:51.119537 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG dbcounter [-] [103791] Writing DB stats nova_api:SELECT=14 {{(pid=103791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:04:51.123277 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi [None req-1ecd8fae-ab6c-4778-9039-b1bccb5657c6 admin admin] Calling method '>' {{(pid=103791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:04:51.130484 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: INFO nova.api.openstack.requestlog [None req-1ecd8fae-ab6c-4778-9039-b1bccb5657c6 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012431 Oct 13 13:04:51.131000 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: [pid: 103791|app: 0|req: 33/65] 10.222.0.23 () {60 vars in 1283 bytes} [Thu Oct 13 13:04:51 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:04:51.142382 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi [None req-1dc2f8ff-f0a2-41cf-84ea-fec53133fe46 admin admin] Calling method '>' {{(pid=103790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:04:51.150106 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: INFO nova.api.openstack.requestlog [None req-1dc2f8ff-f0a2-41cf-84ea-fec53133fe46 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011319 Oct 13 13:04:51.150626 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: [pid: 103790|app: 0|req: 33/66] 10.222.0.23 () {60 vars in 1286 bytes} [Thu Oct 13 13:04:51 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:04:51.161474 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi [None req-f42e333f-47be-4a3e-ba1e-98ced0d41815 admin admin] Calling method '>' {{(pid=103791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:04:51.169071 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: INFO nova.api.openstack.requestlog [None req-f42e333f-47be-4a3e-ba1e-98ced0d41815 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011070 Oct 13 13:04:51.169578 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: [pid: 103791|app: 0|req: 34/67] 10.222.0.23 () {60 vars in 1286 bytes} [Thu Oct 13 13:04:51 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 13:04:51.180345 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi [None req-48659e03-8c02-4911-9cc4-9b2d303cead6 admin admin] Calling method '>' {{(pid=103790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:04:51.187553 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: INFO nova.api.openstack.requestlog [None req-48659e03-8c02-4911-9cc4-9b2d303cead6 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010586 Oct 13 13:04:51.188066 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: [pid: 103790|app: 0|req: 34/68] 10.222.0.23 () {60 vars in 1283 bytes} [Thu Oct 13 13:04:51 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:07:49.912832 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi [None req-f42e333f-47be-4a3e-ba1e-98ced0d41815 admin admin] Calling method '>' {{(pid=103791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:07:49.913841 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: INFO nova.api.openstack.requestlog [None req-f42e333f-47be-4a3e-ba1e-98ced0d41815 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001439 Oct 13 13:07:49.914244 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: [pid: 103791|app: 0|req: 35/69] 10.222.0.23 () {56 vars in 1074 bytes} [Thu Oct 13 13:07:49 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 13:07:50.054909 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG dbcounter [-] [103790] Writing DB stats nova_api:SELECT=6 {{(pid=103790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:07:50.211677 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi [None req-3159c4be-4705-42c8-8d82-f772bb775269 admin admin] Calling method '>' {{(pid=103790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:07:50.216321 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG oslo_concurrency.lockutils [None req-3159c4be-4705-42c8-8d82-f772bb775269 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:07:50.216786 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG oslo_concurrency.lockutils [None req-3159c4be-4705-42c8-8d82-f772bb775269 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=103790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:07:50.217210 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG oslo_concurrency.lockutils [None req-3159c4be-4705-42c8-8d82-f772bb775269 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:07:50.217916 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG oslo_concurrency.lockutils [None req-3159c4be-4705-42c8-8d82-f772bb775269 admin admin] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:07:50.218359 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG oslo_concurrency.lockutils [None req-3159c4be-4705-42c8-8d82-f772bb775269 admin admin] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:07:50.218775 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG oslo_concurrency.lockutils [None req-3159c4be-4705-42c8-8d82-f772bb775269 admin admin] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:07:50.250940 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: INFO nova.api.openstack.requestlog [None req-3159c4be-4705-42c8-8d82-f772bb775269 admin admin] 10.222.0.23 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.92 time: 0.197411 Oct 13 13:07:50.251527 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: [pid: 103790|app: 0|req: 35/70] 10.222.0.23 () {60 vars in 1193 bytes} [Thu Oct 13 13:07:50 2022] GET /compute/v2.1/os-services => generated 791 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 13 13:07:51.366012 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi [None req-f42e333f-47be-4a3e-ba1e-98ced0d41815 admin admin] Calling method '>' {{(pid=103791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:07:51.367014 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: INFO nova.api.openstack.requestlog [None req-f42e333f-47be-4a3e-ba1e-98ced0d41815 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001416 Oct 13 13:07:51.367618 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: [pid: 103791|app: 0|req: 36/71] 10.222.0.23 () {56 vars in 1074 bytes} [Thu Oct 13 13:07:51 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 13:07:51.556637 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi [None req-3602a69f-68c8-4080-bbf6-09991f238012 admin admin] Calling method '>' {{(pid=103790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:07:51.560048 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG oslo_concurrency.lockutils [None req-3602a69f-68c8-4080-bbf6-09991f238012 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:07:51.560526 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG oslo_concurrency.lockutils [None req-3602a69f-68c8-4080-bbf6-09991f238012 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:07:51.560951 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG oslo_concurrency.lockutils [None req-3602a69f-68c8-4080-bbf6-09991f238012 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:07:51.561664 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG oslo_concurrency.lockutils [None req-3602a69f-68c8-4080-bbf6-09991f238012 admin admin] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:07:51.562107 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG oslo_concurrency.lockutils [None req-3602a69f-68c8-4080-bbf6-09991f238012 admin admin] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:07:51.562520 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG oslo_concurrency.lockutils [None req-3602a69f-68c8-4080-bbf6-09991f238012 admin admin] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:07:51.582425 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: INFO nova.api.openstack.requestlog [None req-3602a69f-68c8-4080-bbf6-09991f238012 admin admin] 10.222.0.23 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.92 time: 0.077080 Oct 13 13:07:51.582911 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: [pid: 103790|app: 0|req: 36/72] 10.222.0.23 () {60 vars in 1193 bytes} [Thu Oct 13 13:07:51 2022] GET /compute/v2.1/os-services => generated 791 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 13 13:08:03.037945 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi [None req-f42e333f-47be-4a3e-ba1e-98ced0d41815 admin admin] Calling method '>' {{(pid=103791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:08:03.038954 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: INFO nova.api.openstack.requestlog [None req-f42e333f-47be-4a3e-ba1e-98ced0d41815 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001419 Oct 13 13:08:03.039387 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: [pid: 103791|app: 0|req: 37/73] 10.222.0.23 () {56 vars in 1074 bytes} [Thu Oct 13 13:08:03 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 13:08:03.182875 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG dbcounter [-] [103790] Writing DB stats nova_cell0:SELECT=4 {{(pid=103790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:08:03.183612 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG dbcounter [-] [103790] Writing DB stats nova_cell1:SELECT=4 {{(pid=103790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:08:03.184246 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG dbcounter [-] [103790] Writing DB stats nova_api:SELECT=8 {{(pid=103790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:08:03.231935 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi [None req-5220be85-be59-4f9e-bd12-7b86dc869588 admin admin] Calling method '>' {{(pid=103790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:08:03.235314 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG oslo_concurrency.lockutils [None req-5220be85-be59-4f9e-bd12-7b86dc869588 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:08:03.235781 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG oslo_concurrency.lockutils [None req-5220be85-be59-4f9e-bd12-7b86dc869588 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=103790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:08:03.236202 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG oslo_concurrency.lockutils [None req-5220be85-be59-4f9e-bd12-7b86dc869588 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:08:03.236906 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG oslo_concurrency.lockutils [None req-5220be85-be59-4f9e-bd12-7b86dc869588 admin admin] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:08:03.237346 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG oslo_concurrency.lockutils [None req-5220be85-be59-4f9e-bd12-7b86dc869588 admin admin] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:08:03.237757 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG oslo_concurrency.lockutils [None req-5220be85-be59-4f9e-bd12-7b86dc869588 admin admin] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:08:03.261988 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: INFO nova.api.openstack.requestlog [None req-5220be85-be59-4f9e-bd12-7b86dc869588 admin admin] 10.222.0.23 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.92 time: 0.083806 Oct 13 13:08:03.262532 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: [pid: 103790|app: 0|req: 37/74] 10.222.0.23 () {60 vars in 1193 bytes} [Thu Oct 13 13:08:03 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 13:08:04.331224 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi [None req-f42e333f-47be-4a3e-ba1e-98ced0d41815 admin admin] Calling method '>' {{(pid=103791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:08:04.332233 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: INFO nova.api.openstack.requestlog [None req-f42e333f-47be-4a3e-ba1e-98ced0d41815 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001583 Oct 13 13:08:04.332631 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: [pid: 103791|app: 0|req: 38/75] 10.222.0.23 () {56 vars in 1074 bytes} [Thu Oct 13 13:08:04 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 13:08:04.521130 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG nova.api.openstack.wsgi [None req-29ece765-0cff-4c67-a4b4-dde3a8282412 admin admin] Calling method '>' {{(pid=103790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:08:04.524576 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG oslo_concurrency.lockutils [None req-29ece765-0cff-4c67-a4b4-dde3a8282412 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:08:04.525048 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG oslo_concurrency.lockutils [None req-29ece765-0cff-4c67-a4b4-dde3a8282412 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:08:04.525471 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG oslo_concurrency.lockutils [None req-29ece765-0cff-4c67-a4b4-dde3a8282412 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:08:04.526250 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG oslo_concurrency.lockutils [None req-29ece765-0cff-4c67-a4b4-dde3a8282412 admin admin] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:08:04.526693 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG oslo_concurrency.lockutils [None req-29ece765-0cff-4c67-a4b4-dde3a8282412 admin admin] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=103790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:08:04.527132 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: DEBUG oslo_concurrency.lockutils [None req-29ece765-0cff-4c67-a4b4-dde3a8282412 admin admin] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:08:04.549430 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: INFO nova.api.openstack.requestlog [None req-29ece765-0cff-4c67-a4b4-dde3a8282412 admin admin] 10.222.0.23 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.92 time: 0.078471 Oct 13 13:08:04.549975 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: [pid: 103790|app: 0|req: 38/76] 10.222.0.23 () {60 vars in 1193 bytes} [Thu Oct 13 13:08:04 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 13:09:00.466632 dv-cinder-826607-8-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Oct 13 13:09:00.467468 dv-cinder-826607-8-iscsi devstack@n-api.service[103789]: Thu Oct 13 13:09:00 2022 - graceful shutdown triggered... Oct 13 13:09:00.467963 dv-cinder-826607-8-iscsi devstack@n-api.service[103790]: Gracefully killing worker 1 (pid: 103790)... Oct 13 13:09:00.468384 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: Gracefully killing worker 2 (pid: 103791)... Oct 13 13:09:00.593824 dv-cinder-826607-8-iscsi devstack@n-api.service[103791]: DEBUG dbcounter [-] [103791] Writing DB stats nova_api:SELECT=4 {{(pid=103791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:09:01.468609 dv-cinder-826607-8-iscsi devstack@n-api.service[103789]: worker 1 buried after 1 seconds Oct 13 13:09:01.469139 dv-cinder-826607-8-iscsi devstack@n-api.service[103789]: worker 2 buried after 1 seconds Oct 13 13:09:01.469139 dv-cinder-826607-8-iscsi devstack@n-api.service[103789]: goodbye to uWSGI. Oct 13 13:09:01.470128 dv-cinder-826607-8-iscsi systemd[1]: devstack@n-api.service: Succeeded. Oct 13 13:09:01.470708 dv-cinder-826607-8-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Oct 13 13:09:01.473490 dv-cinder-826607-8-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Oct 13 13:09:01.484108 dv-cinder-826607-8-iscsi devstack@n-api.service[118796]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Oct 13 13:09:01.486132 dv-cinder-826607-8-iscsi devstack@n-api.service[118796]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Oct 13 13:09:01 2022] *** Oct 13 13:09:01.486132 dv-cinder-826607-8-iscsi devstack@n-api.service[118796]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Oct 13 13:09:01.486132 dv-cinder-826607-8-iscsi devstack@n-api.service[118796]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Oct 13 13:09:01.486132 dv-cinder-826607-8-iscsi devstack@n-api.service[118796]: nodename: dv-cinder-826607-8-iscsi Oct 13 13:09:01.486132 dv-cinder-826607-8-iscsi devstack@n-api.service[118796]: machine: x86_64 Oct 13 13:09:01.486132 dv-cinder-826607-8-iscsi devstack@n-api.service[118796]: clock source: unix Oct 13 13:09:01.486132 dv-cinder-826607-8-iscsi devstack@n-api.service[118796]: pcre jit disabled Oct 13 13:09:01.486132 dv-cinder-826607-8-iscsi devstack@n-api.service[118796]: detected number of CPU cores: 4 Oct 13 13:09:01.486132 dv-cinder-826607-8-iscsi devstack@n-api.service[118796]: current working directory: / Oct 13 13:09:01.486132 dv-cinder-826607-8-iscsi devstack@n-api.service[118796]: detected binary path: /usr/bin/uwsgi-core Oct 13 13:09:01.486132 dv-cinder-826607-8-iscsi devstack@n-api.service[118796]: your processes number limit is 47680 Oct 13 13:09:01.486132 dv-cinder-826607-8-iscsi devstack@n-api.service[118796]: your memory page size is 4096 bytes Oct 13 13:09:01.486132 dv-cinder-826607-8-iscsi devstack@n-api.service[118796]: detected max file descriptor number: 2048 Oct 13 13:09:01.486132 dv-cinder-826607-8-iscsi devstack@n-api.service[118796]: lock engine: pthread robust mutexes Oct 13 13:09:01.487577 dv-cinder-826607-8-iscsi devstack@n-api.service[118796]: thunder lock: enabled Oct 13 13:09:01.487577 dv-cinder-826607-8-iscsi devstack@n-api.service[118796]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Oct 13 13:09:01.487577 dv-cinder-826607-8-iscsi devstack@n-api.service[118796]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Oct 13 13:09:01.526519 dv-cinder-826607-8-iscsi devstack@n-api.service[118796]: Python main interpreter initialized at 0x55f2a25a59c0 Oct 13 13:09:01.526519 dv-cinder-826607-8-iscsi devstack@n-api.service[118796]: python threads support enabled Oct 13 13:09:01.526519 dv-cinder-826607-8-iscsi devstack@n-api.service[118796]: your server socket listen backlog is limited to 100 connections Oct 13 13:09:01.526519 dv-cinder-826607-8-iscsi devstack@n-api.service[118796]: your mercy for graceful operations on workers is 90 seconds Oct 13 13:09:01.526958 dv-cinder-826607-8-iscsi devstack@n-api.service[118796]: mapped 403077 bytes (393 KB) for 2 cores Oct 13 13:09:01.526958 dv-cinder-826607-8-iscsi devstack@n-api.service[118796]: *** Operational MODE: preforking *** Oct 13 13:09:01.527259 dv-cinder-826607-8-iscsi devstack@n-api.service[118796]: *** uWSGI is running in multiple interpreter mode *** Oct 13 13:09:01.527259 dv-cinder-826607-8-iscsi devstack@n-api.service[118796]: spawned uWSGI master process (pid: 118796) Oct 13 13:09:01.527467 dv-cinder-826607-8-iscsi systemd[1]: Started Devstack devstack@n-api.service. Oct 13 13:09:01.529977 dv-cinder-826607-8-iscsi devstack@n-api.service[118796]: spawned uWSGI worker 1 (pid: 118814, cores: 1) Oct 13 13:09:01.530295 dv-cinder-826607-8-iscsi devstack@n-api.service[118796]: spawned uWSGI worker 2 (pid: 118815, cores: 1) Oct 13 13:09:01.530584 dv-cinder-826607-8-iscsi devstack@n-api.service[118796]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Oct 13 13:09:02.201638 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 13 13:09:02.212069 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 13 13:09:03.400757 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 13 13:09:03.400757 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: from cryptography.utils import int_from_bytes Oct 13 13:09:03.401510 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 13 13:09:03.401510 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: from cryptography.utils import int_from_bytes Oct 13 13:09:03.407618 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 13 13:09:03.407618 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: from cryptography.utils import int_from_bytes Oct 13 13:09:03.408099 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 13 13:09:03.408099 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: from cryptography.utils import int_from_bytes Oct 13 13:09:05.832587 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 13 13:09:05.833163 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 13 13:09:05.833437 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 13 13:09:05.833763 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 13 13:09:05.834025 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 13 13:09:05.834417 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:09:05.834732 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 13 13:09:05.835216 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:09:05.835317 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 13 13:09:05.835392 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:09:05.835392 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:09:05.835614 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 13 13:09:05.835716 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:09:05.835945 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 13 13:09:05.836047 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:09:05.836211 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 13 13:09:05.836315 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:09:05.836614 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:09:05.836788 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:09:05.836925 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:09:05.837060 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:09:05.837202 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:09:05.837291 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:09:05.837512 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:09:05.837613 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:09:05.837891 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:09:05.837993 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-826607-8-iscsi {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:09:05.838204 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:09:05.838299 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:09:05.838530 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:09:05.838680 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:09:05.838843 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:09:05.839016 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:09:05.839244 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:09:05.839422 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:09:05.839583 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:09:05.839730 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:09:05.839871 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:09:05.840034 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:09:05.840186 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:09:05.840367 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-826607-8-iscsi {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:09:05.840569 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:09:05.840737 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:09:05.840916 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:09:05.841195 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:09:05.841531 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:09:05.841837 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:09:05.842169 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:09:05.842409 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:09:05.842620 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:09:05.842824 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:09:05.843048 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:09:05.843314 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:09:05.843540 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:09:05.843762 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:09:05.843980 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:09:05.844181 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:09:05.844445 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:09:05.844662 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:09:05.844874 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:09:05.845075 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:09:05.845278 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:09:05.845493 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:09:05.845703 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:09:05.845906 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:09:05.846109 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:09:05.846334 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:09:05.846550 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:09:05.846768 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-826607-8-iscsi {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:09:05.846972 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:09:05.847180 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:09:05.847397 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:09:05.847549 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:09:05.847810 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-826607-8-iscsi {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:09:05.847997 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:09:05.848153 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:09:05.848303 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:09:05.848451 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:09:05.848611 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:09:05.848794 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:09:05.848959 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:09:05.849448 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:09:05.849610 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:09:05.849751 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:09:05.849903 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:09:05.850087 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:09:05.850232 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:09:05.850372 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:09:05.850521 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:09:05.850667 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:09:05.850821 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:09:05.850980 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:09:05.851153 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:09:05.851389 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:09:05.851692 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:09:05.851871 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:09:05.852147 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:09:05.852306 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:09:05.852455 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:09:05.852876 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:09:05.853027 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:09:05.853593 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:09:05.853755 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:09:05.853918 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:09:05.854060 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:09:05.854219 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:09:05.854420 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:09:05.854577 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:09:05.854720 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:09:05.854868 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:09:05.855010 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:09:05.855195 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:09:05.855444 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:09:05.855613 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:09:05.855782 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:09:05.856451 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:09:05.856619 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:09:05.856766 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:09:05.856914 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:09:05.856914 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:09:05.857199 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:09:05.857340 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:09:05.857488 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:09:05.857488 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:09:05.857774 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:09:05.857926 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:09:05.858075 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:09:05.858234 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:09:05.858383 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:09:05.858536 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:09:05.858678 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:09:05.858817 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:09:05.858966 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:09:05.859156 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:09:05.859630 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:09:05.859780 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:09:05.859929 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:09:05.860068 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:09:05.860216 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:09:05.860365 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:09:05.860519 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:09:05.860661 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:09:05.860807 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:09:05.860954 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:09:05.861100 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:09:05.861248 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:09:05.861425 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:09:05.861671 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:09:05.861948 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:09:05.862124 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:09:05.862395 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:09:05.862543 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:09:05.862543 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:09:05.862845 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.23 {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:09:05.862845 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.23 {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:09:05.863164 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:09:05.863315 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:09:05.863465 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.23 {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:09:05.863465 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.23 {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:09:05.863750 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:09:05.863899 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:09:05.864046 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:09:05.864186 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:09:05.864341 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:09:05.864540 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:09:05.864686 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:09:05.864828 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:09:05.864977 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:09:05.865125 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:09:05.865274 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:09:05.865415 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:09:05.865561 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:09:05.865561 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:09:05.865849 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:09:05.865849 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:09:05.866129 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:09:05.866270 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:09:05.866419 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:09:05.866419 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:09:05.866704 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:09:05.866853 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:09:05.867002 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:09:05.867211 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:09:05.867926 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:09:05.868085 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:09:05.868235 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:09:05.868377 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:09:05.868516 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:09:05.868666 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:09:05.868828 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:09:05.868970 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:09:05.869344 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:09:05.869885 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:09:05.870079 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:09:05.870226 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:09:05.870382 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:09:05.870534 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:09:05.870686 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:09:05.870826 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:09:05.870966 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:09:05.871142 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:09:05.871303 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:09:05.871447 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:09:05.872679 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:09:05.872843 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:09:05.872996 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:09:05.873152 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:09:05.873304 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:09:05.873445 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:09:05.873592 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:09:05.873741 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:09:05.873895 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:09:05.874049 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:09:05.874192 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:09:05.874343 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:09:05.874484 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:09:05.874484 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:09:05.874809 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:09:05.874960 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:09:05.875132 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:09:05.875289 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:09:05.875440 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:09:05.875440 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:09:05.875712 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:09:05.875866 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:09:05.876007 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:09:05.876155 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:09:05.876320 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:09:05.876471 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:09:05.876620 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:09:05.876769 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:09:05.876916 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:09:05.877056 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:09:05.877204 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:09:05.877346 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:09:05.877486 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:09:05.877638 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:09:05.877779 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:09:05.877919 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:09:05.878066 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:09:05.878216 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:09:05.878443 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:09:05.878605 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:09:05.879312 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:09:05.879476 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:09:05.879638 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:09:05.880140 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:09:05.880300 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:09:05.880450 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:09:05.880598 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:09:05.880740 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:09:05.881101 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:09:05.881257 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:09:05.881408 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:09:05.881559 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:09:05.881706 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:09:05.881858 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:09:05.881999 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:09:05.882150 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:09:05.882941 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:09:05.883049 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:09:05.883165 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:09:05.883252 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:09:05.883356 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:09:05.883454 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:09:05.883550 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:09:05.883646 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:09:05.883731 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:09:05.883824 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:09:05.883916 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:09:05.884011 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:09:05.884096 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:09:05.884188 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:09:05.884280 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:09:05.884366 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:09:05.884450 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:09:05.884548 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:09:05.884635 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:09:05.884716 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:09:05.884800 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:09:05.884883 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:09:05.884963 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:09:05.885053 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:09:05.885130 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:09:05.885207 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.885287 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:09:05.885366 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.885451 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 13:09:05.885532 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.885610 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.885682 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.885752 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.885823 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.885904 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.885985 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.886057 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.886127 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.886204 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.886277 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.886362 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.886436 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.886506 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.886585 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.886657 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.886738 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.886818 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.886891 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.886891 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.887033 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.887168 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.887558 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.887558 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.887717 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.887798 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.887893 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.887985 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.888070 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.888165 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.888258 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.888342 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.888424 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.888424 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.888589 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.888687 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.888773 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.888773 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.888933 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.889025 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.889110 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.889201 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.889292 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.889376 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.889465 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.889549 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.889630 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.889722 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.889814 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.889906 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.889986 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.890077 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.890159 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.890239 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.890318 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.890318 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.890467 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.890549 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.890640 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.890640 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.890802 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.890802 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.890951 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.891041 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.891164 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.891251 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.891335 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.891425 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.891510 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.891601 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.891696 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.891898 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.892072 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.892232 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.892387 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.892550 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.892720 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.893149 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.893301 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.893454 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.893604 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.893755 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.893897 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.894045 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.894187 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.894326 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.894473 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.894623 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.894816 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.894963 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.895165 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.895333 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.895485 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.895635 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.895776 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.895915 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.896055 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.896195 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.896349 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.896490 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.896631 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.896770 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.896917 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.897057 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.897215 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.897357 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.897497 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.897636 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.897776 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.897922 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.898080 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.898229 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.898378 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.898518 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.898665 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.898805 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.898954 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.899132 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.899279 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.899420 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.899561 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.899700 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.899927 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.900176 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.900537 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.900694 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.900835 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.900984 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.901125 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.901272 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.901424 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.901573 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.901722 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.901871 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.902020 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.902167 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.902308 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.902447 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.902588 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.902764 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.902920 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.903186 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.903334 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.903493 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.903667 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.903836 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.904009 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.904151 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.904330 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.904475 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.904630 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.904779 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.904972 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.904972 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.905279 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.905440 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.905591 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.905735 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.905882 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.906036 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.906183 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.906339 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.906496 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.906642 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.906790 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.906935 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.907136 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.907302 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.907472 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.907626 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.907774 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.907933 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.908085 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.908245 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.908399 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.908561 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.908708 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.908862 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.909017 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.909173 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.909320 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.909494 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.909832 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.909989 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.910158 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.910399 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.910750 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.910906 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.911071 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.911237 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.911386 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.911549 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.911698 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.911698 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.911990 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.912144 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.912307 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.912454 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.912600 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.912745 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.912891 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.913081 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.913385 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.914106 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.914276 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.914433 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.914594 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.914741 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.914903 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.915136 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.915292 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.915439 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.915586 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.915748 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.915895 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.916050 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.916206 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.916354 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.917096 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.917259 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.917415 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.917562 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.917562 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.917855 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.918025 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.918174 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.918842 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.919006 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.919180 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.919344 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.919506 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.919674 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.919821 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.919966 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.920112 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.920258 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.920439 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.920900 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.921069 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.921219 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.921366 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.921523 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.921679 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.921827 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.921993 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.922140 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.922287 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.922457 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.922612 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.922766 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.922913 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.923135 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.923307 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.923550 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.923711 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.923858 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.924004 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.924169 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.924323 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.924480 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.924629 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.924775 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.924927 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.925123 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.925285 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.925441 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.925595 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.925742 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.925895 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.926059 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.926230 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.926385 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.926538 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.926686 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.926838 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.926992 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.927197 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.927306 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.927406 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.927495 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.927581 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.927665 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.927759 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.927844 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.928178 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.928270 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.928362 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.928448 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.928545 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.928638 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.928731 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.928822 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.928907 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.929002 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.929095 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.929179 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.929261 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.929352 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.929437 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.929529 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.929614 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.929696 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.929789 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.929874 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.929956 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.930112 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.930200 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.930282 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.930365 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.930448 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.930540 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.930634 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.930724 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.930797 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.930867 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.930943 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.931029 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.931214 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.931289 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.931360 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.931470 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.931669 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.931779 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.931993 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.932115 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.932312 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.932411 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.932626 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.932729 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.932939 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.933041 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.933257 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.933349 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.933589 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.933736 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.933906 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.934050 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.934776 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.934870 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.935109 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.935222 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.935424 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.935517 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.935736 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.935836 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.936072 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.936165 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.936392 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.936485 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.936719 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.936847 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.937020 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.937195 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.937349 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.937497 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.937655 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.937811 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.937970 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.938129 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.938287 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.938442 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.938596 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.938750 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.938905 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.939079 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.939235 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.939381 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.939536 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.939701 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.939848 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.940003 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.940150 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.940326 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.940482 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.940638 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.940803 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.941201 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.941374 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.941525 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.941671 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.941831 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.941980 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.942134 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.942281 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.942435 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.942608 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.942756 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.942903 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.943088 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.943255 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.943405 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.943405 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.943821 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.943987 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.944136 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.944289 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.944438 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.944605 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.944760 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.944916 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.945070 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.945070 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.945891 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.946043 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.946198 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.946198 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.946487 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.946487 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.946797 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.946951 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.947148 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.947328 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.947562 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.947724 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.947880 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.948041 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.948196 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.948345 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.948491 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.948645 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.948794 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.948949 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.949097 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.949271 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.949428 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.949608 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.949765 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.949926 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.950082 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.950236 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.950384 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.950531 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.950677 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.950833 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.951007 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.951223 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.951558 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.951709 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.951877 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.952027 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.952174 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.952328 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.952475 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.952622 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.952822 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.952972 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.953119 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.953265 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.953424 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.953582 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.953743 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.953985 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.954149 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.954298 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.954453 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.954601 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.954757 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.954906 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.955084 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.955240 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.955439 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.955670 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.955868 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.956026 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.956175 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.956322 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.956476 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.956645 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.956802 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.956950 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.957099 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.957255 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.957403 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.957570 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.957726 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.957874 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.958020 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.958175 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.958330 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.958487 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.958635 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.958782 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.958935 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.959115 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.959280 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.959430 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.959589 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.959736 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.959890 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.960037 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.960268 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.960424 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.960572 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.960725 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.960872 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.961019 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.961178 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.961327 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.961656 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.961824 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.961972 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.962119 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.962281 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.962429 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.962583 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.962730 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.962877 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.963071 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.963228 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.963377 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.963547 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.963698 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.963855 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.964091 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.964252 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.964408 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.964563 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.964711 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.964864 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.965021 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.965199 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.965366 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.965515 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.965661 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.965857 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.966032 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.966181 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.966327 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.966481 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.966629 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.966783 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.966931 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.967113 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.967266 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.967413 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.967561 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.967799 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.967959 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.968106 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.968252 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.968399 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.968546 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.968724 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.969288 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.969448 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.969605 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.969835 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.970067 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.970225 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.970373 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.970542 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.970692 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.970839 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.970999 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.971175 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.971335 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.971335 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.971821 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.971993 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.972143 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.972290 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.972444 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.972591 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.972758 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.972920 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.973075 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.973222 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.973368 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.973524 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.973672 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.973828 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.973975 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.974214 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.974376 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.974525 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.974672 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.974839 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.974988 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.974988 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.975331 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.975331 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.975635 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.975635 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.975957 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.976109 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.976256 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.976410 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.976586 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.976749 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.976909 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.977057 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.977204 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.977351 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.977509 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.977509 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.977809 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.977957 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.978103 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.978249 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.978404 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.978552 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.978716 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.978871 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.979019 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.979199 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.979313 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.979407 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.979495 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.979588 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.979686 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.979783 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.979869 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.979963 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.980049 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.980142 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.980236 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.980333 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.980420 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.980511 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.980597 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.980680 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.980771 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.981423 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.981512 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.981599 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.981675 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.981746 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.981825 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.981927 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.982003 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.982082 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.982154 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.982233 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.982321 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.982403 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.982484 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.982557 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.982628 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.982699 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.982778 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.982858 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.982931 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.983011 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.983111 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.983188 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.983278 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.983353 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.983424 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.983495 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.983565 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.983635 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.983714 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.983787 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.983864 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.983937 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.984139 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.984405 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.984511 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.984600 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.984685 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.984807 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.984967 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.985116 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.985300 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.985565 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.985669 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.985882 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.985985 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.986197 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.986289 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.986507 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.986598 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.986821 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.986915 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.987160 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.987340 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.987511 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.987665 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.987838 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.988097 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.988262 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.988426 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.988583 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.988732 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.988888 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.989056 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.989206 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.989776 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.989946 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.990112 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.990262 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.990431 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.990594 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.990744 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.990899 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.991047 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.991249 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.991408 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.991581 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.991744 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.991901 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.992050 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.992381 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.992556 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.992706 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.992865 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.993093 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.993270 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.993438 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.993587 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.993743 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.993899 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.994054 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.994208 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.994449 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.994605 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.994605 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.994915 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.995090 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.995256 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.995416 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.995565 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.995565 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.995863 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.996065 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.996230 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.996378 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.997170 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.997345 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.997508 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.997666 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.997825 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.997976 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.998124 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.998272 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.998427 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.998578 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.998726 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.998881 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.999031 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.999215 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.999381 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.999542 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.999696 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.999845 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:05.999996 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.000145 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.000301 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.000450 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.000598 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.000753 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.000902 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.001050 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.001206 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.001365 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.001521 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.001670 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.001826 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.001988 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.002145 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.002311 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.002547 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.002701 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.002850 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.003012 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.003189 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.003338 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.003508 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.003658 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.003813 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.003971 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.004120 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.004269 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.004442 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.004667 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.004821 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.004983 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.005133 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.005289 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.005438 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.005604 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.005768 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.005917 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.006065 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.006254 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.006408 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.006565 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.006724 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.006880 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.007030 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.007210 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.007363 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.007522 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.007683 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.007842 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.007991 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.008146 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.008305 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.008456 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.008613 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.008770 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.008919 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.009074 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.009223 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.009381 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.009541 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.009689 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.009689 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.009979 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.009979 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.010292 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.010450 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.010612 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.010779 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.011469 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.011642 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.011802 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.011960 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.012150 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.012302 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.012450 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.012699 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.012865 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.013024 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.013182 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.013331 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.013489 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.013653 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.013803 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.013951 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.014099 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.014267 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.014416 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.014572 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.014816 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.014982 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.015157 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.015307 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.015455 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.015615 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.015766 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.015766 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.016057 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.016223 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.016420 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.016576 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.016735 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.016893 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.017051 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.017199 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.017355 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.017512 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.017662 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.017828 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.017978 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.018125 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.018297 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.018445 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.018593 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.018740 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.018889 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.019044 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.019253 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.019410 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.019558 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.019714 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.019863 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.020017 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.020179 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.020338 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.020486 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.020634 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.020831 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.021004 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.021155 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.021302 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.021450 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.021598 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.021753 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.021753 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.022059 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.022059 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.022367 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.022524 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.022690 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.023001 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.023187 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.023348 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.023497 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.023658 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.023816 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.023978 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.024129 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.024277 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.024444 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.024592 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.024748 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.024987 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.025143 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.025143 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.025461 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.026007 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.026181 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.026379 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.026543 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.026694 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.026849 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.027010 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.027212 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.027320 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.027424 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.027546 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.027654 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.027654 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.027842 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.027944 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.028060 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.028168 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.028264 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.028360 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.028454 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.028552 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.028638 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.028721 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.028805 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.028898 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.028984 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.029077 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.029163 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.029255 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.029341 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.029341 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.029513 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.029599 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.029683 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.029683 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.029857 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.029857 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.030013 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.030098 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.030183 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.030183 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.030345 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.030432 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.030515 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.030607 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.030703 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.030798 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.030883 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.030976 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.031085 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.031253 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.031420 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.031620 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.031811 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.031975 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.032150 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.032347 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.032517 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.032714 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.032864 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.033114 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.033276 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.033435 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.033601 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.033757 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.033966 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.034130 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.034299 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.034449 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.034606 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.034767 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.034916 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.035170 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.035326 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.035486 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.035643 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.035643 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.035940 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.036101 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.036268 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.036470 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.036624 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.036780 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.036928 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.037075 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.037223 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.037382 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.037537 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.037701 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.037858 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.037858 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.038173 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.038350 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.038500 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.038655 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.038805 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.038952 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.039143 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.039312 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.039468 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.039626 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.039775 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.039923 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.040851 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.041037 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.041191 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.041339 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.041488 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.041636 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.041792 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.041942 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.042091 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.042091 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.042381 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.042530 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.042689 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.042838 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.043006 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.043196 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.043886 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.044053 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.044213 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.044362 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.044517 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.044677 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.044833 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.044833 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.045126 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.045364 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.045527 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.045694 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.045844 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.046001 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.046158 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.046305 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.046453 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.046644 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.046804 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.046953 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.047126 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.047280 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.047443 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.047604 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.047760 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.047908 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.048063 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.048210 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.048358 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.048512 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.048669 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.048824 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.048973 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.049120 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.049267 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.049414 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.049579 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.049727 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.049882 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.050040 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.050189 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.050348 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.050503 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.050651 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.050799 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.050946 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.051110 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.051341 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.051502 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.051668 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.051824 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.051971 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.052130 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.052286 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.052435 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.052583 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.052738 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.052887 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.053295 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.053454 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.053610 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.053758 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.053927 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.054085 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.054234 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.054395 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.054553 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.054702 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.054856 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.055012 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.055230 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.055399 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.055617 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.055825 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.056010 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.056174 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.056339 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.056489 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.056717 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.056870 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.057037 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.057186 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.057351 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.057509 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.057667 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.057840 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.058395 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.058395 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.058717 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.058875 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.059669 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.059785 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.059887 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.059990 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.060088 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.060177 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.060263 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.060348 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.060442 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.060543 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.060631 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.060726 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.060814 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.060898 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.060990 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.060990 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.061156 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.061254 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.061348 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.061443 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.061561 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.061687 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.061773 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.061981 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.062154 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.062317 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.062480 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.062637 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.062786 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.062936 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.063142 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.063308 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.063467 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.063616 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.064094 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.064278 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.064431 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.064579 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.064738 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.064895 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.065047 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.065196 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.065352 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.065511 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.065762 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.065926 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.066079 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.066258 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.066535 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.066701 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.066851 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.067000 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.067192 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.067344 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.067493 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.067649 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.067797 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.067952 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.068100 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.068248 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.068414 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.068571 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.068728 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.068883 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.069035 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.069183 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.069339 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.069501 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.069658 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.069658 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.069939 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.070094 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.070261 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.070410 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.070558 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.070714 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.070862 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.071022 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.071200 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.071351 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.071556 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.071727 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.071904 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.071904 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.072214 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.072364 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.072542 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.072653 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.072750 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.072853 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.072950 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.073045 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.073144 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.073240 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.073335 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.073423 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.073533 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.073624 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.073717 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.073848 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.074017 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.074167 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.074315 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.074464 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.074655 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.074816 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.074974 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.075167 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.075320 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.075491 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.075654 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.075872 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.076025 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.076181 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.076329 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.076500 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.076720 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.076883 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.077032 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.077180 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.077338 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.077487 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.077651 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.077808 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.077957 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.078113 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.078262 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.078416 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.078565 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.078725 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.078874 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.079029 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.079213 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.079362 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.079522 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.079690 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.079840 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.079987 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.080141 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.080290 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.080516 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.080667 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.080825 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.080972 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.081119 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.081278 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.081435 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.081590 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.081750 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.081907 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.082063 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.082218 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.082386 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.082547 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.082746 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.082906 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.083092 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.083263 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.083414 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.083567 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.083733 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.083897 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.084047 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.084211 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.084360 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.084516 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.084665 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.084817 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.084968 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.085124 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.085272 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.085420 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.085579 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.085738 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.085894 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.086051 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.086199 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.086354 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.086502 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.086650 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.086896 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.087084 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.087241 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.087402 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.087552 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.087706 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.087875 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.088025 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.088181 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.088337 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.088486 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.088642 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.088804 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.088952 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.089100 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.089257 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.089414 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.089571 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.089732 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.089880 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.090028 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.090202 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.090381 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.090551 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.090702 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.090857 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.091006 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.091182 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.091334 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.091494 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.091655 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.091804 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.091958 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.092114 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.092273 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.092440 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.092609 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.092758 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.092913 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.093069 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.093225 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.093375 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.093522 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.093680 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.093835 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.093983 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.094142 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.094299 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.094449 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.094604 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.094761 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.094917 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.095096 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.095251 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.095400 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.095565 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.095713 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.095878 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.096029 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.096183 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.096339 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.096487 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.096635 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.096791 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.097045 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.097208 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.097359 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.097507 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 13 13:09:06.097667 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.097667 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.097667 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.098112 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.098112 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.098402 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.098690 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 13:09:06.098938 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 13 13:09:06.158480 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO dbcounter [None req-c168f2fb-b8f2-4cf0-bca9-5825c6e80404 None None] Registered counter for database nova_api Oct 13 13:09:06.160926 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO dbcounter [None req-2f035dbf-cc52-4fc0-90c8-641d03d45762 None None] Registered counter for database nova_api Oct 13 13:09:06.179467 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_db.sqlalchemy.engines [None req-c168f2fb-b8f2-4cf0-bca9-5825c6e80404 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118814) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 13 13:09:06.181546 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_db.sqlalchemy.engines [None req-2f035dbf-cc52-4fc0-90c8-641d03d45762 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118815) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 13 13:09:06.186129 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG dbcounter [-] [118814] Writer thread running {{(pid=118814) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 13 13:09:06.188120 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG dbcounter [-] [118815] Writer thread running {{(pid=118815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 13 13:09:06.242247 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.context [None req-c168f2fb-b8f2-4cf0-bca9-5825c6e80404 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),0819204c-42d8-4282-8b98-8f0b36a44d37(cell1) {{(pid=118814) load_cells /opt/stack/nova/nova/context.py:464}} Oct 13 13:09:06.244338 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.context [None req-2f035dbf-cc52-4fc0-90c8-641d03d45762 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),0819204c-42d8-4282-8b98-8f0b36a44d37(cell1) {{(pid=118815) load_cells /opt/stack/nova/nova/context.py:464}} Oct 13 13:09:06.246277 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-c168f2fb-b8f2-4cf0-bca9-5825c6e80404 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:09:06.246789 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-c168f2fb-b8f2-4cf0-bca9-5825c6e80404 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:09:06.248372 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-2f035dbf-cc52-4fc0-90c8-641d03d45762 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:09:06.248510 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-c168f2fb-b8f2-4cf0-bca9-5825c6e80404 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:09:06.248851 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-2f035dbf-cc52-4fc0-90c8-641d03d45762 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:09:06.249131 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-c168f2fb-b8f2-4cf0-bca9-5825c6e80404 None None] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:09:06.249582 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-c168f2fb-b8f2-4cf0-bca9-5825c6e80404 None None] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:09:06.250445 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-2f035dbf-cc52-4fc0-90c8-641d03d45762 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:09:06.251297 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-2f035dbf-cc52-4fc0-90c8-641d03d45762 None None] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:09:06.251609 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-c168f2fb-b8f2-4cf0-bca9-5825c6e80404 None None] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:09:06.251754 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-2f035dbf-cc52-4fc0-90c8-641d03d45762 None None] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:09:06.253595 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO dbcounter [None req-c168f2fb-b8f2-4cf0-bca9-5825c6e80404 None None] Registered counter for database nova_cell0 Oct 13 13:09:06.253751 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-2f035dbf-cc52-4fc0-90c8-641d03d45762 None None] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:09:06.256014 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO dbcounter [None req-2f035dbf-cc52-4fc0-90c8-641d03d45762 None None] Registered counter for database nova_cell0 Oct 13 13:09:06.257605 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO dbcounter [None req-c168f2fb-b8f2-4cf0-bca9-5825c6e80404 None None] Registered counter for database nova_cell1 Oct 13 13:09:06.259934 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO dbcounter [None req-2f035dbf-cc52-4fc0-90c8-641d03d45762 None None] Registered counter for database nova_cell1 Oct 13 13:09:06.265355 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_db.sqlalchemy.engines [None req-c168f2fb-b8f2-4cf0-bca9-5825c6e80404 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118814) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 13 13:09:06.267745 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_db.sqlalchemy.engines [None req-c168f2fb-b8f2-4cf0-bca9-5825c6e80404 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118814) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 13 13:09:06.269031 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_db.sqlalchemy.engines [None req-2f035dbf-cc52-4fc0-90c8-641d03d45762 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118815) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 13 13:09:06.271305 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_db.sqlalchemy.engines [None req-2f035dbf-cc52-4fc0-90c8-641d03d45762 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118815) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 13 13:09:06.274400 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG dbcounter [-] [118814] Writer thread running {{(pid=118814) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 13 13:09:06.274774 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG dbcounter [-] [118814] Writer thread running {{(pid=118814) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 13 13:09:06.276162 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG dbcounter [-] [118815] Writer thread running {{(pid=118815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 13 13:09:06.279858 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG dbcounter [-] [118815] Writer thread running {{(pid=118815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 13 13:09:06.420934 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO dbcounter [None req-c168f2fb-b8f2-4cf0-bca9-5825c6e80404 None None] Registered counter for database nova_cell0 Oct 13 13:09:06.428174 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_db.sqlalchemy.engines [None req-c168f2fb-b8f2-4cf0-bca9-5825c6e80404 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118814) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 13 13:09:06.429107 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO dbcounter [None req-2f035dbf-cc52-4fc0-90c8-641d03d45762 None None] Registered counter for database nova_cell0 Oct 13 13:09:06.432917 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG dbcounter [-] [118814] Writer thread running {{(pid=118814) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 13 13:09:06.437739 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_db.sqlalchemy.engines [None req-2f035dbf-cc52-4fc0-90c8-641d03d45762 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118815) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 13 13:09:06.442742 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG dbcounter [-] [118815] Writer thread running {{(pid=118815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 13 13:09:06.752107 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: WARNING keystonemiddleware.auth_token [None req-c168f2fb-b8f2-4cf0-bca9-5825c6e80404 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 13 13:09:06.759369 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: WARNING keystonemiddleware.auth_token [None req-c168f2fb-b8f2-4cf0-bca9-5825c6e80404 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 13 13:09:06.771728 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: WARNING keystonemiddleware.auth_token [None req-2f035dbf-cc52-4fc0-90c8-641d03d45762 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 13 13:09:06.779863 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: WARNING keystonemiddleware.auth_token [None req-2f035dbf-cc52-4fc0-90c8-641d03d45762 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 13 13:09:07.104117 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: WARNING keystonemiddleware.auth_token [None req-c168f2fb-b8f2-4cf0-bca9-5825c6e80404 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 13 13:09:07.110197 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: WARNING keystonemiddleware.auth_token [None req-c168f2fb-b8f2-4cf0-bca9-5825c6e80404 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 13 13:09:07.115517 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55f2a25a59c0 pid: 118814 (default app) Oct 13 13:09:07.127205 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: WARNING keystonemiddleware.auth_token [None req-2f035dbf-cc52-4fc0-90c8-641d03d45762 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 13 13:09:07.133231 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: WARNING keystonemiddleware.auth_token [None req-2f035dbf-cc52-4fc0-90c8-641d03d45762 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 13 13:09:07.139139 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55f2a25a59c0 pid: 118815 (default app) Oct 13 13:09:40.972533 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG dbcounter [-] [118814] Writing DB stats nova_api:SELECT=3 {{(pid=118814) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:09:40.974726 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG dbcounter [-] [118814] Writing DB stats nova_cell1:SELECT=3 {{(pid=118814) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:09:40.976496 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG dbcounter [-] [118814] Writing DB stats nova_cell0:SELECT=3 {{(pid=118814) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:09:40.977290 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG dbcounter [-] [118814] Writing DB stats nova_cell0:SELECT=3 {{(pid=118814) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:09:41.997296 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-71ccf7ce-9adf-415d-bdd3-71216fcd9f40 tempest-VolumesGetTestJSON-497963220 tempest-VolumesGetTestJSON-497963220-project] Action: 'create', calling method: .version_select at 0x7f5098e04550>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1291025500", "metadata": {"Type": "work"}}} {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 13:09:42.617290 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG dbcounter [-] [118815] Writing DB stats nova_api:SELECT=3 {{(pid=118815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:09:42.618317 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG dbcounter [-] [118815] Writing DB stats nova_cell0:SELECT=3 {{(pid=118815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:09:42.619103 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG dbcounter [-] [118815] Writing DB stats nova_cell1:SELECT=3 {{(pid=118815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:09:42.620481 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG dbcounter [-] [118815] Writing DB stats nova_cell0:SELECT=3 {{(pid=118815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:09:43.886430 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-71ccf7ce-9adf-415d-bdd3-71216fcd9f40 tempest-VolumesGetTestJSON-497963220 tempest-VolumesGetTestJSON-497963220-project] 10.222.0.23 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 2.927304 Oct 13 13:09:43.887630 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 1/1] 10.222.0.23 () {60 vars in 1156 bytes} [Thu Oct 13 13:09:40 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 2930 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Oct 13 13:09:43.905819 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-7078e6b3-4284-4177-9477-9ab622921fe0 tempest-VolumesGetTestJSON-497963220 tempest-VolumesGetTestJSON-497963220-project] Calling method '.version_select at 0x7f5098cd9430>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:09:44.093105 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-7078e6b3-4284-4177-9477-9ab622921fe0 tempest-VolumesGetTestJSON-497963220 tempest-VolumesGetTestJSON-497963220-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/b4d6ca23-cc91-4cce-a9ac-dfed5551cdb3" status: 200 len: 353 microversion: 2.1 time: 0.192679 Oct 13 13:09:44.093678 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 2/2] 10.222.0.23 () {58 vars in 1245 bytes} [Thu Oct 13 13:09:43 2022] GET /compute/v2.1/os-volumes/b4d6ca23-cc91-4cce-a9ac-dfed5551cdb3 => generated 353 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 13 13:09:44.136234 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-f0cebeb2-7698-41fe-96b6-336557c6d1ac tempest-VolumesNegativeTest-443849995 tempest-VolumesNegativeTest-443849995-project] Action: 'create', calling method: .version_select at 0x7f5098e054c0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1807913977", "metadata": {"Type": "work"}}} {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 13:09:44.143041 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-f0cebeb2-7698-41fe-96b6-336557c6d1ac tempest-VolumesNegativeTest-443849995 tempest-VolumesNegativeTest-443849995-project] Request method failure captured: Oct 13 13:09:44.143041 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Oct 13 13:09:44.143041 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: Accept: application/json Oct 13 13:09:44.143041 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: Accept-Encoding: identity Oct 13 13:09:44.143041 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: Connection: close Oct 13 13:09:44.143041 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: Content-Length: 122 Oct 13 13:09:44.143041 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: Content-Type: application/json Oct 13 13:09:44.143041 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: Host: 10.222.0.23 Oct 13 13:09:44.143041 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: Openstack-System-Scope: None Oct 13 13:09:44.143041 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: User-Agent: python-urllib3/1.26.12 Oct 13 13:09:44.143041 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Auth-Token: gAAAAABjSA4W6lGHznimXDyXXjElAIjx3snf2_vtoJHR4jyV6Xg2uJrreTml5OPMQQhJIo7tRhr7OBsw_D4cHRy1pZFphgjI3gaFQyS1A3ygPDSRDCsNT1ec1UgKqmVmu4DBYrXrYu29DTlMkUsjr4LLJG6fUTAiO72AlM9Jkj31R1BjfoyGnPs Oct 13 13:09:44.143041 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Domain-Id: None Oct 13 13:09:44.143041 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Domain-Name: None Oct 13 13:09:44.143041 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Identity-Status: Confirmed Oct 13 13:09:44.143041 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Is-Admin-Project: True Oct 13 13:09:44.143041 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Project-Domain-Id: default Oct 13 13:09:44.143041 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Project-Domain-Name: Default Oct 13 13:09:44.143041 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Project-Id: 7ec0414e1e454d2099bda01207ac1380 Oct 13 13:09:44.143041 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Project-Name: tempest-VolumesNegativeTest-443849995 Oct 13 13:09:44.143041 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Role: reader,member Oct 13 13:09:44.143041 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Roles: reader,member Oct 13 13:09:44.144548 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_7ec0414e1e454d2099bda01207ac1380"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/7ec0414e1e454d2099bda01207ac1380"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/7ec0414e1e454d2099bda01207ac1380"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/7ec0414e1e454d2099bda01207ac1380"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}] Oct 13 13:09:44.144548 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Tenant: tempest-VolumesNegativeTest-443849995 Oct 13 13:09:44.144548 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Tenant-Id: 7ec0414e1e454d2099bda01207ac1380 Oct 13 13:09:44.144548 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Tenant-Name: tempest-VolumesNegativeTest-443849995 Oct 13 13:09:44.144548 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-User: tempest-VolumesNegativeTest-443849995-project Oct 13 13:09:44.144548 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-User-Domain-Id: default Oct 13 13:09:44.144548 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-User-Domain-Name: Default Oct 13 13:09:44.144548 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-User-Id: dc9c24d7fa024b1dafa212cf5bf5c02d Oct 13 13:09:44.144548 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-User-Name: tempest-VolumesNegativeTest-443849995-project Oct 13 13:09:44.144548 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: Oct 13 13:09:44.144548 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1807913977", "metadata": {"Type": "work"}}} Oct 13 13:09:44.144548 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: method: Oct 13 13:09:44.144548 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Oct 13 13:09:44.145479 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1807913977', 'metadata': {'Type': 'work'}}}} Oct 13 13:09:44.145479 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 13:09:44.145479 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 13:09:44.145479 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 13 13:09:44.145479 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 13 13:09:44.145479 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 13 13:09:44.145479 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi raise error Oct 13 13:09:44.145479 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Oct 13 13:09:44.145479 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi Oct 13 13:09:44.145479 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Oct 13 13:09:44.145479 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Oct 13 13:09:44.145479 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi Oct 13 13:09:44.145479 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi On instance['volume']: Oct 13 13:09:44.145479 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi '#$%' Oct 13 13:09:44.145479 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi Oct 13 13:09:44.145479 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 13:09:44.145479 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi Oct 13 13:09:44.145479 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 13:09:44.145479 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 13:09:44.145479 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 13:09:44.145479 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 13:09:44.145479 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 13:09:44.146809 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 13 13:09:44.146809 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 13 13:09:44.146809 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 13:09:44.146809 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 13:09:44.146809 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 13 13:09:44.146809 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 13 13:09:44.146809 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 13 13:09:44.146809 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 13 13:09:44.146809 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 13 13:09:44.146809 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 13 13:09:44.146809 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Oct 13 13:09:44.146809 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi Oct 13 13:09:44.146809 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 13:09:44.146809 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi Oct 13 13:09:44.146809 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 13:09:44.146809 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 13:09:44.146809 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 13:09:44.146809 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 13 13:09:44.146809 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 13 13:09:44.148188 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Oct 13 13:09:44.148188 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi Oct 13 13:09:44.148188 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-f0cebeb2-7698-41fe-96b6-336557c6d1ac tempest-VolumesNegativeTest-443849995 tempest-VolumesNegativeTest-443849995-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=118815) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 13:09:44.148188 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-f0cebeb2-7698-41fe-96b6-336557c6d1ac tempest-VolumesNegativeTest-443849995 tempest-VolumesNegativeTest-443849995-project] 10.222.0.23 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 1.538205 Oct 13 13:09:44.155457 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-bf81ecfb-8166-44be-9ced-3ecba1969946 tempest-VolumesNegativeTest-443849995 tempest-VolumesNegativeTest-443849995-project] Action: 'create', calling method: .version_select at 0x7f5098cd9a60>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1411434021", "metadata": {"Type": "work"}}} {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 13:09:44.160607 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 1/3] 10.222.0.23 () {60 vars in 1156 bytes} [Thu Oct 13 13:09:42 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 1555 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 13 13:09:44.161993 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-bf81ecfb-8166-44be-9ced-3ecba1969946 tempest-VolumesNegativeTest-443849995 tempest-VolumesNegativeTest-443849995-project] Request method failure captured: Oct 13 13:09:44.161993 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Oct 13 13:09:44.161993 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: Accept: application/json Oct 13 13:09:44.161993 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: Accept-Encoding: identity Oct 13 13:09:44.161993 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: Connection: close Oct 13 13:09:44.161993 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: Content-Length: 120 Oct 13 13:09:44.161993 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: Content-Type: application/json Oct 13 13:09:44.161993 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: Host: 10.222.0.23 Oct 13 13:09:44.161993 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: Openstack-System-Scope: None Oct 13 13:09:44.161993 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: User-Agent: python-urllib3/1.26.12 Oct 13 13:09:44.161993 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Auth-Token: gAAAAABjSA4W6lGHznimXDyXXjElAIjx3snf2_vtoJHR4jyV6Xg2uJrreTml5OPMQQhJIo7tRhr7OBsw_D4cHRy1pZFphgjI3gaFQyS1A3ygPDSRDCsNT1ec1UgKqmVmu4DBYrXrYu29DTlMkUsjr4LLJG6fUTAiO72AlM9Jkj31R1BjfoyGnPs Oct 13 13:09:44.161993 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Domain-Id: None Oct 13 13:09:44.161993 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Domain-Name: None Oct 13 13:09:44.161993 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Identity-Status: Confirmed Oct 13 13:09:44.161993 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Is-Admin-Project: True Oct 13 13:09:44.161993 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Project-Domain-Id: default Oct 13 13:09:44.161993 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Project-Domain-Name: Default Oct 13 13:09:44.161993 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Project-Id: 7ec0414e1e454d2099bda01207ac1380 Oct 13 13:09:44.161993 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Project-Name: tempest-VolumesNegativeTest-443849995 Oct 13 13:09:44.161993 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Role: reader,member Oct 13 13:09:44.161993 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Roles: reader,member Oct 13 13:09:44.163361 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_7ec0414e1e454d2099bda01207ac1380"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/7ec0414e1e454d2099bda01207ac1380"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/7ec0414e1e454d2099bda01207ac1380"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/7ec0414e1e454d2099bda01207ac1380"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}] Oct 13 13:09:44.163361 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Tenant: tempest-VolumesNegativeTest-443849995 Oct 13 13:09:44.163361 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Tenant-Id: 7ec0414e1e454d2099bda01207ac1380 Oct 13 13:09:44.163361 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Tenant-Name: tempest-VolumesNegativeTest-443849995 Oct 13 13:09:44.163361 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-User: tempest-VolumesNegativeTest-443849995-project Oct 13 13:09:44.163361 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-User-Domain-Id: default Oct 13 13:09:44.163361 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-User-Domain-Name: Default Oct 13 13:09:44.163361 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-User-Id: dc9c24d7fa024b1dafa212cf5bf5c02d Oct 13 13:09:44.163361 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-User-Name: tempest-VolumesNegativeTest-443849995-project Oct 13 13:09:44.163361 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: Oct 13 13:09:44.163361 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1411434021", "metadata": {"Type": "work"}}} Oct 13 13:09:44.163361 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: method: Oct 13 13:09:44.163361 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Oct 13 13:09:44.164161 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1411434021', 'metadata': {'Type': 'work'}}}} Oct 13 13:09:44.164161 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 13:09:44.164161 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 13:09:44.164161 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 13 13:09:44.164161 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 13 13:09:44.164161 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 13 13:09:44.164161 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi raise error Oct 13 13:09:44.164161 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Oct 13 13:09:44.164161 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi Oct 13 13:09:44.164161 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Oct 13 13:09:44.164161 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Oct 13 13:09:44.164161 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi Oct 13 13:09:44.164161 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi On instance['volume']: Oct 13 13:09:44.164161 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi '0' Oct 13 13:09:44.164161 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi Oct 13 13:09:44.164161 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 13:09:44.164161 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi Oct 13 13:09:44.164161 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 13:09:44.164161 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 13:09:44.164161 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 13:09:44.164161 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 13:09:44.164161 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 13:09:44.165513 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 13 13:09:44.165513 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 13 13:09:44.165513 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 13:09:44.165513 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 13:09:44.165513 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 13 13:09:44.165513 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 13 13:09:44.165513 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 13 13:09:44.165513 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 13 13:09:44.165513 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 13 13:09:44.165513 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 13 13:09:44.165513 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Oct 13 13:09:44.165513 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi Oct 13 13:09:44.165513 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 13:09:44.165513 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi Oct 13 13:09:44.165513 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 13:09:44.165513 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 13:09:44.165513 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 13:09:44.165513 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 13 13:09:44.165513 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 13 13:09:44.166642 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Oct 13 13:09:44.166642 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi Oct 13 13:09:44.167899 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-bf81ecfb-8166-44be-9ced-3ecba1969946 tempest-VolumesNegativeTest-443849995 tempest-VolumesNegativeTest-443849995-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=118814) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 13:09:44.168910 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-bf81ecfb-8166-44be-9ced-3ecba1969946 tempest-VolumesNegativeTest-443849995 tempest-VolumesNegativeTest-443849995-project] 10.222.0.23 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.018368 Oct 13 13:09:44.178493 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 3/4] 10.222.0.23 () {60 vars in 1156 bytes} [Thu Oct 13 13:09:44 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 24 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 13 13:09:44.180600 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-3197120c-c25d-4899-aecb-56e1a5b734b5 tempest-VolumesNegativeTest-443849995 tempest-VolumesNegativeTest-443849995-project] Action: 'create', calling method: .version_select at 0x7f5098e05e50>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1583653414", "metadata": {"Type": "work"}}} {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 13:09:44.185622 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-3197120c-c25d-4899-aecb-56e1a5b734b5 tempest-VolumesNegativeTest-443849995 tempest-VolumesNegativeTest-443849995-project] Request method failure captured: Oct 13 13:09:44.185622 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Oct 13 13:09:44.185622 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: Accept: application/json Oct 13 13:09:44.185622 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: Accept-Encoding: identity Oct 13 13:09:44.185622 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: Connection: close Oct 13 13:09:44.185622 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: Content-Length: 119 Oct 13 13:09:44.185622 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: Content-Type: application/json Oct 13 13:09:44.185622 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: Host: 10.222.0.23 Oct 13 13:09:44.185622 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: Openstack-System-Scope: None Oct 13 13:09:44.185622 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: User-Agent: python-urllib3/1.26.12 Oct 13 13:09:44.185622 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Auth-Token: gAAAAABjSA4W6lGHznimXDyXXjElAIjx3snf2_vtoJHR4jyV6Xg2uJrreTml5OPMQQhJIo7tRhr7OBsw_D4cHRy1pZFphgjI3gaFQyS1A3ygPDSRDCsNT1ec1UgKqmVmu4DBYrXrYu29DTlMkUsjr4LLJG6fUTAiO72AlM9Jkj31R1BjfoyGnPs Oct 13 13:09:44.185622 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Domain-Id: None Oct 13 13:09:44.185622 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Domain-Name: None Oct 13 13:09:44.185622 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Identity-Status: Confirmed Oct 13 13:09:44.185622 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Is-Admin-Project: True Oct 13 13:09:44.185622 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Project-Domain-Id: default Oct 13 13:09:44.185622 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Project-Domain-Name: Default Oct 13 13:09:44.185622 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Project-Id: 7ec0414e1e454d2099bda01207ac1380 Oct 13 13:09:44.185622 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Project-Name: tempest-VolumesNegativeTest-443849995 Oct 13 13:09:44.185622 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Role: reader,member Oct 13 13:09:44.185622 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Roles: reader,member Oct 13 13:09:44.187309 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_7ec0414e1e454d2099bda01207ac1380"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/7ec0414e1e454d2099bda01207ac1380"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/7ec0414e1e454d2099bda01207ac1380"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/7ec0414e1e454d2099bda01207ac1380"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}] Oct 13 13:09:44.187309 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Tenant: tempest-VolumesNegativeTest-443849995 Oct 13 13:09:44.187309 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Tenant-Id: 7ec0414e1e454d2099bda01207ac1380 Oct 13 13:09:44.187309 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Tenant-Name: tempest-VolumesNegativeTest-443849995 Oct 13 13:09:44.187309 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-User: tempest-VolumesNegativeTest-443849995-project Oct 13 13:09:44.187309 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-User-Domain-Id: default Oct 13 13:09:44.187309 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-User-Domain-Name: Default Oct 13 13:09:44.187309 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-User-Id: dc9c24d7fa024b1dafa212cf5bf5c02d Oct 13 13:09:44.187309 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-User-Name: tempest-VolumesNegativeTest-443849995-project Oct 13 13:09:44.187309 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: Oct 13 13:09:44.187309 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1583653414", "metadata": {"Type": "work"}}} Oct 13 13:09:44.187309 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: method: Oct 13 13:09:44.187309 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Oct 13 13:09:44.188121 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1583653414', 'metadata': {'Type': 'work'}}}} Oct 13 13:09:44.188121 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 13:09:44.188121 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 13:09:44.188121 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 13 13:09:44.188121 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 13 13:09:44.188121 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 13 13:09:44.188121 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi raise error Oct 13 13:09:44.188121 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Oct 13 13:09:44.188121 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi Oct 13 13:09:44.188121 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Oct 13 13:09:44.188121 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Oct 13 13:09:44.188121 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi Oct 13 13:09:44.188121 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi On instance['volume']: Oct 13 13:09:44.188121 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi '' Oct 13 13:09:44.188121 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi Oct 13 13:09:44.188121 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 13:09:44.188121 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi Oct 13 13:09:44.188121 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 13:09:44.188121 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 13:09:44.188121 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 13:09:44.188121 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 13:09:44.188121 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 13:09:44.189653 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 13 13:09:44.189653 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 13 13:09:44.189653 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 13:09:44.189653 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 13:09:44.189653 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 13 13:09:44.189653 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 13 13:09:44.189653 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 13 13:09:44.189653 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 13 13:09:44.189653 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 13 13:09:44.189653 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 13 13:09:44.189653 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Oct 13 13:09:44.189653 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi Oct 13 13:09:44.189653 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 13:09:44.189653 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi Oct 13 13:09:44.189653 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 13:09:44.189653 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 13:09:44.189653 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 13:09:44.189653 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 13 13:09:44.189653 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 13 13:09:44.191282 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Oct 13 13:09:44.191282 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi Oct 13 13:09:44.192228 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-3197120c-c25d-4899-aecb-56e1a5b734b5 tempest-VolumesNegativeTest-443849995 tempest-VolumesNegativeTest-443849995-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=118815) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 13:09:44.193619 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-3197120c-c25d-4899-aecb-56e1a5b734b5 tempest-VolumesNegativeTest-443849995 tempest-VolumesNegativeTest-443849995-project] 10.222.0.23 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.017871 Oct 13 13:09:44.194505 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 2/5] 10.222.0.23 () {60 vars in 1156 bytes} [Thu Oct 13 13:09:44 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 20 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 13 13:09:44.205724 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-323c2087-ce15-41ff-8d0b-5502ab74eeed tempest-VolumesNegativeTest-443849995 tempest-VolumesNegativeTest-443849995-project] Calling method '.version_select at 0x7f5098c6b430>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:09:44.254891 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.wsgi [None req-323c2087-ce15-41ff-8d0b-5502ab74eeed tempest-VolumesNegativeTest-443849995 tempest-VolumesNegativeTest-443849995-project] HTTP exception thrown: Volume tempest-invalid-1223418719 could not be found. Oct 13 13:09:44.258867 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-323c2087-ce15-41ff-8d0b-5502ab74eeed tempest-VolumesNegativeTest-443849995 tempest-VolumesNegativeTest-443849995-project] Request method failure captured: Oct 13 13:09:44.258867 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1223418719 HTTP/1.1 Oct 13 13:09:44.258867 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: Accept: application/json Oct 13 13:09:44.258867 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: Accept-Encoding: identity Oct 13 13:09:44.258867 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: Connection: close Oct 13 13:09:44.258867 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: Content-Length: 0 Oct 13 13:09:44.258867 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: Content-Type: application/json Oct 13 13:09:44.258867 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: Host: 10.222.0.23 Oct 13 13:09:44.258867 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: Openstack-System-Scope: None Oct 13 13:09:44.258867 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: User-Agent: python-urllib3/1.26.12 Oct 13 13:09:44.258867 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Auth-Token: gAAAAABjSA4W6lGHznimXDyXXjElAIjx3snf2_vtoJHR4jyV6Xg2uJrreTml5OPMQQhJIo7tRhr7OBsw_D4cHRy1pZFphgjI3gaFQyS1A3ygPDSRDCsNT1ec1UgKqmVmu4DBYrXrYu29DTlMkUsjr4LLJG6fUTAiO72AlM9Jkj31R1BjfoyGnPs Oct 13 13:09:44.258867 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Domain-Id: None Oct 13 13:09:44.258867 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Domain-Name: None Oct 13 13:09:44.258867 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Identity-Status: Confirmed Oct 13 13:09:44.258867 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Is-Admin-Project: True Oct 13 13:09:44.258867 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Project-Domain-Id: default Oct 13 13:09:44.258867 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Project-Domain-Name: Default Oct 13 13:09:44.258867 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Project-Id: 7ec0414e1e454d2099bda01207ac1380 Oct 13 13:09:44.258867 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Project-Name: tempest-VolumesNegativeTest-443849995 Oct 13 13:09:44.258867 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Role: reader,member Oct 13 13:09:44.258867 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Roles: reader,member Oct 13 13:09:44.260200 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_7ec0414e1e454d2099bda01207ac1380"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/7ec0414e1e454d2099bda01207ac1380"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/7ec0414e1e454d2099bda01207ac1380"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/7ec0414e1e454d2099bda01207ac1380"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}] Oct 13 13:09:44.260200 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Tenant: tempest-VolumesNegativeTest-443849995 Oct 13 13:09:44.260200 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Tenant-Id: 7ec0414e1e454d2099bda01207ac1380 Oct 13 13:09:44.260200 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Tenant-Name: tempest-VolumesNegativeTest-443849995 Oct 13 13:09:44.260200 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-User: tempest-VolumesNegativeTest-443849995-project Oct 13 13:09:44.260200 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-User-Domain-Id: default Oct 13 13:09:44.260200 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-User-Domain-Name: Default Oct 13 13:09:44.260200 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-User-Id: dc9c24d7fa024b1dafa212cf5bf5c02d Oct 13 13:09:44.260200 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-User-Name: tempest-VolumesNegativeTest-443849995-project Oct 13 13:09:44.260200 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: method: Oct 13 13:09:44.260200 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: exception: Volume tempest-invalid-1223418719 could not be found. Oct 13 13:09:44.260200 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: action_args: {'id': 'tempest-invalid-1223418719'} Oct 13 13:09:44.260200 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 13:09:44.261537 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 13:09:44.261537 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 13 13:09:44.261537 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 13 13:09:44.261537 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 13 13:09:44.261537 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 13 13:09:44.261537 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 13 13:09:44.261537 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 13 13:09:44.261537 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 13 13:09:44.261537 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 13 13:09:44.261537 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 13 13:09:44.261537 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 13 13:09:44.261537 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 13 13:09:44.261537 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 13 13:09:44.261537 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 13 13:09:44.261537 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 13 13:09:44.261537 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1223418719 could not be found. (HTTP 404) (Request-ID: req-27dff06e-33c9-40cc-b6a8-d9239e8c7f52) Oct 13 13:09:44.261537 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi Oct 13 13:09:44.261537 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 13:09:44.261537 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi Oct 13 13:09:44.262651 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 13:09:44.262651 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Oct 13 13:09:44.262651 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Oct 13 13:09:44.262651 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 13 13:09:44.262651 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 13 13:09:44.262651 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 13 13:09:44.262651 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 13 13:09:44.262651 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 13 13:09:44.262651 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 13 13:09:44.262651 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 13 13:09:44.262651 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 13 13:09:44.262651 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 13 13:09:44.262651 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 13 13:09:44.262651 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 13 13:09:44.262651 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 13 13:09:44.262651 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 13 13:09:44.262651 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 13 13:09:44.262651 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 13 13:09:44.262651 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 13 13:09:44.266360 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 13 13:09:44.266360 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 13 13:09:44.266360 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 13 13:09:44.266360 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 13 13:09:44.266360 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1223418719 could not be found. Oct 13 13:09:44.266360 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi Oct 13 13:09:44.266360 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 13:09:44.266360 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi Oct 13 13:09:44.266360 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 13:09:44.266360 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 13:09:44.266360 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 13:09:44.266360 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 13:09:44.266360 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 13:09:44.266360 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 13 13:09:44.266360 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 13 13:09:44.266360 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 13:09:44.266360 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 13:09:44.266360 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Oct 13 13:09:44.266360 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 13 13:09:44.266360 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1223418719 could not be found. Oct 13 13:09:44.268921 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi Oct 13 13:09:44.268921 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 13:09:44.268921 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi Oct 13 13:09:44.268921 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 13:09:44.268921 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 13:09:44.268921 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 13:09:44.268921 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 13:09:44.268921 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 13:09:44.268921 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1223418719 could not be found. Oct 13 13:09:44.268921 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi Oct 13 13:09:44.268921 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-323c2087-ce15-41ff-8d0b-5502ab74eeed tempest-VolumesNegativeTest-443849995 tempest-VolumesNegativeTest-443849995-project] Returning 404 to user: Volume tempest-invalid-1223418719 could not be found. {{(pid=118814) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 13:09:44.268921 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-323c2087-ce15-41ff-8d0b-5502ab74eeed tempest-VolumesNegativeTest-443849995 tempest-VolumesNegativeTest-443849995-project] 10.222.0.23 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1223418719" status: 404 len: 99 microversion: 2.1 time: 0.059569 Oct 13 13:09:44.278365 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-bc2197c6-0582-48d3-98b9-51ee8587dc38 tempest-VolumesNegativeTest-443849995 tempest-VolumesNegativeTest-443849995-project] 10.222.0.23 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.011212 Oct 13 13:09:44.281503 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 3/6] 10.222.0.23 () {58 vars in 1140 bytes} [Thu Oct 13 13:09:44 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 15 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 13 13:09:44.286352 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 4/7] 10.222.0.23 () {58 vars in 1218 bytes} [Thu Oct 13 13:09:44 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1223418719 => generated 99 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 13 13:09:44.297629 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-e72ff4e9-7ff9-4186-a41f-5ca72c302566 tempest-VolumesNegativeTest-443849995 tempest-VolumesNegativeTest-443849995-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.005736 Oct 13 13:09:44.313331 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 4/8] 10.222.0.23 () {58 vars in 1137 bytes} [Thu Oct 13 13:09:44 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 22 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 13 13:09:44.324939 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-78e9eabe-f629-4fec-b0ba-414b545f6166 tempest-VolumesNegativeTest-443849995 tempest-VolumesNegativeTest-443849995-project] Calling method '.version_select at 0x7f5098ca8700>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:09:44.374978 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.wsgi [None req-78e9eabe-f629-4fec-b0ba-414b545f6166 tempest-VolumesNegativeTest-443849995 tempest-VolumesNegativeTest-443849995-project] HTTP exception thrown: Volume 9e350db4-7396-487a-9a6e-c22ea1161649 could not be found. Oct 13 13:09:44.376968 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-78e9eabe-f629-4fec-b0ba-414b545f6166 tempest-VolumesNegativeTest-443849995 tempest-VolumesNegativeTest-443849995-project] Request method failure captured: Oct 13 13:09:44.376968 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: request: DELETE /compute/v2.1/os-volumes/9e350db4-7396-487a-9a6e-c22ea1161649 HTTP/1.1 Oct 13 13:09:44.376968 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: Accept: application/json Oct 13 13:09:44.376968 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: Accept-Encoding: identity Oct 13 13:09:44.376968 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: Connection: close Oct 13 13:09:44.376968 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: Content-Length: 0 Oct 13 13:09:44.376968 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: Content-Type: application/json Oct 13 13:09:44.376968 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: Host: 10.222.0.23 Oct 13 13:09:44.376968 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: Openstack-System-Scope: None Oct 13 13:09:44.376968 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: User-Agent: python-urllib3/1.26.12 Oct 13 13:09:44.376968 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Auth-Token: gAAAAABjSA4W6lGHznimXDyXXjElAIjx3snf2_vtoJHR4jyV6Xg2uJrreTml5OPMQQhJIo7tRhr7OBsw_D4cHRy1pZFphgjI3gaFQyS1A3ygPDSRDCsNT1ec1UgKqmVmu4DBYrXrYu29DTlMkUsjr4LLJG6fUTAiO72AlM9Jkj31R1BjfoyGnPs Oct 13 13:09:44.376968 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Domain-Id: None Oct 13 13:09:44.376968 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Domain-Name: None Oct 13 13:09:44.376968 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Identity-Status: Confirmed Oct 13 13:09:44.376968 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Is-Admin-Project: True Oct 13 13:09:44.376968 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Project-Domain-Id: default Oct 13 13:09:44.376968 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Project-Domain-Name: Default Oct 13 13:09:44.376968 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Project-Id: 7ec0414e1e454d2099bda01207ac1380 Oct 13 13:09:44.376968 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Project-Name: tempest-VolumesNegativeTest-443849995 Oct 13 13:09:44.376968 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Role: reader,member Oct 13 13:09:44.376968 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Roles: reader,member Oct 13 13:09:44.378265 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_7ec0414e1e454d2099bda01207ac1380"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/7ec0414e1e454d2099bda01207ac1380"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/7ec0414e1e454d2099bda01207ac1380"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/7ec0414e1e454d2099bda01207ac1380"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}] Oct 13 13:09:44.378265 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Tenant: tempest-VolumesNegativeTest-443849995 Oct 13 13:09:44.378265 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Tenant-Id: 7ec0414e1e454d2099bda01207ac1380 Oct 13 13:09:44.378265 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Tenant-Name: tempest-VolumesNegativeTest-443849995 Oct 13 13:09:44.378265 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-User: tempest-VolumesNegativeTest-443849995-project Oct 13 13:09:44.378265 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-User-Domain-Id: default Oct 13 13:09:44.378265 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-User-Domain-Name: Default Oct 13 13:09:44.378265 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-User-Id: dc9c24d7fa024b1dafa212cf5bf5c02d Oct 13 13:09:44.378265 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-User-Name: tempest-VolumesNegativeTest-443849995-project Oct 13 13:09:44.378265 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: method: Oct 13 13:09:44.378265 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: exception: Volume 9e350db4-7396-487a-9a6e-c22ea1161649 could not be found. Oct 13 13:09:44.378265 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: action_args: {'id': '9e350db4-7396-487a-9a6e-c22ea1161649'} Oct 13 13:09:44.378265 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 13:09:44.379088 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 13:09:44.379088 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 13 13:09:44.379088 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 13 13:09:44.379088 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 13 13:09:44.379088 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 13 13:09:44.379088 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 13 13:09:44.379088 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 13 13:09:44.379088 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 13 13:09:44.379088 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 13 13:09:44.379088 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 13 13:09:44.379088 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 13 13:09:44.379088 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 13 13:09:44.379088 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 13 13:09:44.379088 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 13 13:09:44.379088 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 13 13:09:44.379088 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 9e350db4-7396-487a-9a6e-c22ea1161649 could not be found. (HTTP 404) (Request-ID: req-d4b95754-b171-47f2-b965-745810b84722) Oct 13 13:09:44.379088 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi Oct 13 13:09:44.379088 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 13:09:44.379088 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi Oct 13 13:09:44.380302 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 13:09:44.380302 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Oct 13 13:09:44.380302 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Oct 13 13:09:44.380302 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 13 13:09:44.380302 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 13 13:09:44.380302 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 13 13:09:44.380302 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 13 13:09:44.380302 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 13 13:09:44.380302 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 13 13:09:44.380302 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 13 13:09:44.380302 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 13 13:09:44.380302 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 13 13:09:44.380302 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 13 13:09:44.380302 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 13 13:09:44.380302 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 13 13:09:44.380302 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 13 13:09:44.380302 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 13 13:09:44.380302 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 13 13:09:44.380302 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 13 13:09:44.381424 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 13 13:09:44.381424 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 13 13:09:44.381424 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 13 13:09:44.381424 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 13 13:09:44.381424 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 9e350db4-7396-487a-9a6e-c22ea1161649 could not be found. Oct 13 13:09:44.381424 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi Oct 13 13:09:44.381424 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 13:09:44.381424 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi Oct 13 13:09:44.381424 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 13:09:44.381424 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 13:09:44.381424 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 13:09:44.381424 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 13:09:44.381424 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 13:09:44.381424 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 13 13:09:44.381424 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 13 13:09:44.381424 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 13:09:44.381424 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 13:09:44.381424 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Oct 13 13:09:44.381424 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 13 13:09:44.382594 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 9e350db4-7396-487a-9a6e-c22ea1161649 could not be found. Oct 13 13:09:44.382594 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi Oct 13 13:09:44.382594 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 13:09:44.382594 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi Oct 13 13:09:44.382594 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 13:09:44.382594 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 13:09:44.382594 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 13:09:44.382594 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 13:09:44.382594 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 13:09:44.382594 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 9e350db4-7396-487a-9a6e-c22ea1161649 could not be found. Oct 13 13:09:44.382594 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi Oct 13 13:09:44.382594 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-78e9eabe-f629-4fec-b0ba-414b545f6166 tempest-VolumesNegativeTest-443849995 tempest-VolumesNegativeTest-443849995-project] Returning 404 to user: Volume 9e350db4-7396-487a-9a6e-c22ea1161649 could not be found. {{(pid=118814) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 13:09:44.382594 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-78e9eabe-f629-4fec-b0ba-414b545f6166 tempest-VolumesNegativeTest-443849995 tempest-VolumesNegativeTest-443849995-project] 10.222.0.23 "DELETE /compute/v2.1/os-volumes/9e350db4-7396-487a-9a6e-c22ea1161649" status: 404 len: 109 microversion: 2.1 time: 0.059597 Oct 13 13:09:44.382594 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 5/9] 10.222.0.23 () {58 vars in 1248 bytes} [Thu Oct 13 13:09:44 2022] DELETE /compute/v2.1/os-volumes/9e350db4-7396-487a-9a6e-c22ea1161649 => generated 109 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 13 13:09:44.390796 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-eca5bbdc-7bc3-4203-ab33-bfe96339b277 tempest-VolumesNegativeTest-443849995 tempest-VolumesNegativeTest-443849995-project] Calling method '.version_select at 0x7f5098cc2700>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:09:44.815426 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.wsgi [None req-eca5bbdc-7bc3-4203-ab33-bfe96339b277 tempest-VolumesNegativeTest-443849995 tempest-VolumesNegativeTest-443849995-project] HTTP exception thrown: Volume abae0f44-9687-4498-8e5c-ca8ff2264167 could not be found. Oct 13 13:09:44.819613 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-eca5bbdc-7bc3-4203-ab33-bfe96339b277 tempest-VolumesNegativeTest-443849995 tempest-VolumesNegativeTest-443849995-project] Request method failure captured: Oct 13 13:09:44.819613 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: request: GET /compute/v2.1/os-volumes/abae0f44-9687-4498-8e5c-ca8ff2264167 HTTP/1.1 Oct 13 13:09:44.819613 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: Accept: application/json Oct 13 13:09:44.819613 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: Accept-Encoding: identity Oct 13 13:09:44.819613 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: Connection: close Oct 13 13:09:44.819613 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: Content-Length: 0 Oct 13 13:09:44.819613 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: Content-Type: application/json Oct 13 13:09:44.819613 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: Host: 10.222.0.23 Oct 13 13:09:44.819613 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: Openstack-System-Scope: None Oct 13 13:09:44.819613 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: User-Agent: python-urllib3/1.26.12 Oct 13 13:09:44.819613 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Auth-Token: gAAAAABjSA4W6lGHznimXDyXXjElAIjx3snf2_vtoJHR4jyV6Xg2uJrreTml5OPMQQhJIo7tRhr7OBsw_D4cHRy1pZFphgjI3gaFQyS1A3ygPDSRDCsNT1ec1UgKqmVmu4DBYrXrYu29DTlMkUsjr4LLJG6fUTAiO72AlM9Jkj31R1BjfoyGnPs Oct 13 13:09:44.819613 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Domain-Id: None Oct 13 13:09:44.819613 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Domain-Name: None Oct 13 13:09:44.819613 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Identity-Status: Confirmed Oct 13 13:09:44.819613 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Is-Admin-Project: True Oct 13 13:09:44.819613 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Project-Domain-Id: default Oct 13 13:09:44.819613 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Project-Domain-Name: Default Oct 13 13:09:44.819613 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Project-Id: 7ec0414e1e454d2099bda01207ac1380 Oct 13 13:09:44.819613 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Project-Name: tempest-VolumesNegativeTest-443849995 Oct 13 13:09:44.819613 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Role: reader,member Oct 13 13:09:44.819613 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Roles: reader,member Oct 13 13:09:44.821001 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_7ec0414e1e454d2099bda01207ac1380"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/7ec0414e1e454d2099bda01207ac1380"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/7ec0414e1e454d2099bda01207ac1380"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/7ec0414e1e454d2099bda01207ac1380"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}] Oct 13 13:09:44.821001 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Tenant: tempest-VolumesNegativeTest-443849995 Oct 13 13:09:44.821001 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Tenant-Id: 7ec0414e1e454d2099bda01207ac1380 Oct 13 13:09:44.821001 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Tenant-Name: tempest-VolumesNegativeTest-443849995 Oct 13 13:09:44.821001 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-User: tempest-VolumesNegativeTest-443849995-project Oct 13 13:09:44.821001 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-User-Domain-Id: default Oct 13 13:09:44.821001 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-User-Domain-Name: Default Oct 13 13:09:44.821001 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-User-Id: dc9c24d7fa024b1dafa212cf5bf5c02d Oct 13 13:09:44.821001 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-User-Name: tempest-VolumesNegativeTest-443849995-project Oct 13 13:09:44.821001 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: method: Oct 13 13:09:44.821001 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: exception: Volume abae0f44-9687-4498-8e5c-ca8ff2264167 could not be found. Oct 13 13:09:44.821001 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: action_args: {'id': 'abae0f44-9687-4498-8e5c-ca8ff2264167'} Oct 13 13:09:44.821001 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 13:09:44.821757 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 13:09:44.821757 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 13 13:09:44.821757 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 13 13:09:44.821757 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 13 13:09:44.821757 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 13 13:09:44.821757 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 13 13:09:44.821757 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 13 13:09:44.821757 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 13 13:09:44.821757 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 13 13:09:44.821757 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 13 13:09:44.821757 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 13 13:09:44.821757 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 13 13:09:44.821757 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 13 13:09:44.821757 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 13 13:09:44.821757 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 13 13:09:44.821757 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume abae0f44-9687-4498-8e5c-ca8ff2264167 could not be found. (HTTP 404) (Request-ID: req-5508bcad-5d37-4ea0-820e-740b671ef26c) Oct 13 13:09:44.821757 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi Oct 13 13:09:44.821757 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 13:09:44.821757 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi Oct 13 13:09:44.823028 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 13:09:44.823028 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 13 13:09:44.823028 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 13 13:09:44.823028 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 13 13:09:44.823028 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 13 13:09:44.823028 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 13 13:09:44.823028 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 13 13:09:44.823028 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 13 13:09:44.823028 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 13 13:09:44.823028 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 13 13:09:44.823028 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 13 13:09:44.823028 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 13 13:09:44.823028 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 13 13:09:44.823028 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 13 13:09:44.823028 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 13 13:09:44.823028 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 13 13:09:44.823028 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 13 13:09:44.823028 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 13 13:09:44.823028 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 13 13:09:44.825545 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 13 13:09:44.825545 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 13 13:09:44.825545 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 13 13:09:44.825545 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 13 13:09:44.825545 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume abae0f44-9687-4498-8e5c-ca8ff2264167 could not be found. Oct 13 13:09:44.825545 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi Oct 13 13:09:44.825545 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 13:09:44.825545 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi Oct 13 13:09:44.825545 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 13:09:44.825545 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 13:09:44.825545 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 13:09:44.825545 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 13:09:44.825545 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 13:09:44.825545 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 13 13:09:44.825545 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 13 13:09:44.825545 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 13:09:44.825545 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 13:09:44.825545 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 13 13:09:44.825545 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 13 13:09:44.827905 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume abae0f44-9687-4498-8e5c-ca8ff2264167 could not be found. Oct 13 13:09:44.827905 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi Oct 13 13:09:44.827905 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 13:09:44.827905 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi Oct 13 13:09:44.827905 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 13:09:44.827905 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 13:09:44.827905 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 13:09:44.827905 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 13:09:44.827905 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 13:09:44.827905 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume abae0f44-9687-4498-8e5c-ca8ff2264167 could not be found. Oct 13 13:09:44.827905 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi Oct 13 13:09:44.827905 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-eca5bbdc-7bc3-4203-ab33-bfe96339b277 tempest-VolumesNegativeTest-443849995 tempest-VolumesNegativeTest-443849995-project] Returning 404 to user: Volume abae0f44-9687-4498-8e5c-ca8ff2264167 could not be found. {{(pid=118815) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 13:09:44.827905 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-eca5bbdc-7bc3-4203-ab33-bfe96339b277 tempest-VolumesNegativeTest-443849995 tempest-VolumesNegativeTest-443849995-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/abae0f44-9687-4498-8e5c-ca8ff2264167" status: 404 len: 109 microversion: 2.1 time: 0.434489 Oct 13 13:09:44.827905 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 5/10] 10.222.0.23 () {58 vars in 1245 bytes} [Thu Oct 13 13:09:44 2022] GET /compute/v2.1/os-volumes/abae0f44-9687-4498-8e5c-ca8ff2264167 => generated 109 bytes in 436 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 13 13:09:45.108538 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-644ccddd-b575-44f5-a178-048130f8450b tempest-VolumesGetTestJSON-497963220 tempest-VolumesGetTestJSON-497963220-project] Calling method '.version_select at 0x7f5098c6b700>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:09:45.230675 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-644ccddd-b575-44f5-a178-048130f8450b tempest-VolumesGetTestJSON-497963220 tempest-VolumesGetTestJSON-497963220-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/b4d6ca23-cc91-4cce-a9ac-dfed5551cdb3" status: 200 len: 354 microversion: 2.1 time: 0.123351 Oct 13 13:09:45.231293 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 6/11] 10.222.0.23 () {58 vars in 1245 bytes} [Thu Oct 13 13:09:45 2022] GET /compute/v2.1/os-volumes/b4d6ca23-cc91-4cce-a9ac-dfed5551cdb3 => generated 354 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 13:09:45.245174 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-bb97ac2f-b1c3-4482-b972-067294588728 tempest-VolumesGetTestJSON-497963220 tempest-VolumesGetTestJSON-497963220-project] Calling method '.version_select at 0x7f5098ec3e50>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:09:45.355260 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-5ab22d44-a9f4-435c-b876-95711ada8462 tempest-VolumesTestJSON-1408096684 tempest-VolumesTestJSON-1408096684-project] Calling method '.version_select at 0x7f5098ca84c0>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:09:45.361551 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-bb97ac2f-b1c3-4482-b972-067294588728 tempest-VolumesGetTestJSON-497963220 tempest-VolumesGetTestJSON-497963220-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/b4d6ca23-cc91-4cce-a9ac-dfed5551cdb3" status: 200 len: 354 microversion: 2.1 time: 0.121119 Oct 13 13:09:45.362334 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 6/12] 10.222.0.23 () {58 vars in 1245 bytes} [Thu Oct 13 13:09:45 2022] GET /compute/v2.1/os-volumes/b4d6ca23-cc91-4cce-a9ac-dfed5551cdb3 => generated 354 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 13:09:45.390651 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-5abd0e17-cacf-4cad-be1f-96e2837e5127 tempest-VolumesGetTestJSON-497963220 tempest-VolumesGetTestJSON-497963220-project] Calling method '.version_select at 0x7f5098bf5700>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:09:45.462523 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-5ab22d44-a9f4-435c-b876-95711ada8462 tempest-VolumesTestJSON-1408096684 tempest-VolumesTestJSON-1408096684-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/58d95512-40cd-4af4-b9d8-4464001cf5e1" status: 200 len: 350 microversion: 2.1 time: 0.111134 Oct 13 13:09:45.463179 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 7/13] 10.222.0.23 () {58 vars in 1245 bytes} [Thu Oct 13 13:09:45 2022] GET /compute/v2.1/os-volumes/58d95512-40cd-4af4-b9d8-4464001cf5e1 => generated 350 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 13 13:09:45.587817 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-5abd0e17-cacf-4cad-be1f-96e2837e5127 tempest-VolumesGetTestJSON-497963220 tempest-VolumesGetTestJSON-497963220-project] 10.222.0.23 "DELETE /compute/v2.1/os-volumes/b4d6ca23-cc91-4cce-a9ac-dfed5551cdb3" status: 202 len: 0 microversion: 2.1 time: 0.202348 Oct 13 13:09:45.593146 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 7/14] 10.222.0.23 () {58 vars in 1248 bytes} [Thu Oct 13 13:09:45 2022] DELETE /compute/v2.1/os-volumes/b4d6ca23-cc91-4cce-a9ac-dfed5551cdb3 => generated 0 bytes in 210 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 13 13:09:45.598303 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-d2916d19-859a-44ad-a94a-2d4b8db8b066 tempest-VolumesGetTestJSON-497963220 tempest-VolumesGetTestJSON-497963220-project] Calling method '.version_select at 0x7f5098ca8ee0>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:09:45.940771 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.wsgi [None req-d2916d19-859a-44ad-a94a-2d4b8db8b066 tempest-VolumesGetTestJSON-497963220 tempest-VolumesGetTestJSON-497963220-project] HTTP exception thrown: Volume b4d6ca23-cc91-4cce-a9ac-dfed5551cdb3 could not be found. Oct 13 13:09:45.943717 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-d2916d19-859a-44ad-a94a-2d4b8db8b066 tempest-VolumesGetTestJSON-497963220 tempest-VolumesGetTestJSON-497963220-project] Request method failure captured: Oct 13 13:09:45.943717 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: request: GET /compute/v2.1/os-volumes/b4d6ca23-cc91-4cce-a9ac-dfed5551cdb3 HTTP/1.1 Oct 13 13:09:45.943717 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: Accept: application/json Oct 13 13:09:45.943717 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: Accept-Encoding: identity Oct 13 13:09:45.943717 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: Connection: close Oct 13 13:09:45.943717 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: Content-Length: 0 Oct 13 13:09:45.943717 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: Content-Type: application/json Oct 13 13:09:45.943717 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: Host: 10.222.0.23 Oct 13 13:09:45.943717 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: Openstack-System-Scope: None Oct 13 13:09:45.943717 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: User-Agent: python-urllib3/1.26.12 Oct 13 13:09:45.943717 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Auth-Token: gAAAAABjSA4UuuyTJKU0rX4XoVtOtdebEjVgrm87bsyzyboe3PtWaD3uUSWopxK0YJepiUnnFlR6SjHMtb_d4oiKycWs_8AxHBBDtLN_hWS5RDG6yBr03kno5StCXxTE7KJv76xvEwYRALrdCYyMnYdDERuWjCyVpNCFXk_fDCOs_E78vlF5Cfc Oct 13 13:09:45.943717 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Domain-Id: None Oct 13 13:09:45.943717 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Domain-Name: None Oct 13 13:09:45.943717 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Identity-Status: Confirmed Oct 13 13:09:45.943717 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Is-Admin-Project: True Oct 13 13:09:45.943717 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Project-Domain-Id: default Oct 13 13:09:45.943717 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Project-Domain-Name: Default Oct 13 13:09:45.943717 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Project-Id: fcc66b8f231d4b47be0c6c6b4b52b389 Oct 13 13:09:45.943717 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Project-Name: tempest-VolumesGetTestJSON-497963220 Oct 13 13:09:45.943717 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Role: reader,member Oct 13 13:09:45.943717 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Roles: reader,member Oct 13 13:09:45.945357 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_fcc66b8f231d4b47be0c6c6b4b52b389"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/fcc66b8f231d4b47be0c6c6b4b52b389"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/fcc66b8f231d4b47be0c6c6b4b52b389"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/fcc66b8f231d4b47be0c6c6b4b52b389"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}] Oct 13 13:09:45.945357 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Tenant: tempest-VolumesGetTestJSON-497963220 Oct 13 13:09:45.945357 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Tenant-Id: fcc66b8f231d4b47be0c6c6b4b52b389 Oct 13 13:09:45.945357 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Tenant-Name: tempest-VolumesGetTestJSON-497963220 Oct 13 13:09:45.945357 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-User: tempest-VolumesGetTestJSON-497963220-project Oct 13 13:09:45.945357 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-User-Domain-Id: default Oct 13 13:09:45.945357 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-User-Domain-Name: Default Oct 13 13:09:45.945357 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-User-Id: 8c83931f54cb4d16b530cf7b4b817899 Oct 13 13:09:45.945357 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-User-Name: tempest-VolumesGetTestJSON-497963220-project Oct 13 13:09:45.945357 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: method: Oct 13 13:09:45.945357 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: exception: Volume b4d6ca23-cc91-4cce-a9ac-dfed5551cdb3 could not be found. Oct 13 13:09:45.945357 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: action_args: {'id': 'b4d6ca23-cc91-4cce-a9ac-dfed5551cdb3'} Oct 13 13:09:45.945357 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 13:09:45.946418 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 13:09:45.946418 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 13 13:09:45.946418 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 13 13:09:45.946418 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 13 13:09:45.946418 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 13 13:09:45.946418 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 13 13:09:45.946418 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 13 13:09:45.946418 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 13 13:09:45.946418 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 13 13:09:45.946418 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 13 13:09:45.946418 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 13 13:09:45.946418 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 13 13:09:45.946418 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 13 13:09:45.946418 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 13 13:09:45.946418 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 13 13:09:45.946418 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume b4d6ca23-cc91-4cce-a9ac-dfed5551cdb3 could not be found. (HTTP 404) (Request-ID: req-498c06b6-cbdb-44cd-a9a4-00dd4303c89f) Oct 13 13:09:45.946418 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi Oct 13 13:09:45.946418 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 13:09:45.946418 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi Oct 13 13:09:45.948826 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 13:09:45.948826 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 13 13:09:45.948826 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 13 13:09:45.948826 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 13 13:09:45.948826 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 13 13:09:45.948826 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 13 13:09:45.948826 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 13 13:09:45.948826 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 13 13:09:45.948826 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 13 13:09:45.948826 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 13 13:09:45.948826 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 13 13:09:45.948826 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 13 13:09:45.948826 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 13 13:09:45.948826 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 13 13:09:45.948826 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 13 13:09:45.948826 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 13 13:09:45.948826 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 13 13:09:45.948826 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 13 13:09:45.948826 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 13 13:09:45.950434 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 13 13:09:45.950434 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 13 13:09:45.950434 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 13 13:09:45.950434 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 13 13:09:45.950434 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume b4d6ca23-cc91-4cce-a9ac-dfed5551cdb3 could not be found. Oct 13 13:09:45.950434 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi Oct 13 13:09:45.950434 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 13:09:45.950434 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi Oct 13 13:09:45.950434 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 13:09:45.950434 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 13:09:45.950434 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 13:09:45.950434 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 13:09:45.950434 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 13:09:45.950434 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 13 13:09:45.950434 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 13 13:09:45.950434 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 13:09:45.950434 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 13:09:45.950434 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 13 13:09:45.950434 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 13 13:09:45.952006 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume b4d6ca23-cc91-4cce-a9ac-dfed5551cdb3 could not be found. Oct 13 13:09:45.952006 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi Oct 13 13:09:45.952006 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 13:09:45.952006 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi Oct 13 13:09:45.952006 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 13:09:45.952006 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 13:09:45.952006 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 13:09:45.952006 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 13:09:45.952006 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 13:09:45.952006 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume b4d6ca23-cc91-4cce-a9ac-dfed5551cdb3 could not be found. Oct 13 13:09:45.952006 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi Oct 13 13:09:45.955447 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-d2916d19-859a-44ad-a94a-2d4b8db8b066 tempest-VolumesGetTestJSON-497963220 tempest-VolumesGetTestJSON-497963220-project] Returning 404 to user: Volume b4d6ca23-cc91-4cce-a9ac-dfed5551cdb3 could not be found. {{(pid=118814) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 13:09:45.956428 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-d2916d19-859a-44ad-a94a-2d4b8db8b066 tempest-VolumesGetTestJSON-497963220 tempest-VolumesGetTestJSON-497963220-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/b4d6ca23-cc91-4cce-a9ac-dfed5551cdb3" status: 404 len: 109 microversion: 2.1 time: 0.362255 Oct 13 13:09:45.957560 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 8/15] 10.222.0.23 () {58 vars in 1245 bytes} [Thu Oct 13 13:09:45 2022] GET /compute/v2.1/os-volumes/b4d6ca23-cc91-4cce-a9ac-dfed5551cdb3 => generated 109 bytes in 364 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 13 13:09:47.380014 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-49fbf464-1af6-424c-b254-5dd74c447923 tempest-VolumesTestJSON-1408096684 tempest-VolumesTestJSON-1408096684-project] Calling method '.version_select at 0x7f5098c97820>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:09:47.672409 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-49fbf464-1af6-424c-b254-5dd74c447923 tempest-VolumesTestJSON-1408096684 tempest-VolumesTestJSON-1408096684-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/0dd4f747-aee8-4954-817f-b368b4f29357" status: 200 len: 350 microversion: 2.1 time: 0.296629 Oct 13 13:09:47.682204 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 8/16] 10.222.0.23 () {58 vars in 1245 bytes} [Thu Oct 13 13:09:47 2022] GET /compute/v2.1/os-volumes/0dd4f747-aee8-4954-817f-b368b4f29357 => generated 350 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 13:09:49.566866 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-ed789496-54ed-4958-a7a4-80fc4534a784 tempest-VolumesTestJSON-1408096684 tempest-VolumesTestJSON-1408096684-project] Calling method '.version_select at 0x7f5098ca8f70>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:09:49.692860 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-ed789496-54ed-4958-a7a4-80fc4534a784 tempest-VolumesTestJSON-1408096684 tempest-VolumesTestJSON-1408096684-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/7bcd57f1-ee8a-4fc3-9784-a47d0de499e2" status: 200 len: 350 microversion: 2.1 time: 0.130840 Oct 13 13:09:49.694087 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 9/17] 10.222.0.23 () {58 vars in 1245 bytes} [Thu Oct 13 13:09:49 2022] GET /compute/v2.1/os-volumes/7bcd57f1-ee8a-4fc3-9784-a47d0de499e2 => generated 350 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 13:09:49.707904 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-970eb784-e131-4165-a248-57f840032aa9 tempest-VolumesTestJSON-1408096684 tempest-VolumesTestJSON-1408096684-project] Calling method '.version_select at 0x7f5098bf5a60>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:09:49.955077 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-970eb784-e131-4165-a248-57f840032aa9 tempest-VolumesTestJSON-1408096684 tempest-VolumesTestJSON-1408096684-project] 10.222.0.23 "GET /compute/v2.1/os-volumes" status: 200 len: 1033 microversion: 2.1 time: 0.251561 Oct 13 13:09:49.956034 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 9/18] 10.222.0.23 () {58 vars in 1134 bytes} [Thu Oct 13 13:09:49 2022] GET /compute/v2.1/os-volumes => generated 1033 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:09:49.970960 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-f87402d3-b1af-4ac6-875f-4633d1be1e16 tempest-VolumesTestJSON-1408096684 tempest-VolumesTestJSON-1408096684-project] Calling method '.version_select at 0x7f5098ca84c0>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:09:50.141414 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-f87402d3-b1af-4ac6-875f-4633d1be1e16 tempest-VolumesTestJSON-1408096684 tempest-VolumesTestJSON-1408096684-project] 10.222.0.23 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.173683 Oct 13 13:09:50.142773 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 10/19] 10.222.0.23 () {58 vars in 1149 bytes} [Thu Oct 13 13:09:49 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 693 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 13:09:50.159048 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-2a5bfacd-8875-403a-a305-78451e4fcd4f tempest-VolumesTestJSON-1408096684 tempest-VolumesTestJSON-1408096684-project] Calling method '.version_select at 0x7f5098ca4310>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:09:50.424028 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-2a5bfacd-8875-403a-a305-78451e4fcd4f tempest-VolumesTestJSON-1408096684 tempest-VolumesTestJSON-1408096684-project] 10.222.0.23 "GET /compute/v2.1/os-volumes" status: 200 len: 1033 microversion: 2.1 time: 0.268786 Oct 13 13:09:50.424745 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 10/20] 10.222.0.23 () {58 vars in 1134 bytes} [Thu Oct 13 13:09:50 2022] GET /compute/v2.1/os-volumes => generated 1033 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:09:50.438956 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-0bf186a1-58ad-43d6-9c68-bbf5f9b21d03 tempest-VolumesTestJSON-1408096684 tempest-VolumesTestJSON-1408096684-project] Calling method '.version_select at 0x7f5098ca8670>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:09:50.612483 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-0bf186a1-58ad-43d6-9c68-bbf5f9b21d03 tempest-VolumesTestJSON-1408096684 tempest-VolumesTestJSON-1408096684-project] 10.222.0.23 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.177141 Oct 13 13:09:50.613981 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 11/21] 10.222.0.23 () {58 vars in 1167 bytes} [Thu Oct 13 13:09:50 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 13:09:50.628050 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-bb3c39e9-8cd2-4943-b431-0698f300fcdb tempest-VolumesTestJSON-1408096684 tempest-VolumesTestJSON-1408096684-project] Calling method '.version_select at 0x7f5098ca48b0>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:09:50.786939 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-bb3c39e9-8cd2-4943-b431-0698f300fcdb tempest-VolumesTestJSON-1408096684 tempest-VolumesTestJSON-1408096684-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.162482 Oct 13 13:09:50.787896 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 11/22] 10.222.0.23 () {58 vars in 1170 bytes} [Thu Oct 13 13:09:50 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 693 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 13:09:50.806698 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-7039f688-ef47-4d34-be04-e48306d53ad4 tempest-VolumesTestJSON-1408096684 tempest-VolumesTestJSON-1408096684-project] Calling method '.version_select at 0x7f5098e045e0>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:09:51.118719 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-7039f688-ef47-4d34-be04-e48306d53ad4 tempest-VolumesTestJSON-1408096684 tempest-VolumesTestJSON-1408096684-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1033 microversion: 2.1 time: 0.319836 Oct 13 13:09:51.128339 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 12/23] 10.222.0.23 () {58 vars in 1155 bytes} [Thu Oct 13 13:09:50 2022] GET /compute/v2.1/os-volumes/detail => generated 1033 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:09:51.133575 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-5b728a9f-1a9d-47ca-8e7e-c7514def0232 tempest-VolumesTestJSON-1408096684 tempest-VolumesTestJSON-1408096684-project] Calling method '.version_select at 0x7f5098bf5430>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:09:51.380476 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-5b728a9f-1a9d-47ca-8e7e-c7514def0232 tempest-VolumesTestJSON-1408096684 tempest-VolumesTestJSON-1408096684-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.250628 Oct 13 13:09:51.381045 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 12/24] 10.222.0.23 () {58 vars in 1188 bytes} [Thu Oct 13 13:09:51 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 13:09:51.394405 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-bc4ef30c-74ca-4e32-9a5d-619b706856eb tempest-VolumesTestJSON-1408096684 tempest-VolumesTestJSON-1408096684-project] Calling method '.version_select at 0x7f5098c05280>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:09:51.656284 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-bc4ef30c-74ca-4e32-9a5d-619b706856eb tempest-VolumesTestJSON-1408096684 tempest-VolumesTestJSON-1408096684-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1033 microversion: 2.1 time: 0.265431 Oct 13 13:09:51.658062 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 13/25] 10.222.0.23 () {58 vars in 1155 bytes} [Thu Oct 13 13:09:51 2022] GET /compute/v2.1/os-volumes/detail => generated 1033 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:09:56.242418 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-60cb2797-ccf6-4023-aeba-4b9c2934b4d9 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Action: 'create', calling method: .version_select at 0x7f5098c47dc0>, body: {"keypair": {"name": "tempest-keypair-1254467242", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOwDAVfJl5enewCj17KdpEsBqeg8sLzXPtrSaEw55J5TqhwULEUBopqIx4fAuGXdMxV8QoiHpGueJkZWSJxIGwcvZv31UVM4AY0Lj22+S3ozsSEn/7NTZqeUMcPaQSe24A=="}} {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 13:09:56.330089 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.quota [None req-60cb2797-ccf6-4023-aeba-4b9c2934b4d9 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Getting quotas for project ecd3d5d2a3a54a07ba64f1fea4846c40. Resources: {'key_pairs'} {{(pid=118815) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 13 13:09:56.348124 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.quota [None req-60cb2797-ccf6-4023-aeba-4b9c2934b4d9 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Getting quotas for user 2e783caddcad473dbdd764919286e244 and project ecd3d5d2a3a54a07ba64f1fea4846c40. Resources: {'key_pairs'} {{(pid=118815) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 13 13:09:56.458077 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-60cb2797-ccf6-4023-aeba-4b9c2934b4d9 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.401458 Oct 13 13:09:56.469408 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 13/26] 10.222.0.23 () {60 vars in 1159 bytes} [Thu Oct 13 13:09:56 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 13:10:00.205991 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-63a68a89-9fd6-447b-8e5b-5a68a91b956d tempest-DeleteServersTestJSON-1957240839 tempest-DeleteServersTestJSON-1957240839-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1611729142", "imageRef": "e2cdd20b-2540-48bc-a05c-d6a2e7e9a66e", "flavorRef": "452", "networks": [{"uuid": "d7a9f8d3-62bc-4905-b92d-b9129667450a"}]}} {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 13:10:00.548413 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.network.neutron [None req-63a68a89-9fd6-447b-8e5b-5a68a91b956d tempest-DeleteServersTestJSON-1957240839 tempest-DeleteServersTestJSON-1957240839-project] validate_networks() for [('d7a9f8d3-62bc-4905-b92d-b9129667450a', None, None, None, None, None)] {{(pid=118814) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 13 13:10:03.701945 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-38cd8ce8-6632-4c6c-a56a-5fd2085e7168 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1644493229", "imageRef": "e2cdd20b-2540-48bc-a05c-d6a2e7e9a66e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "9007e121-4e22-42f4-a8ed-c79c5c61badd"}], "security_groups": [{"name": "tempest-securitygroup--970899355"}], "key_name": "tempest-keypair-1254467242", "user_data": "}} {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 13:10:04.190982 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.network.neutron [None req-38cd8ce8-6632-4c6c-a56a-5fd2085e7168 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] validate_networks() for [('9007e121-4e22-42f4-a8ed-c79c5c61badd', None, None, None, None, None)] {{(pid=118815) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 13 13:10:04.202806 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.virt.hardware [None req-63a68a89-9fd6-447b-8e5b-5a68a91b956d tempest-DeleteServersTestJSON-1957240839 tempest-DeleteServersTestJSON-1957240839-project] Flavor limits 0:0:0 {{(pid=118814) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 13 13:10:04.203501 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.virt.hardware [None req-63a68a89-9fd6-447b-8e5b-5a68a91b956d tempest-DeleteServersTestJSON-1957240839 tempest-DeleteServersTestJSON-1957240839-project] Image limits 0:0:0 {{(pid=118814) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 13 13:10:04.204049 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.virt.hardware [None req-63a68a89-9fd6-447b-8e5b-5a68a91b956d tempest-DeleteServersTestJSON-1957240839 tempest-DeleteServersTestJSON-1957240839-project] Flavor pref 0:0:0 {{(pid=118814) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 13 13:10:04.204529 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.virt.hardware [None req-63a68a89-9fd6-447b-8e5b-5a68a91b956d tempest-DeleteServersTestJSON-1957240839 tempest-DeleteServersTestJSON-1957240839-project] Image pref 0:0:0 {{(pid=118814) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 13 13:10:04.205018 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.virt.hardware [None req-63a68a89-9fd6-447b-8e5b-5a68a91b956d tempest-DeleteServersTestJSON-1957240839 tempest-DeleteServersTestJSON-1957240839-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118814) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 13 13:10:04.250994 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-63a68a89-9fd6-447b-8e5b-5a68a91b956d tempest-DeleteServersTestJSON-1957240839 tempest-DeleteServersTestJSON-1957240839-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:10:04.254675 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-63a68a89-9fd6-447b-8e5b-5a68a91b956d tempest-DeleteServersTestJSON-1957240839 tempest-DeleteServersTestJSON-1957240839-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:10:04.257076 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-63a68a89-9fd6-447b-8e5b-5a68a91b956d tempest-DeleteServersTestJSON-1957240839 tempest-DeleteServersTestJSON-1957240839-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:10:04.258122 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-63a68a89-9fd6-447b-8e5b-5a68a91b956d tempest-DeleteServersTestJSON-1957240839 tempest-DeleteServersTestJSON-1957240839-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:10:04.262300 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-63a68a89-9fd6-447b-8e5b-5a68a91b956d tempest-DeleteServersTestJSON-1957240839 tempest-DeleteServersTestJSON-1957240839-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:10:04.263011 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-63a68a89-9fd6-447b-8e5b-5a68a91b956d tempest-DeleteServersTestJSON-1957240839 tempest-DeleteServersTestJSON-1957240839-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:10:04.390356 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.quota [None req-63a68a89-9fd6-447b-8e5b-5a68a91b956d tempest-DeleteServersTestJSON-1957240839 tempest-DeleteServersTestJSON-1957240839-project] Getting quotas for project 6027a602300d4d2bbf33ac329b2960f6. Resources: {'instances', 'cores', 'ram'} {{(pid=118814) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 13 13:10:04.416848 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.quota [None req-63a68a89-9fd6-447b-8e5b-5a68a91b956d tempest-DeleteServersTestJSON-1957240839 tempest-DeleteServersTestJSON-1957240839-project] Getting quotas for user e3a049e77aba470db21e26d1bc8caa80 and project 6027a602300d4d2bbf33ac329b2960f6. Resources: {'instances', 'cores', 'ram'} {{(pid=118814) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 13 13:10:04.454851 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-63a68a89-9fd6-447b-8e5b-5a68a91b956d tempest-DeleteServersTestJSON-1957240839 tempest-DeleteServersTestJSON-1957240839-project] Going to run 1 instances... {{(pid=118814) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 13 13:10:04.459132 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-63a68a89-9fd6-447b-8e5b-5a68a91b956d tempest-DeleteServersTestJSON-1957240839 tempest-DeleteServersTestJSON-1957240839-project] [instance: dcd9bb33-bad5-4d93-ba0f-558c63746e29] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e2cdd20b-2540-48bc-a05c-d6a2e7e9a66e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118814) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 13 13:10:04.678084 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-63a68a89-9fd6-447b-8e5b-5a68a91b956d tempest-DeleteServersTestJSON-1957240839 tempest-DeleteServersTestJSON-1957240839-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.698205 Oct 13 13:10:04.678746 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 14/27] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Oct 13 13:09:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 4701 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 13 13:10:04.692373 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-9a4cc035-1d41-4c1b-b4ef-26328fc3dba5 tempest-DeleteServersTestJSON-1957240839 tempest-DeleteServersTestJSON-1957240839-project] Calling method '>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:10:04.705449 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-9a4cc035-1d41-4c1b-b4ef-26328fc3dba5 tempest-DeleteServersTestJSON-1957240839 tempest-DeleteServersTestJSON-1957240839-project] [instance: dcd9bb33-bad5-4d93-ba0f-558c63746e29] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:10:04.947901 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-9a4cc035-1d41-4c1b-b4ef-26328fc3dba5 tempest-DeleteServersTestJSON-1957240839 tempest-DeleteServersTestJSON-1957240839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3a049e77aba470db21e26d1bc8caa80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6027a602300d4d2bbf33ac329b2960f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:10:04.993882 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-9a4cc035-1d41-4c1b-b4ef-26328fc3dba5 tempest-DeleteServersTestJSON-1957240839 tempest-DeleteServersTestJSON-1957240839-project] 10.222.0.23 "GET /compute/v2.1/servers/dcd9bb33-bad5-4d93-ba0f-558c63746e29" status: 200 len: 1215 microversion: 2.1 time: 0.305693 Oct 13 13:10:04.996503 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 15/28] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:10:04 2022] GET /compute/v2.1/servers/dcd9bb33-bad5-4d93-ba0f-558c63746e29 => generated 1215 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:10:06.383011 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG dbcounter [-] [118815] Writing DB stats nova_cell0:SELECT=4 {{(pid=118815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:10:06.629815 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-2985f453-4884-47c1-896f-063b6f361c1e tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Action: 'create', calling method: .version_select at 0x7f5099529e50>, body: {"keypair": {"name": "tempest-keypair-2036477842", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMHldgKkuzS8hR+Xrs9Zdxw59c+OPK04e0T+lzhnSoboTPg/0WVeEJfkUFk/WVugXACmxVA4JhsgqjVJR3wNj0w6hN7ZbH94gPXwUmVJ/hjBq9qTy1jVR9GGt4QAHSywHw=="}} {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 13:10:06.641764 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.virt.hardware [None req-38cd8ce8-6632-4c6c-a56a-5fd2085e7168 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Flavor limits 0:0:0 {{(pid=118815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 13 13:10:06.642544 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.virt.hardware [None req-38cd8ce8-6632-4c6c-a56a-5fd2085e7168 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Image limits 0:0:0 {{(pid=118815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 13 13:10:06.643208 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.virt.hardware [None req-38cd8ce8-6632-4c6c-a56a-5fd2085e7168 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Flavor pref 0:0:0 {{(pid=118815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 13 13:10:06.643629 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.virt.hardware [None req-38cd8ce8-6632-4c6c-a56a-5fd2085e7168 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Image pref 0:0:0 {{(pid=118815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 13 13:10:06.644363 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.virt.hardware [None req-38cd8ce8-6632-4c6c-a56a-5fd2085e7168 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 13 13:10:06.667918 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-38cd8ce8-6632-4c6c-a56a-5fd2085e7168 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:10:06.668469 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-38cd8ce8-6632-4c6c-a56a-5fd2085e7168 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:10:06.668915 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-38cd8ce8-6632-4c6c-a56a-5fd2085e7168 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:10:06.671080 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-38cd8ce8-6632-4c6c-a56a-5fd2085e7168 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:10:06.671544 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-38cd8ce8-6632-4c6c-a56a-5fd2085e7168 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:10:06.672029 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-38cd8ce8-6632-4c6c-a56a-5fd2085e7168 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:10:06.735339 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.quota [None req-2985f453-4884-47c1-896f-063b6f361c1e tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Getting quotas for project 4af4b9833fd14a1f881610bbc90bbd37. Resources: {'key_pairs'} {{(pid=118814) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 13 13:10:06.755505 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.quota [None req-38cd8ce8-6632-4c6c-a56a-5fd2085e7168 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Getting quotas for project ecd3d5d2a3a54a07ba64f1fea4846c40. Resources: {'instances', 'cores', 'ram'} {{(pid=118815) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 13 13:10:06.758935 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.quota [None req-2985f453-4884-47c1-896f-063b6f361c1e tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Getting quotas for user b5dbaf53464b44fe8d9e16f5013587b4 and project 4af4b9833fd14a1f881610bbc90bbd37. Resources: {'key_pairs'} {{(pid=118814) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 13 13:10:06.766843 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.quota [None req-38cd8ce8-6632-4c6c-a56a-5fd2085e7168 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Getting quotas for user 2e783caddcad473dbdd764919286e244 and project ecd3d5d2a3a54a07ba64f1fea4846c40. Resources: {'instances', 'cores', 'ram'} {{(pid=118815) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 13 13:10:06.803808 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-38cd8ce8-6632-4c6c-a56a-5fd2085e7168 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Going to run 1 instances... {{(pid=118815) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 13 13:10:06.819762 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-38cd8ce8-6632-4c6c-a56a-5fd2085e7168 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] [instance: e125ab44-9111-4260-909d-95d57b7861a7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e2cdd20b-2540-48bc-a05c-d6a2e7e9a66e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118815) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 13 13:10:06.846247 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-2985f453-4884-47c1-896f-063b6f361c1e tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 1.419489 Oct 13 13:10:06.849395 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 16/29] 10.222.0.23 () {62 vars in 1200 bytes} [Thu Oct 13 13:10:05 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 1423 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 13 13:10:07.048701 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-38cd8ce8-6632-4c6c-a56a-5fd2085e7168 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 3.350716 Oct 13 13:10:07.050107 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 14/30] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Oct 13 13:10:03 2022] POST /compute/v2.1/servers => generated 401 bytes in 3354 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 13 13:10:07.077513 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-9947d255-978c-417a-8afa-ba58cd7ff0f3 tempest-DeleteServersTestJSON-1957240839 tempest-DeleteServersTestJSON-1957240839-project] Calling method '>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:10:07.082778 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-9947d255-978c-417a-8afa-ba58cd7ff0f3 tempest-DeleteServersTestJSON-1957240839 tempest-DeleteServersTestJSON-1957240839-project] [instance: dcd9bb33-bad5-4d93-ba0f-558c63746e29] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:10:07.141107 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-9947d255-978c-417a-8afa-ba58cd7ff0f3 tempest-DeleteServersTestJSON-1957240839 tempest-DeleteServersTestJSON-1957240839-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:10:07.141797 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-9947d255-978c-417a-8afa-ba58cd7ff0f3 tempest-DeleteServersTestJSON-1957240839 tempest-DeleteServersTestJSON-1957240839-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:10:07.144017 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-9947d255-978c-417a-8afa-ba58cd7ff0f3 tempest-DeleteServersTestJSON-1957240839 tempest-DeleteServersTestJSON-1957240839-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:10:07.151995 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-9947d255-978c-417a-8afa-ba58cd7ff0f3 tempest-DeleteServersTestJSON-1957240839 tempest-DeleteServersTestJSON-1957240839-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:10:07.160016 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-9947d255-978c-417a-8afa-ba58cd7ff0f3 tempest-DeleteServersTestJSON-1957240839 tempest-DeleteServersTestJSON-1957240839-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:10:07.161227 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-9947d255-978c-417a-8afa-ba58cd7ff0f3 tempest-DeleteServersTestJSON-1957240839 tempest-DeleteServersTestJSON-1957240839-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:10:07.717300 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-9947d255-978c-417a-8afa-ba58cd7ff0f3 tempest-DeleteServersTestJSON-1957240839 tempest-DeleteServersTestJSON-1957240839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3a049e77aba470db21e26d1bc8caa80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6027a602300d4d2bbf33ac329b2960f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:10:07.774252 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-9947d255-978c-417a-8afa-ba58cd7ff0f3 tempest-DeleteServersTestJSON-1957240839 tempest-DeleteServersTestJSON-1957240839-project] 10.222.0.23 "GET /compute/v2.1/servers/dcd9bb33-bad5-4d93-ba0f-558c63746e29" status: 200 len: 1219 microversion: 2.1 time: 0.718382 Oct 13 13:10:07.780188 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 15/31] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:10:07 2022] GET /compute/v2.1/servers/dcd9bb33-bad5-4d93-ba0f-558c63746e29 => generated 1219 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:10:07.808654 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-78b171cb-3ab7-4319-8094-1a470ddaafff tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Calling method '>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:10:07.812606 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-78b171cb-3ab7-4319-8094-1a470ddaafff tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] [instance: e125ab44-9111-4260-909d-95d57b7861a7] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:10:07.969682 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-421740d6-e355-447d-8464-859fa3ff360a tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1247153917", "imageRef": "e2cdd20b-2540-48bc-a05c-d6a2e7e9a66e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 13:10:08.022208 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-78b171cb-3ab7-4319-8094-1a470ddaafff tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e783caddcad473dbdd764919286e244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecd3d5d2a3a54a07ba64f1fea4846c40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:10:08.065624 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-78b171cb-3ab7-4319-8094-1a470ddaafff tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] 10.222.0.23 "GET /compute/v2.1/servers/e125ab44-9111-4260-909d-95d57b7861a7" status: 200 len: 1238 microversion: 2.1 time: 0.262495 Oct 13 13:10:08.069036 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 16/32] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:10:07 2022] GET /compute/v2.1/servers/e125ab44-9111-4260-909d-95d57b7861a7 => generated 1238 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:10:08.139704 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.network.neutron [None req-421740d6-e355-447d-8464-859fa3ff360a tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] validate_networks() for [('6c7eaa8a-d195-41e7-950e-394b3e71b249', None, None, None, None, None)] {{(pid=118814) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 13 13:10:08.803017 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-542f7d2c-d940-4e5d-a78b-1a23913a34e8 tempest-DeleteServersTestJSON-1957240839 tempest-DeleteServersTestJSON-1957240839-project] Calling method '>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:10:08.804413 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-542f7d2c-d940-4e5d-a78b-1a23913a34e8 tempest-DeleteServersTestJSON-1957240839 tempest-DeleteServersTestJSON-1957240839-project] [instance: dcd9bb33-bad5-4d93-ba0f-558c63746e29] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:10:08.816246 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-542f7d2c-d940-4e5d-a78b-1a23913a34e8 tempest-DeleteServersTestJSON-1957240839 tempest-DeleteServersTestJSON-1957240839-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:10:08.817475 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-542f7d2c-d940-4e5d-a78b-1a23913a34e8 tempest-DeleteServersTestJSON-1957240839 tempest-DeleteServersTestJSON-1957240839-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:10:08.818844 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-542f7d2c-d940-4e5d-a78b-1a23913a34e8 tempest-DeleteServersTestJSON-1957240839 tempest-DeleteServersTestJSON-1957240839-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:10:08.820784 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-542f7d2c-d940-4e5d-a78b-1a23913a34e8 tempest-DeleteServersTestJSON-1957240839 tempest-DeleteServersTestJSON-1957240839-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:10:08.824633 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-542f7d2c-d940-4e5d-a78b-1a23913a34e8 tempest-DeleteServersTestJSON-1957240839 tempest-DeleteServersTestJSON-1957240839-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:10:08.825297 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-542f7d2c-d940-4e5d-a78b-1a23913a34e8 tempest-DeleteServersTestJSON-1957240839 tempest-DeleteServersTestJSON-1957240839-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:10:08.999047 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-542f7d2c-d940-4e5d-a78b-1a23913a34e8 tempest-DeleteServersTestJSON-1957240839 tempest-DeleteServersTestJSON-1957240839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3a049e77aba470db21e26d1bc8caa80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6027a602300d4d2bbf33ac329b2960f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:10:09.011707 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-542f7d2c-d940-4e5d-a78b-1a23913a34e8 tempest-DeleteServersTestJSON-1957240839 tempest-DeleteServersTestJSON-1957240839-project] 10.222.0.23 "GET /compute/v2.1/servers/dcd9bb33-bad5-4d93-ba0f-558c63746e29" status: 200 len: 1275 microversion: 2.1 time: 0.213257 Oct 13 13:10:09.015446 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 17/33] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:10:08 2022] GET /compute/v2.1/servers/dcd9bb33-bad5-4d93-ba0f-558c63746e29 => generated 1275 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:10:09.096137 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-63c3768e-501b-4b9a-a82c-e527fd261435 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Calling method '>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:10:09.096746 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-63c3768e-501b-4b9a-a82c-e527fd261435 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] [instance: e125ab44-9111-4260-909d-95d57b7861a7] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:10:09.169237 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-63c3768e-501b-4b9a-a82c-e527fd261435 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e783caddcad473dbdd764919286e244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecd3d5d2a3a54a07ba64f1fea4846c40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:10:09.187980 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-63c3768e-501b-4b9a-a82c-e527fd261435 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] 10.222.0.23 "GET /compute/v2.1/servers/e125ab44-9111-4260-909d-95d57b7861a7" status: 200 len: 1238 microversion: 2.1 time: 0.095894 Oct 13 13:10:09.189456 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 18/34] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:10:09 2022] GET /compute/v2.1/servers/e125ab44-9111-4260-909d-95d57b7861a7 => generated 1238 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 13:10:09.376045 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.virt.hardware [None req-421740d6-e355-447d-8464-859fa3ff360a tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Flavor limits 0:0:0 {{(pid=118814) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 13 13:10:09.376541 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.virt.hardware [None req-421740d6-e355-447d-8464-859fa3ff360a tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Image limits 0:0:0 {{(pid=118814) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 13 13:10:09.377030 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.virt.hardware [None req-421740d6-e355-447d-8464-859fa3ff360a tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Flavor pref 0:0:0 {{(pid=118814) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 13 13:10:09.377513 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.virt.hardware [None req-421740d6-e355-447d-8464-859fa3ff360a tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Image pref 0:0:0 {{(pid=118814) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 13 13:10:09.377940 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.virt.hardware [None req-421740d6-e355-447d-8464-859fa3ff360a tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118814) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 13 13:10:09.392905 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-421740d6-e355-447d-8464-859fa3ff360a tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:10:09.393773 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-421740d6-e355-447d-8464-859fa3ff360a tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:10:09.394221 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-421740d6-e355-447d-8464-859fa3ff360a tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:10:09.396172 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-421740d6-e355-447d-8464-859fa3ff360a tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:10:09.397104 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-421740d6-e355-447d-8464-859fa3ff360a tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:10:09.397717 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-421740d6-e355-447d-8464-859fa3ff360a tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:10:09.450178 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.quota [None req-421740d6-e355-447d-8464-859fa3ff360a tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Getting quotas for project 5e7312d0ac9248f2bfbece5611913ab2. Resources: {'instances', 'cores', 'ram'} {{(pid=118814) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 13 13:10:09.455317 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.quota [None req-421740d6-e355-447d-8464-859fa3ff360a tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Getting quotas for user 454203f47b434cca952a1cef56de559f and project 5e7312d0ac9248f2bfbece5611913ab2. Resources: {'instances', 'cores', 'ram'} {{(pid=118814) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 13 13:10:09.469435 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-421740d6-e355-447d-8464-859fa3ff360a tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Going to run 1 instances... {{(pid=118814) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 13 13:10:09.472076 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-421740d6-e355-447d-8464-859fa3ff360a tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] [instance: 0548a3eb-e119-482c-ac70-04fbc6f83bf7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e2cdd20b-2540-48bc-a05c-d6a2e7e9a66e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118814) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 13 13:10:09.555451 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-421740d6-e355-447d-8464-859fa3ff360a tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.704675 Oct 13 13:10:09.556949 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 17/35] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Oct 13 13:10:06 2022] POST /compute/v2.1/servers => generated 383 bytes in 2707 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 13 13:10:09.569632 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-acf82cba-c117-4e27-87d9-2685617963c8 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Calling method '>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:10:09.570255 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-acf82cba-c117-4e27-87d9-2685617963c8 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] [instance: 0548a3eb-e119-482c-ac70-04fbc6f83bf7] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:10:09.692066 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-acf82cba-c117-4e27-87d9-2685617963c8 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '454203f47b434cca952a1cef56de559f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7312d0ac9248f2bfbece5611913ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:10:09.701066 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-acf82cba-c117-4e27-87d9-2685617963c8 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] 10.222.0.23 "GET /compute/v2.1/servers/0548a3eb-e119-482c-ac70-04fbc6f83bf7" status: 200 len: 1222 microversion: 2.1 time: 0.136231 Oct 13 13:10:09.724157 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 19/36] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:10:09 2022] GET /compute/v2.1/servers/0548a3eb-e119-482c-ac70-04fbc6f83bf7 => generated 1222 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:10:10.045119 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-b773fb0e-80df-450b-be18-7c4fec01baf8 tempest-DeleteServersTestJSON-1957240839 tempest-DeleteServersTestJSON-1957240839-project] Calling method '>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:10:10.046583 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-b773fb0e-80df-450b-be18-7c4fec01baf8 tempest-DeleteServersTestJSON-1957240839 tempest-DeleteServersTestJSON-1957240839-project] [instance: dcd9bb33-bad5-4d93-ba0f-558c63746e29] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:10:10.069419 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-b773fb0e-80df-450b-be18-7c4fec01baf8 tempest-DeleteServersTestJSON-1957240839 tempest-DeleteServersTestJSON-1957240839-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:10:10.070872 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-b773fb0e-80df-450b-be18-7c4fec01baf8 tempest-DeleteServersTestJSON-1957240839 tempest-DeleteServersTestJSON-1957240839-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:10:10.071825 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-b773fb0e-80df-450b-be18-7c4fec01baf8 tempest-DeleteServersTestJSON-1957240839 tempest-DeleteServersTestJSON-1957240839-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:10:10.076948 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-b773fb0e-80df-450b-be18-7c4fec01baf8 tempest-DeleteServersTestJSON-1957240839 tempest-DeleteServersTestJSON-1957240839-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:10:10.079681 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-b773fb0e-80df-450b-be18-7c4fec01baf8 tempest-DeleteServersTestJSON-1957240839 tempest-DeleteServersTestJSON-1957240839-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:10:10.080397 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-b773fb0e-80df-450b-be18-7c4fec01baf8 tempest-DeleteServersTestJSON-1957240839 tempest-DeleteServersTestJSON-1957240839-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:10:10.189125 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-d5058d21-6ac6-43bb-96ad-9c3688e07618 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1362317646", "imageRef": "e2cdd20b-2540-48bc-a05c-d6a2e7e9a66e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 13:10:10.312877 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.network.neutron [None req-d5058d21-6ac6-43bb-96ad-9c3688e07618 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] validate_networks() for [('6c7eaa8a-d195-41e7-950e-394b3e71b249', None, None, None, None, None)] {{(pid=118815) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 13 13:10:10.509591 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-b773fb0e-80df-450b-be18-7c4fec01baf8 tempest-DeleteServersTestJSON-1957240839 tempest-DeleteServersTestJSON-1957240839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3a049e77aba470db21e26d1bc8caa80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6027a602300d4d2bbf33ac329b2960f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:10:10.550251 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-b773fb0e-80df-450b-be18-7c4fec01baf8 tempest-DeleteServersTestJSON-1957240839 tempest-DeleteServersTestJSON-1957240839-project] 10.222.0.23 "GET /compute/v2.1/servers/dcd9bb33-bad5-4d93-ba0f-558c63746e29" status: 200 len: 1273 microversion: 2.1 time: 0.512844 Oct 13 13:10:10.553600 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 18/37] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:10:10 2022] GET /compute/v2.1/servers/dcd9bb33-bad5-4d93-ba0f-558c63746e29 => generated 1273 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:10:10.562711 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-86c200d6-5f90-4155-bf93-c0022f9299cc tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Calling method '>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:10:10.563802 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-86c200d6-5f90-4155-bf93-c0022f9299cc tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] [instance: e125ab44-9111-4260-909d-95d57b7861a7] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:10:10.585696 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-86c200d6-5f90-4155-bf93-c0022f9299cc tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:10:10.590026 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-86c200d6-5f90-4155-bf93-c0022f9299cc tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:10:10.590949 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-86c200d6-5f90-4155-bf93-c0022f9299cc tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:10:10.592950 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-86c200d6-5f90-4155-bf93-c0022f9299cc tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:10:10.593659 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-86c200d6-5f90-4155-bf93-c0022f9299cc tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:10:10.595488 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-86c200d6-5f90-4155-bf93-c0022f9299cc tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:10:10.752566 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-86c200d6-5f90-4155-bf93-c0022f9299cc tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e783caddcad473dbdd764919286e244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecd3d5d2a3a54a07ba64f1fea4846c40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:10:10.764261 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-86c200d6-5f90-4155-bf93-c0022f9299cc tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] 10.222.0.23 "GET /compute/v2.1/servers/e125ab44-9111-4260-909d-95d57b7861a7" status: 200 len: 1298 microversion: 2.1 time: 0.208324 Oct 13 13:10:10.767846 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 19/38] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:10:10 2022] GET /compute/v2.1/servers/e125ab44-9111-4260-909d-95d57b7861a7 => generated 1298 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:10:11.583133 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-2329840e-80ad-469e-bf89-f3825a878ee3 tempest-DeleteServersTestJSON-1957240839 tempest-DeleteServersTestJSON-1957240839-project] Calling method '>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:10:11.584734 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-2329840e-80ad-469e-bf89-f3825a878ee3 tempest-DeleteServersTestJSON-1957240839 tempest-DeleteServersTestJSON-1957240839-project] [instance: dcd9bb33-bad5-4d93-ba0f-558c63746e29] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:10:11.600961 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-2329840e-80ad-469e-bf89-f3825a878ee3 tempest-DeleteServersTestJSON-1957240839 tempest-DeleteServersTestJSON-1957240839-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:10:11.601713 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-2329840e-80ad-469e-bf89-f3825a878ee3 tempest-DeleteServersTestJSON-1957240839 tempest-DeleteServersTestJSON-1957240839-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:10:11.602818 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-2329840e-80ad-469e-bf89-f3825a878ee3 tempest-DeleteServersTestJSON-1957240839 tempest-DeleteServersTestJSON-1957240839-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:10:11.605158 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-2329840e-80ad-469e-bf89-f3825a878ee3 tempest-DeleteServersTestJSON-1957240839 tempest-DeleteServersTestJSON-1957240839-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:10:11.605894 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-2329840e-80ad-469e-bf89-f3825a878ee3 tempest-DeleteServersTestJSON-1957240839 tempest-DeleteServersTestJSON-1957240839-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:10:11.608488 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-2329840e-80ad-469e-bf89-f3825a878ee3 tempest-DeleteServersTestJSON-1957240839 tempest-DeleteServersTestJSON-1957240839-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:10:11.800937 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-2329840e-80ad-469e-bf89-f3825a878ee3 tempest-DeleteServersTestJSON-1957240839 tempest-DeleteServersTestJSON-1957240839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3a049e77aba470db21e26d1bc8caa80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6027a602300d4d2bbf33ac329b2960f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:10:11.829296 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-2329840e-80ad-469e-bf89-f3825a878ee3 tempest-DeleteServersTestJSON-1957240839 tempest-DeleteServersTestJSON-1957240839-project] 10.222.0.23 "GET /compute/v2.1/servers/dcd9bb33-bad5-4d93-ba0f-558c63746e29" status: 200 len: 1273 microversion: 2.1 time: 0.249203 Oct 13 13:10:11.831417 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 20/39] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:10:11 2022] GET /compute/v2.1/servers/dcd9bb33-bad5-4d93-ba0f-558c63746e29 => generated 1273 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 13:10:11.853917 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.virt.hardware [None req-d5058d21-6ac6-43bb-96ad-9c3688e07618 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Flavor limits 0:0:0 {{(pid=118815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 13 13:10:11.854491 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.virt.hardware [None req-d5058d21-6ac6-43bb-96ad-9c3688e07618 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Image limits 0:0:0 {{(pid=118815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 13 13:10:11.854814 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.virt.hardware [None req-d5058d21-6ac6-43bb-96ad-9c3688e07618 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Flavor pref 0:0:0 {{(pid=118815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 13 13:10:11.856225 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.virt.hardware [None req-d5058d21-6ac6-43bb-96ad-9c3688e07618 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Image pref 0:0:0 {{(pid=118815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 13 13:10:11.856990 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.virt.hardware [None req-d5058d21-6ac6-43bb-96ad-9c3688e07618 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 13 13:10:11.863000 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-f90dd338-0368-40a1-b816-78ec4348a9d4 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Calling method '>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:10:11.865263 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-f90dd338-0368-40a1-b816-78ec4348a9d4 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] [instance: e125ab44-9111-4260-909d-95d57b7861a7] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:10:11.873933 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-f90dd338-0368-40a1-b816-78ec4348a9d4 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:10:11.874799 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-f90dd338-0368-40a1-b816-78ec4348a9d4 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:10:11.875568 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-f90dd338-0368-40a1-b816-78ec4348a9d4 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:10:11.876530 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-f90dd338-0368-40a1-b816-78ec4348a9d4 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:10:11.877761 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-f90dd338-0368-40a1-b816-78ec4348a9d4 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:10:11.879335 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-f90dd338-0368-40a1-b816-78ec4348a9d4 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:10:11.882694 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-d5058d21-6ac6-43bb-96ad-9c3688e07618 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:10:11.887565 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-d5058d21-6ac6-43bb-96ad-9c3688e07618 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:10:11.888294 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-d5058d21-6ac6-43bb-96ad-9c3688e07618 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:10:11.890689 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-d5058d21-6ac6-43bb-96ad-9c3688e07618 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:10:11.892539 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-d5058d21-6ac6-43bb-96ad-9c3688e07618 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:10:11.895688 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-d5058d21-6ac6-43bb-96ad-9c3688e07618 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:10:11.957941 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.quota [None req-d5058d21-6ac6-43bb-96ad-9c3688e07618 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Getting quotas for project 5e7312d0ac9248f2bfbece5611913ab2. Resources: {'instances', 'cores', 'ram'} {{(pid=118815) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 13 13:10:11.963821 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.quota [None req-d5058d21-6ac6-43bb-96ad-9c3688e07618 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Getting quotas for user 454203f47b434cca952a1cef56de559f and project 5e7312d0ac9248f2bfbece5611913ab2. Resources: {'instances', 'cores', 'ram'} {{(pid=118815) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 13 13:10:11.978806 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-d5058d21-6ac6-43bb-96ad-9c3688e07618 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Going to run 1 instances... {{(pid=118815) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 13 13:10:11.981604 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-d5058d21-6ac6-43bb-96ad-9c3688e07618 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] [instance: 96c829cb-4dde-467c-b50f-b2f666bdab0b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e2cdd20b-2540-48bc-a05c-d6a2e7e9a66e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118815) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 13 13:10:12.013106 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-f90dd338-0368-40a1-b816-78ec4348a9d4 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e783caddcad473dbdd764919286e244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecd3d5d2a3a54a07ba64f1fea4846c40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:10:12.032296 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-f90dd338-0368-40a1-b816-78ec4348a9d4 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] 10.222.0.23 "GET /compute/v2.1/servers/e125ab44-9111-4260-909d-95d57b7861a7" status: 200 len: 1298 microversion: 2.1 time: 0.187976 Oct 13 13:10:12.043200 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 21/40] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:10:11 2022] GET /compute/v2.1/servers/e125ab44-9111-4260-909d-95d57b7861a7 => generated 1298 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:10:12.059262 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-d5058d21-6ac6-43bb-96ad-9c3688e07618 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.877582 Oct 13 13:10:12.060628 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 20/41] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Oct 13 13:10:10 2022] POST /compute/v2.1/servers => generated 383 bytes in 1881 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 13 13:10:12.073358 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-01c53d7d-8cf8-4ac3-9c10-6d53551527b0 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Calling method '>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:10:12.074379 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-01c53d7d-8cf8-4ac3-9c10-6d53551527b0 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] [instance: 96c829cb-4dde-467c-b50f-b2f666bdab0b] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:10:12.174146 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-01c53d7d-8cf8-4ac3-9c10-6d53551527b0 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '454203f47b434cca952a1cef56de559f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7312d0ac9248f2bfbece5611913ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:10:12.194087 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-01c53d7d-8cf8-4ac3-9c10-6d53551527b0 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] 10.222.0.23 "GET /compute/v2.1/servers/96c829cb-4dde-467c-b50f-b2f666bdab0b" status: 200 len: 1222 microversion: 2.1 time: 0.126248 Oct 13 13:10:12.194692 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 22/42] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:10:12 2022] GET /compute/v2.1/servers/96c829cb-4dde-467c-b50f-b2f666bdab0b => generated 1222 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:10:12.858559 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-a2cd169f-97cc-4aee-8d30-188a30474ba8 tempest-DeleteServersTestJSON-1957240839 tempest-DeleteServersTestJSON-1957240839-project] Calling method '>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:10:12.859812 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-a2cd169f-97cc-4aee-8d30-188a30474ba8 tempest-DeleteServersTestJSON-1957240839 tempest-DeleteServersTestJSON-1957240839-project] [instance: dcd9bb33-bad5-4d93-ba0f-558c63746e29] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:10:12.882217 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-a2cd169f-97cc-4aee-8d30-188a30474ba8 tempest-DeleteServersTestJSON-1957240839 tempest-DeleteServersTestJSON-1957240839-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:10:12.885075 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-a2cd169f-97cc-4aee-8d30-188a30474ba8 tempest-DeleteServersTestJSON-1957240839 tempest-DeleteServersTestJSON-1957240839-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:10:12.885640 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-a2cd169f-97cc-4aee-8d30-188a30474ba8 tempest-DeleteServersTestJSON-1957240839 tempest-DeleteServersTestJSON-1957240839-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:10:12.886369 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-a2cd169f-97cc-4aee-8d30-188a30474ba8 tempest-DeleteServersTestJSON-1957240839 tempest-DeleteServersTestJSON-1957240839-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:10:12.886838 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-a2cd169f-97cc-4aee-8d30-188a30474ba8 tempest-DeleteServersTestJSON-1957240839 tempest-DeleteServersTestJSON-1957240839-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:10:12.892620 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-a2cd169f-97cc-4aee-8d30-188a30474ba8 tempest-DeleteServersTestJSON-1957240839 tempest-DeleteServersTestJSON-1957240839-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:10:13.067306 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-436401ea-6091-4482-b977-d4ded4f03bc6 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Calling method '>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:10:13.069074 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-436401ea-6091-4482-b977-d4ded4f03bc6 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] [instance: e125ab44-9111-4260-909d-95d57b7861a7] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:10:13.100148 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-436401ea-6091-4482-b977-d4ded4f03bc6 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:10:13.104122 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-436401ea-6091-4482-b977-d4ded4f03bc6 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:10:13.104936 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-436401ea-6091-4482-b977-d4ded4f03bc6 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:10:13.108174 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-436401ea-6091-4482-b977-d4ded4f03bc6 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:10:13.112763 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-436401ea-6091-4482-b977-d4ded4f03bc6 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:10:13.114096 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-436401ea-6091-4482-b977-d4ded4f03bc6 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:10:13.457475 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-436401ea-6091-4482-b977-d4ded4f03bc6 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e783caddcad473dbdd764919286e244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecd3d5d2a3a54a07ba64f1fea4846c40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:10:13.477795 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-436401ea-6091-4482-b977-d4ded4f03bc6 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] 10.222.0.23 "GET /compute/v2.1/servers/e125ab44-9111-4260-909d-95d57b7861a7" status: 200 len: 1296 microversion: 2.1 time: 0.417715 Oct 13 13:10:13.478406 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 23/43] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:10:13 2022] GET /compute/v2.1/servers/e125ab44-9111-4260-909d-95d57b7861a7 => generated 1296 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:10:13.495584 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-c2da3827-0700-4f2a-8b0d-9a2a5509d03c tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Calling method '>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:10:13.498600 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-c2da3827-0700-4f2a-8b0d-9a2a5509d03c tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] [instance: 96c829cb-4dde-467c-b50f-b2f666bdab0b] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:10:13.540484 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-c2da3827-0700-4f2a-8b0d-9a2a5509d03c tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:10:13.542380 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-c2da3827-0700-4f2a-8b0d-9a2a5509d03c tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:10:13.548923 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-c2da3827-0700-4f2a-8b0d-9a2a5509d03c tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:10:13.551435 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-c2da3827-0700-4f2a-8b0d-9a2a5509d03c tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:10:13.555391 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-c2da3827-0700-4f2a-8b0d-9a2a5509d03c tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:10:13.559022 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-c2da3827-0700-4f2a-8b0d-9a2a5509d03c tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:10:13.573007 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-a2cd169f-97cc-4aee-8d30-188a30474ba8 tempest-DeleteServersTestJSON-1957240839 tempest-DeleteServersTestJSON-1957240839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3a049e77aba470db21e26d1bc8caa80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6027a602300d4d2bbf33ac329b2960f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:10:13.584935 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-a2cd169f-97cc-4aee-8d30-188a30474ba8 tempest-DeleteServersTestJSON-1957240839 tempest-DeleteServersTestJSON-1957240839-project] 10.222.0.23 "GET /compute/v2.1/servers/dcd9bb33-bad5-4d93-ba0f-558c63746e29" status: 200 len: 1315 microversion: 2.1 time: 0.730464 Oct 13 13:10:13.603480 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 21/44] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:10:12 2022] GET /compute/v2.1/servers/dcd9bb33-bad5-4d93-ba0f-558c63746e29 => generated 1315 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:10:13.943626 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-c2da3827-0700-4f2a-8b0d-9a2a5509d03c tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '454203f47b434cca952a1cef56de559f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7312d0ac9248f2bfbece5611913ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:10:13.995352 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-c2da3827-0700-4f2a-8b0d-9a2a5509d03c tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] 10.222.0.23 "GET /compute/v2.1/servers/96c829cb-4dde-467c-b50f-b2f666bdab0b" status: 200 len: 1226 microversion: 2.1 time: 0.502797 Oct 13 13:10:13.996058 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 24/45] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:10:13 2022] GET /compute/v2.1/servers/96c829cb-4dde-467c-b50f-b2f666bdab0b => generated 1226 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:10:14.292877 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-f6b0f773-dad5-4683-aea7-92586ed5af7b tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1930265657", "imageRef": "e2cdd20b-2540-48bc-a05c-d6a2e7e9a66e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "be617289-4b6b-4fbf-91a3-2f05a4825667"}], "security_groups": [{"name": "tempest-securitygroup--911227448"}], "key_name": "tempest-keypair-2036477842", "user_data": "}} {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 13:10:14.504346 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-7ffb5fb2-425a-47c5-b3d6-640a6b6a4f25 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Calling method '>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:10:14.504972 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-7ffb5fb2-425a-47c5-b3d6-640a6b6a4f25 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] [instance: e125ab44-9111-4260-909d-95d57b7861a7] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:10:14.532736 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-7ffb5fb2-425a-47c5-b3d6-640a6b6a4f25 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:10:14.534136 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-7ffb5fb2-425a-47c5-b3d6-640a6b6a4f25 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:10:14.537047 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-7ffb5fb2-425a-47c5-b3d6-640a6b6a4f25 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:10:14.541806 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-7ffb5fb2-425a-47c5-b3d6-640a6b6a4f25 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:10:14.543688 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-7ffb5fb2-425a-47c5-b3d6-640a6b6a4f25 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:10:14.545132 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-7ffb5fb2-425a-47c5-b3d6-640a6b6a4f25 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:10:14.912825 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.network.neutron [None req-f6b0f773-dad5-4683-aea7-92586ed5af7b tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] validate_networks() for [('be617289-4b6b-4fbf-91a3-2f05a4825667', None, None, None, None, None)] {{(pid=118815) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 13 13:10:15.385980 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-7ffb5fb2-425a-47c5-b3d6-640a6b6a4f25 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e783caddcad473dbdd764919286e244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecd3d5d2a3a54a07ba64f1fea4846c40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:10:15.408519 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-7ffb5fb2-425a-47c5-b3d6-640a6b6a4f25 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] 10.222.0.23 "GET /compute/v2.1/servers/e125ab44-9111-4260-909d-95d57b7861a7" status: 200 len: 1296 microversion: 2.1 time: 0.908939 Oct 13 13:10:15.411090 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 25/46] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:10:14 2022] GET /compute/v2.1/servers/e125ab44-9111-4260-909d-95d57b7861a7 => generated 1296 bytes in 914 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 13:10:15.429869 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-561d0e9e-7da4-4c95-ab13-c6b82a52cd88 tempest-DeleteServersTestJSON-1957240839 tempest-DeleteServersTestJSON-1957240839-project] Calling method '>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:10:15.444015 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-561d0e9e-7da4-4c95-ab13-c6b82a52cd88 tempest-DeleteServersTestJSON-1957240839 tempest-DeleteServersTestJSON-1957240839-project] [instance: dcd9bb33-bad5-4d93-ba0f-558c63746e29] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:10:15.467343 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-561d0e9e-7da4-4c95-ab13-c6b82a52cd88 tempest-DeleteServersTestJSON-1957240839 tempest-DeleteServersTestJSON-1957240839-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:10:15.470759 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-561d0e9e-7da4-4c95-ab13-c6b82a52cd88 tempest-DeleteServersTestJSON-1957240839 tempest-DeleteServersTestJSON-1957240839-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:10:15.471249 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-561d0e9e-7da4-4c95-ab13-c6b82a52cd88 tempest-DeleteServersTestJSON-1957240839 tempest-DeleteServersTestJSON-1957240839-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:10:15.480711 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-561d0e9e-7da4-4c95-ab13-c6b82a52cd88 tempest-DeleteServersTestJSON-1957240839 tempest-DeleteServersTestJSON-1957240839-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:10:15.483945 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-561d0e9e-7da4-4c95-ab13-c6b82a52cd88 tempest-DeleteServersTestJSON-1957240839 tempest-DeleteServersTestJSON-1957240839-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:10:15.484543 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-561d0e9e-7da4-4c95-ab13-c6b82a52cd88 tempest-DeleteServersTestJSON-1957240839 tempest-DeleteServersTestJSON-1957240839-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:10:16.773887 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-561d0e9e-7da4-4c95-ab13-c6b82a52cd88 tempest-DeleteServersTestJSON-1957240839 tempest-DeleteServersTestJSON-1957240839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3a049e77aba470db21e26d1bc8caa80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6027a602300d4d2bbf33ac329b2960f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:10:16.784364 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-561d0e9e-7da4-4c95-ab13-c6b82a52cd88 tempest-DeleteServersTestJSON-1957240839 tempest-DeleteServersTestJSON-1957240839-project] 10.222.0.23 "GET /compute/v2.1/servers/dcd9bb33-bad5-4d93-ba0f-558c63746e29" status: 200 len: 1315 microversion: 2.1 time: 1.371011 Oct 13 13:10:16.784951 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 26/47] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:10:15 2022] GET /compute/v2.1/servers/dcd9bb33-bad5-4d93-ba0f-558c63746e29 => generated 1315 bytes in 1373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:10:16.843548 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-d807f7ad-df81-45c9-84ff-0a795d3cdd39 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Calling method '>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:10:16.844496 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-d807f7ad-df81-45c9-84ff-0a795d3cdd39 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] [instance: 96c829cb-4dde-467c-b50f-b2f666bdab0b] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:10:16.873898 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-d807f7ad-df81-45c9-84ff-0a795d3cdd39 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:10:16.874780 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-d807f7ad-df81-45c9-84ff-0a795d3cdd39 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:10:16.888567 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-d807f7ad-df81-45c9-84ff-0a795d3cdd39 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:10:16.889793 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-d807f7ad-df81-45c9-84ff-0a795d3cdd39 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:10:16.898442 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-d807f7ad-df81-45c9-84ff-0a795d3cdd39 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:10:16.899137 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-d807f7ad-df81-45c9-84ff-0a795d3cdd39 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:10:17.296729 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-d807f7ad-df81-45c9-84ff-0a795d3cdd39 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '454203f47b434cca952a1cef56de559f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7312d0ac9248f2bfbece5611913ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:10:17.317552 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-d807f7ad-df81-45c9-84ff-0a795d3cdd39 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] 10.222.0.23 "GET /compute/v2.1/servers/96c829cb-4dde-467c-b50f-b2f666bdab0b" status: 200 len: 1280 microversion: 2.1 time: 0.512160 Oct 13 13:10:17.318385 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 27/48] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:10:16 2022] GET /compute/v2.1/servers/96c829cb-4dde-467c-b50f-b2f666bdab0b => generated 1280 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:10:17.341966 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-0070f567-3bf7-47a9-b87c-02a14742c041 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Calling method '>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:10:17.343190 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-0070f567-3bf7-47a9-b87c-02a14742c041 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] [instance: e125ab44-9111-4260-909d-95d57b7861a7] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:10:17.368075 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-0070f567-3bf7-47a9-b87c-02a14742c041 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:10:17.368334 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-0070f567-3bf7-47a9-b87c-02a14742c041 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:10:17.372168 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-0070f567-3bf7-47a9-b87c-02a14742c041 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:10:17.372953 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-0070f567-3bf7-47a9-b87c-02a14742c041 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:10:17.375984 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-0070f567-3bf7-47a9-b87c-02a14742c041 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:10:17.380626 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-0070f567-3bf7-47a9-b87c-02a14742c041 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:10:18.308877 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-0070f567-3bf7-47a9-b87c-02a14742c041 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e783caddcad473dbdd764919286e244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecd3d5d2a3a54a07ba64f1fea4846c40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:10:18.324518 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-0070f567-3bf7-47a9-b87c-02a14742c041 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] 10.222.0.23 "GET /compute/v2.1/servers/e125ab44-9111-4260-909d-95d57b7861a7" status: 200 len: 1296 microversion: 2.1 time: 0.992950 Oct 13 13:10:18.327658 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 28/49] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:10:17 2022] GET /compute/v2.1/servers/e125ab44-9111-4260-909d-95d57b7861a7 => generated 1296 bytes in 1003 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:10:18.347729 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-aca8f9da-2b07-4979-824f-fa92e1490733 tempest-DeleteServersTestJSON-1957240839 tempest-DeleteServersTestJSON-1957240839-project] Calling method '>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:10:18.348471 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-aca8f9da-2b07-4979-824f-fa92e1490733 tempest-DeleteServersTestJSON-1957240839 tempest-DeleteServersTestJSON-1957240839-project] [instance: dcd9bb33-bad5-4d93-ba0f-558c63746e29] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:10:18.373371 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-aca8f9da-2b07-4979-824f-fa92e1490733 tempest-DeleteServersTestJSON-1957240839 tempest-DeleteServersTestJSON-1957240839-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:10:18.374670 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-aca8f9da-2b07-4979-824f-fa92e1490733 tempest-DeleteServersTestJSON-1957240839 tempest-DeleteServersTestJSON-1957240839-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:10:18.377960 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-aca8f9da-2b07-4979-824f-fa92e1490733 tempest-DeleteServersTestJSON-1957240839 tempest-DeleteServersTestJSON-1957240839-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:10:18.379662 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-aca8f9da-2b07-4979-824f-fa92e1490733 tempest-DeleteServersTestJSON-1957240839 tempest-DeleteServersTestJSON-1957240839-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:10:18.381780 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-aca8f9da-2b07-4979-824f-fa92e1490733 tempest-DeleteServersTestJSON-1957240839 tempest-DeleteServersTestJSON-1957240839-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:10:18.383417 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-aca8f9da-2b07-4979-824f-fa92e1490733 tempest-DeleteServersTestJSON-1957240839 tempest-DeleteServersTestJSON-1957240839-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:10:19.292790 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-aca8f9da-2b07-4979-824f-fa92e1490733 tempest-DeleteServersTestJSON-1957240839 tempest-DeleteServersTestJSON-1957240839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3a049e77aba470db21e26d1bc8caa80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6027a602300d4d2bbf33ac329b2960f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:10:19.300660 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-aca8f9da-2b07-4979-824f-fa92e1490733 tempest-DeleteServersTestJSON-1957240839 tempest-DeleteServersTestJSON-1957240839-project] 10.222.0.23 "GET /compute/v2.1/servers/dcd9bb33-bad5-4d93-ba0f-558c63746e29" status: 200 len: 1315 microversion: 2.1 time: 0.971737 Oct 13 13:10:19.301294 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 29/50] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:10:18 2022] GET /compute/v2.1/servers/dcd9bb33-bad5-4d93-ba0f-558c63746e29 => generated 1315 bytes in 973 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:10:19.353478 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-c366ebd0-c75c-4f9f-9702-8d4645279ca2 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Calling method '>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:10:19.360780 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.virt.hardware [None req-f6b0f773-dad5-4683-aea7-92586ed5af7b tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Flavor limits 0:0:0 {{(pid=118815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 13 13:10:19.361298 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.virt.hardware [None req-f6b0f773-dad5-4683-aea7-92586ed5af7b tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Image limits 0:0:0 {{(pid=118815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 13 13:10:19.361551 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-c366ebd0-c75c-4f9f-9702-8d4645279ca2 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] [instance: 96c829cb-4dde-467c-b50f-b2f666bdab0b] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:10:19.362314 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.virt.hardware [None req-f6b0f773-dad5-4683-aea7-92586ed5af7b tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Flavor pref 0:0:0 {{(pid=118815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 13 13:10:19.362740 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.virt.hardware [None req-f6b0f773-dad5-4683-aea7-92586ed5af7b tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Image pref 0:0:0 {{(pid=118815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 13 13:10:19.363669 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.virt.hardware [None req-f6b0f773-dad5-4683-aea7-92586ed5af7b tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 13 13:10:19.376600 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-c366ebd0-c75c-4f9f-9702-8d4645279ca2 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:10:19.376600 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-c366ebd0-c75c-4f9f-9702-8d4645279ca2 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:10:19.376983 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-c366ebd0-c75c-4f9f-9702-8d4645279ca2 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:10:19.380621 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-c366ebd0-c75c-4f9f-9702-8d4645279ca2 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:10:19.381106 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-c366ebd0-c75c-4f9f-9702-8d4645279ca2 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:10:19.381557 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-c366ebd0-c75c-4f9f-9702-8d4645279ca2 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:10:19.393153 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-f6b0f773-dad5-4683-aea7-92586ed5af7b tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:10:19.393867 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-f6b0f773-dad5-4683-aea7-92586ed5af7b tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:10:19.394749 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-f6b0f773-dad5-4683-aea7-92586ed5af7b tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:10:19.398992 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-f6b0f773-dad5-4683-aea7-92586ed5af7b tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:10:19.400987 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-f6b0f773-dad5-4683-aea7-92586ed5af7b tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:10:19.401703 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-f6b0f773-dad5-4683-aea7-92586ed5af7b tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:10:19.429880 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG dbcounter [-] [118814] Writing DB stats nova_cell0:SELECT=4 {{(pid=118814) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:10:19.473416 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.quota [None req-f6b0f773-dad5-4683-aea7-92586ed5af7b tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Getting quotas for project 4af4b9833fd14a1f881610bbc90bbd37. Resources: {'instances', 'cores', 'ram'} {{(pid=118815) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 13 13:10:19.491383 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.quota [None req-f6b0f773-dad5-4683-aea7-92586ed5af7b tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Getting quotas for user b5dbaf53464b44fe8d9e16f5013587b4 and project 4af4b9833fd14a1f881610bbc90bbd37. Resources: {'instances', 'cores', 'ram'} {{(pid=118815) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 13 13:10:19.541182 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-f6b0f773-dad5-4683-aea7-92586ed5af7b tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Going to run 1 instances... {{(pid=118815) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 13 13:10:19.550052 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-f6b0f773-dad5-4683-aea7-92586ed5af7b tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] [instance: 26bd475b-3495-4669-9985-d4a7dedb4bbf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e2cdd20b-2540-48bc-a05c-d6a2e7e9a66e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118815) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 13 13:10:19.680282 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-f6b0f773-dad5-4683-aea7-92586ed5af7b tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 5.392744 Oct 13 13:10:19.686914 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 22/51] 10.222.0.23 () {62 vars in 1188 bytes} [Thu Oct 13 13:10:14 2022] POST /compute/v2.1/servers => generated 401 bytes in 5395 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 13 13:10:19.690755 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-2a4a3da8-314f-4f4b-8505-ec3e899191c0 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Calling method '>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:10:19.695822 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-2a4a3da8-314f-4f4b-8505-ec3e899191c0 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] [instance: e125ab44-9111-4260-909d-95d57b7861a7] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:10:19.709792 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-2a4a3da8-314f-4f4b-8505-ec3e899191c0 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:10:19.710296 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-2a4a3da8-314f-4f4b-8505-ec3e899191c0 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:10:19.710743 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-2a4a3da8-314f-4f4b-8505-ec3e899191c0 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:10:19.711490 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-2a4a3da8-314f-4f4b-8505-ec3e899191c0 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:10:19.712537 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-c366ebd0-c75c-4f9f-9702-8d4645279ca2 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '454203f47b434cca952a1cef56de559f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7312d0ac9248f2bfbece5611913ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:10:19.712887 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-2a4a3da8-314f-4f4b-8505-ec3e899191c0 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:10:19.715010 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-2a4a3da8-314f-4f4b-8505-ec3e899191c0 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:10:19.721991 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-c366ebd0-c75c-4f9f-9702-8d4645279ca2 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] 10.222.0.23 "GET /compute/v2.1/servers/96c829cb-4dde-467c-b50f-b2f666bdab0b" status: 200 len: 1280 microversion: 2.1 time: 0.396158 Oct 13 13:10:19.733462 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 30/52] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:10:19 2022] GET /compute/v2.1/servers/96c829cb-4dde-467c-b50f-b2f666bdab0b => generated 1280 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:10:19.747643 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-f697f105-7811-46db-a4d6-42e4310a2e11 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Calling method '>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:10:19.755682 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-f697f105-7811-46db-a4d6-42e4310a2e11 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] [instance: 26bd475b-3495-4669-9985-d4a7dedb4bbf] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:10:20.198635 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-f697f105-7811-46db-a4d6-42e4310a2e11 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:10:20.225898 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-f697f105-7811-46db-a4d6-42e4310a2e11 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:10:20.236859 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-f697f105-7811-46db-a4d6-42e4310a2e11 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:10:20.240348 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-f697f105-7811-46db-a4d6-42e4310a2e11 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] 10.222.0.23 "GET /compute/v2.1/servers/26bd475b-3495-4669-9985-d4a7dedb4bbf" status: 200 len: 1282 microversion: 2.20 time: 0.505276 Oct 13 13:10:20.242632 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 31/53] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 13:10:19 2022] GET /compute/v2.1/servers/26bd475b-3495-4669-9985-d4a7dedb4bbf => generated 1282 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 13:10:20.344532 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-19fd7d72-46b0-40b5-a2e4-3d6bba13926b tempest-DeleteServersTestJSON-1957240839 tempest-DeleteServersTestJSON-1957240839-project] Calling method '>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:10:20.357999 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-19fd7d72-46b0-40b5-a2e4-3d6bba13926b tempest-DeleteServersTestJSON-1957240839 tempest-DeleteServersTestJSON-1957240839-project] [instance: dcd9bb33-bad5-4d93-ba0f-558c63746e29] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:10:20.396554 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-19fd7d72-46b0-40b5-a2e4-3d6bba13926b tempest-DeleteServersTestJSON-1957240839 tempest-DeleteServersTestJSON-1957240839-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:10:20.398371 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-19fd7d72-46b0-40b5-a2e4-3d6bba13926b tempest-DeleteServersTestJSON-1957240839 tempest-DeleteServersTestJSON-1957240839-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:10:20.400221 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-19fd7d72-46b0-40b5-a2e4-3d6bba13926b tempest-DeleteServersTestJSON-1957240839 tempest-DeleteServersTestJSON-1957240839-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:10:20.414728 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-19fd7d72-46b0-40b5-a2e4-3d6bba13926b tempest-DeleteServersTestJSON-1957240839 tempest-DeleteServersTestJSON-1957240839-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:10:20.420631 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-19fd7d72-46b0-40b5-a2e4-3d6bba13926b tempest-DeleteServersTestJSON-1957240839 tempest-DeleteServersTestJSON-1957240839-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:10:20.425944 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-19fd7d72-46b0-40b5-a2e4-3d6bba13926b tempest-DeleteServersTestJSON-1957240839 tempest-DeleteServersTestJSON-1957240839-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:10:21.000443 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-2a4a3da8-314f-4f4b-8505-ec3e899191c0 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e783caddcad473dbdd764919286e244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecd3d5d2a3a54a07ba64f1fea4846c40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:10:21.022970 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-2a4a3da8-314f-4f4b-8505-ec3e899191c0 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] 10.222.0.23 "GET /compute/v2.1/servers/e125ab44-9111-4260-909d-95d57b7861a7" status: 200 len: 1363 microversion: 2.1 time: 1.331431 Oct 13 13:10:21.024985 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 23/54] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:10:19 2022] GET /compute/v2.1/servers/e125ab44-9111-4260-909d-95d57b7861a7 => generated 1363 bytes in 1342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:10:21.123943 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-19fd7d72-46b0-40b5-a2e4-3d6bba13926b tempest-DeleteServersTestJSON-1957240839 tempest-DeleteServersTestJSON-1957240839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3a049e77aba470db21e26d1bc8caa80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6027a602300d4d2bbf33ac329b2960f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:10:21.135991 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-19fd7d72-46b0-40b5-a2e4-3d6bba13926b tempest-DeleteServersTestJSON-1957240839 tempest-DeleteServersTestJSON-1957240839-project] 10.222.0.23 "GET /compute/v2.1/servers/dcd9bb33-bad5-4d93-ba0f-558c63746e29" status: 200 len: 1315 microversion: 2.1 time: 0.807002 Oct 13 13:10:21.137862 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 32/55] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:10:20 2022] GET /compute/v2.1/servers/dcd9bb33-bad5-4d93-ba0f-558c63746e29 => generated 1315 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:10:21.152671 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-03942888-f35f-404c-b053-d5e98da95fec tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Calling method '>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:10:21.153876 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-03942888-f35f-404c-b053-d5e98da95fec tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] [instance: 96c829cb-4dde-467c-b50f-b2f666bdab0b] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:10:21.159680 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG dbcounter [-] [118814] Writing DB stats nova_api:SELECT=76,nova_api:INSERT=7 {{(pid=118814) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:10:21.174864 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-03942888-f35f-404c-b053-d5e98da95fec tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:10:21.178257 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-03942888-f35f-404c-b053-d5e98da95fec tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:10:21.179179 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-03942888-f35f-404c-b053-d5e98da95fec tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:10:21.181041 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-03942888-f35f-404c-b053-d5e98da95fec tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:10:21.185036 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-03942888-f35f-404c-b053-d5e98da95fec tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:10:21.185663 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-03942888-f35f-404c-b053-d5e98da95fec tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:10:21.204642 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [req-236e7a1a-02e4-4f87-ab85-ade629638730 req-749faced-377d-4562-a015-077e9fae1f04 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dcd9bb33-bad5-4d93-ba0f-558c63746e29", "tag": "56f9f92a-e0d4-4a2d-b2f3-734fabaf36a0"}]} {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 13:10:21.237900 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [req-236e7a1a-02e4-4f87-ab85-ade629638730 req-749faced-377d-4562-a015-077e9fae1f04 service nova] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:10:21.238450 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [req-236e7a1a-02e4-4f87-ab85-ade629638730 req-749faced-377d-4562-a015-077e9fae1f04 service nova] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:10:21.238902 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [req-236e7a1a-02e4-4f87-ab85-ade629638730 req-749faced-377d-4562-a015-077e9fae1f04 service nova] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:10:21.289178 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.compute.server_external_events [req-236e7a1a-02e4-4f87-ab85-ade629638730 req-749faced-377d-4562-a015-077e9fae1f04 service nova] Creating event network-changed:56f9f92a-e0d4-4a2d-b2f3-734fabaf36a0 for instance dcd9bb33-bad5-4d93-ba0f-558c63746e29 on hv-cinder-82660 Oct 13 13:10:21.291879 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [req-236e7a1a-02e4-4f87-ab85-ade629638730 req-749faced-377d-4562-a015-077e9fae1f04 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=118815) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 13 13:10:21.292301 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [req-236e7a1a-02e4-4f87-ab85-ade629638730 req-749faced-377d-4562-a015-077e9fae1f04 service nova] Acquired lock "compute-rpcapi-router" {{(pid=118815) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 13 13:10:21.294196 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-b9112fbd-1186-42f3-bf13-8cb16f79e7db None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:10:21.294660 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-b9112fbd-1186-42f3-bf13-8cb16f79e7db None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:10:21.296342 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-b9112fbd-1186-42f3-bf13-8cb16f79e7db None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:10:21.297090 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-b9112fbd-1186-42f3-bf13-8cb16f79e7db None None] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:10:21.297553 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-b9112fbd-1186-42f3-bf13-8cb16f79e7db None None] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:10:21.306295 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-b9112fbd-1186-42f3-bf13-8cb16f79e7db None None] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:10:21.343728 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.compute.rpcapi [None req-b9112fbd-1186-42f3-bf13-8cb16f79e7db None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Oct 13 13:10:21.344658 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-b9112fbd-1186-42f3-bf13-8cb16f79e7db None None] Releasing lock "compute-rpcapi-router" {{(pid=118815) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 13 13:10:21.385849 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-03942888-f35f-404c-b053-d5e98da95fec tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '454203f47b434cca952a1cef56de559f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7312d0ac9248f2bfbece5611913ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:10:21.401622 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-b9112fbd-1186-42f3-bf13-8cb16f79e7db None None] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.372416 Oct 13 13:10:21.401837 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-03942888-f35f-404c-b053-d5e98da95fec tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] 10.222.0.23 "GET /compute/v2.1/servers/96c829cb-4dde-467c-b50f-b2f666bdab0b" status: 200 len: 1280 microversion: 2.1 time: 0.262550 Oct 13 13:10:21.402636 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 24/56] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 13:10:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 13:10:21.415788 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 33/57] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:10:21 2022] GET /compute/v2.1/servers/96c829cb-4dde-467c-b50f-b2f666bdab0b => generated 1280 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:10:21.420253 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-663271e7-f43d-4445-b722-23a7e7a6e2c7 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Calling method '>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:10:21.421003 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-663271e7-f43d-4445-b722-23a7e7a6e2c7 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] [instance: 26bd475b-3495-4669-9985-d4a7dedb4bbf] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:10:21.461062 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-663271e7-f43d-4445-b722-23a7e7a6e2c7 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:10:21.462721 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-663271e7-f43d-4445-b722-23a7e7a6e2c7 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:10:21.463586 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-663271e7-f43d-4445-b722-23a7e7a6e2c7 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:10:21.464621 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-663271e7-f43d-4445-b722-23a7e7a6e2c7 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:10:21.469471 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-663271e7-f43d-4445-b722-23a7e7a6e2c7 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:10:21.470264 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-663271e7-f43d-4445-b722-23a7e7a6e2c7 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:10:21.719240 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-663271e7-f43d-4445-b722-23a7e7a6e2c7 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:10:21.753618 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-663271e7-f43d-4445-b722-23a7e7a6e2c7 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:10:21.762795 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-663271e7-f43d-4445-b722-23a7e7a6e2c7 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:10:21.766807 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-663271e7-f43d-4445-b722-23a7e7a6e2c7 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] 10.222.0.23 "GET /compute/v2.1/servers/26bd475b-3495-4669-9985-d4a7dedb4bbf" status: 200 len: 1334 microversion: 2.20 time: 0.362519 Oct 13 13:10:21.785147 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 25/58] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 13:10:21 2022] GET /compute/v2.1/servers/26bd475b-3495-4669-9985-d4a7dedb4bbf => generated 1334 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 13:10:22.049198 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-37ae072d-66f8-43e7-8d3c-0a416265080c tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Calling method '>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:10:22.050495 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-37ae072d-66f8-43e7-8d3c-0a416265080c tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] [instance: e125ab44-9111-4260-909d-95d57b7861a7] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:10:22.060188 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-37ae072d-66f8-43e7-8d3c-0a416265080c tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:10:22.060676 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-37ae072d-66f8-43e7-8d3c-0a416265080c tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:10:22.064294 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-37ae072d-66f8-43e7-8d3c-0a416265080c tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:10:22.065067 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-37ae072d-66f8-43e7-8d3c-0a416265080c tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:10:22.065542 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-37ae072d-66f8-43e7-8d3c-0a416265080c tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:10:22.065971 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-37ae072d-66f8-43e7-8d3c-0a416265080c tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:10:22.168782 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-262049be-78ab-4d89-8035-9cead2298dc4 tempest-DeleteServersTestJSON-1957240839 tempest-DeleteServersTestJSON-1957240839-project] Calling method '>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:10:22.171299 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-262049be-78ab-4d89-8035-9cead2298dc4 tempest-DeleteServersTestJSON-1957240839 tempest-DeleteServersTestJSON-1957240839-project] [instance: dcd9bb33-bad5-4d93-ba0f-558c63746e29] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:10:22.198965 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-262049be-78ab-4d89-8035-9cead2298dc4 tempest-DeleteServersTestJSON-1957240839 tempest-DeleteServersTestJSON-1957240839-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:10:22.204389 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-262049be-78ab-4d89-8035-9cead2298dc4 tempest-DeleteServersTestJSON-1957240839 tempest-DeleteServersTestJSON-1957240839-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:10:22.207792 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-262049be-78ab-4d89-8035-9cead2298dc4 tempest-DeleteServersTestJSON-1957240839 tempest-DeleteServersTestJSON-1957240839-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:10:22.209583 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-262049be-78ab-4d89-8035-9cead2298dc4 tempest-DeleteServersTestJSON-1957240839 tempest-DeleteServersTestJSON-1957240839-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:10:22.214322 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-262049be-78ab-4d89-8035-9cead2298dc4 tempest-DeleteServersTestJSON-1957240839 tempest-DeleteServersTestJSON-1957240839-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:10:22.215071 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-262049be-78ab-4d89-8035-9cead2298dc4 tempest-DeleteServersTestJSON-1957240839 tempest-DeleteServersTestJSON-1957240839-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:10:22.842631 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-262049be-78ab-4d89-8035-9cead2298dc4 tempest-DeleteServersTestJSON-1957240839 tempest-DeleteServersTestJSON-1957240839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3a049e77aba470db21e26d1bc8caa80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6027a602300d4d2bbf33ac329b2960f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:10:22.868694 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-262049be-78ab-4d89-8035-9cead2298dc4 tempest-DeleteServersTestJSON-1957240839 tempest-DeleteServersTestJSON-1957240839-project] 10.222.0.23 "GET /compute/v2.1/servers/dcd9bb33-bad5-4d93-ba0f-558c63746e29" status: 200 len: 1315 microversion: 2.1 time: 0.703041 Oct 13 13:10:22.872737 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 26/59] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:10:22 2022] GET /compute/v2.1/servers/dcd9bb33-bad5-4d93-ba0f-558c63746e29 => generated 1315 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:10:22.876723 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-37ae072d-66f8-43e7-8d3c-0a416265080c tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e783caddcad473dbdd764919286e244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecd3d5d2a3a54a07ba64f1fea4846c40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:10:22.889632 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-0e019281-9c0d-4ee0-8a7e-50f2df58e502 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Calling method '>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:10:22.890173 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-0e019281-9c0d-4ee0-8a7e-50f2df58e502 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] [instance: 96c829cb-4dde-467c-b50f-b2f666bdab0b] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:10:22.898830 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-37ae072d-66f8-43e7-8d3c-0a416265080c tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] 10.222.0.23 "GET /compute/v2.1/servers/e125ab44-9111-4260-909d-95d57b7861a7" status: 200 len: 1363 microversion: 2.1 time: 0.853786 Oct 13 13:10:22.900305 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 34/60] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:10:22 2022] GET /compute/v2.1/servers/e125ab44-9111-4260-909d-95d57b7861a7 => generated 1363 bytes in 856 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:10:22.908176 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-0e019281-9c0d-4ee0-8a7e-50f2df58e502 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:10:22.910328 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-0e019281-9c0d-4ee0-8a7e-50f2df58e502 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:10:22.910927 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-0e019281-9c0d-4ee0-8a7e-50f2df58e502 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:10:22.912721 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-0e019281-9c0d-4ee0-8a7e-50f2df58e502 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:10:22.913385 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-0e019281-9c0d-4ee0-8a7e-50f2df58e502 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:10:22.916517 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-5a1b2084-cf19-48b2-982b-6a8d045f2881 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Calling method '>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:10:22.917405 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-0e019281-9c0d-4ee0-8a7e-50f2df58e502 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:10:22.926457 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-5a1b2084-cf19-48b2-982b-6a8d045f2881 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] [instance: 26bd475b-3495-4669-9985-d4a7dedb4bbf] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:10:22.944691 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-5a1b2084-cf19-48b2-982b-6a8d045f2881 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:10:22.945458 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-5a1b2084-cf19-48b2-982b-6a8d045f2881 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:10:22.975710 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-5a1b2084-cf19-48b2-982b-6a8d045f2881 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:10:22.981118 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-5a1b2084-cf19-48b2-982b-6a8d045f2881 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:10:22.981647 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-5a1b2084-cf19-48b2-982b-6a8d045f2881 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:10:22.982099 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-5a1b2084-cf19-48b2-982b-6a8d045f2881 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:10:23.364168 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-5a1b2084-cf19-48b2-982b-6a8d045f2881 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:10:23.370126 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG dbcounter [-] [118814] Writing DB stats nova_cell1:SELECT=100 {{(pid=118814) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:10:23.392160 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-5a1b2084-cf19-48b2-982b-6a8d045f2881 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:10:23.397104 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-5a1b2084-cf19-48b2-982b-6a8d045f2881 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:10:23.426474 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-5a1b2084-cf19-48b2-982b-6a8d045f2881 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] 10.222.0.23 "GET /compute/v2.1/servers/26bd475b-3495-4669-9985-d4a7dedb4bbf" status: 200 len: 1334 microversion: 2.20 time: 0.524653 Oct 13 13:10:23.429244 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 35/61] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 13:10:22 2022] GET /compute/v2.1/servers/26bd475b-3495-4669-9985-d4a7dedb4bbf => generated 1334 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 13:10:23.764473 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [req-2295d374-d567-4f99-9640-0b8504dfafa8 req-d95bf084-e69f-4b47-99ed-564f2a7f05d7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e125ab44-9111-4260-909d-95d57b7861a7", "tag": "95c8323b-318e-4698-a732-2714f447a0ff"}]} {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 13:10:23.834617 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [req-2295d374-d567-4f99-9640-0b8504dfafa8 req-d95bf084-e69f-4b47-99ed-564f2a7f05d7 service nova] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:10:23.846060 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [req-2295d374-d567-4f99-9640-0b8504dfafa8 req-d95bf084-e69f-4b47-99ed-564f2a7f05d7 service nova] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:10:23.846667 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [req-2295d374-d567-4f99-9640-0b8504dfafa8 req-d95bf084-e69f-4b47-99ed-564f2a7f05d7 service nova] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:10:23.916820 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.compute.server_external_events [req-2295d374-d567-4f99-9640-0b8504dfafa8 req-d95bf084-e69f-4b47-99ed-564f2a7f05d7 service nova] Creating event network-changed:95c8323b-318e-4698-a732-2714f447a0ff for instance e125ab44-9111-4260-909d-95d57b7861a7 on hv-cinder-82660 Oct 13 13:10:23.917526 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [req-2295d374-d567-4f99-9640-0b8504dfafa8 req-d95bf084-e69f-4b47-99ed-564f2a7f05d7 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=118814) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 13 13:10:23.917739 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [req-2295d374-d567-4f99-9640-0b8504dfafa8 req-d95bf084-e69f-4b47-99ed-564f2a7f05d7 service nova] Acquired lock "compute-rpcapi-router" {{(pid=118814) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 13 13:10:23.919226 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-288f81d0-607a-4f05-a29e-64b1ca09fc19 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:10:23.925270 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-288f81d0-607a-4f05-a29e-64b1ca09fc19 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:10:23.925959 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-288f81d0-607a-4f05-a29e-64b1ca09fc19 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:10:23.931732 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-288f81d0-607a-4f05-a29e-64b1ca09fc19 None None] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:10:23.932371 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-288f81d0-607a-4f05-a29e-64b1ca09fc19 None None] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:10:23.933137 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-288f81d0-607a-4f05-a29e-64b1ca09fc19 None None] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:10:23.952681 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.compute.rpcapi [None req-288f81d0-607a-4f05-a29e-64b1ca09fc19 None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Oct 13 13:10:23.954006 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-288f81d0-607a-4f05-a29e-64b1ca09fc19 None None] Releasing lock "compute-rpcapi-router" {{(pid=118814) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 13 13:10:23.991884 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-288f81d0-607a-4f05-a29e-64b1ca09fc19 None None] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.558708 Oct 13 13:10:23.993311 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 36/62] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 13:10:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 13:10:24.003733 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-85a06c20-8f82-4a27-9eb3-c640b7d5eba6 tempest-DeleteServersTestJSON-1957240839 tempest-DeleteServersTestJSON-1957240839-project] Calling method '>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:10:24.004715 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-85a06c20-8f82-4a27-9eb3-c640b7d5eba6 tempest-DeleteServersTestJSON-1957240839 tempest-DeleteServersTestJSON-1957240839-project] [instance: dcd9bb33-bad5-4d93-ba0f-558c63746e29] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:10:24.021951 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-85a06c20-8f82-4a27-9eb3-c640b7d5eba6 tempest-DeleteServersTestJSON-1957240839 tempest-DeleteServersTestJSON-1957240839-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:10:24.022624 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-85a06c20-8f82-4a27-9eb3-c640b7d5eba6 tempest-DeleteServersTestJSON-1957240839 tempest-DeleteServersTestJSON-1957240839-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:10:24.023245 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-85a06c20-8f82-4a27-9eb3-c640b7d5eba6 tempest-DeleteServersTestJSON-1957240839 tempest-DeleteServersTestJSON-1957240839-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:10:24.024186 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-85a06c20-8f82-4a27-9eb3-c640b7d5eba6 tempest-DeleteServersTestJSON-1957240839 tempest-DeleteServersTestJSON-1957240839-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:10:24.025283 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-85a06c20-8f82-4a27-9eb3-c640b7d5eba6 tempest-DeleteServersTestJSON-1957240839 tempest-DeleteServersTestJSON-1957240839-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:10:24.025854 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-85a06c20-8f82-4a27-9eb3-c640b7d5eba6 tempest-DeleteServersTestJSON-1957240839 tempest-DeleteServersTestJSON-1957240839-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:10:24.313727 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-0e019281-9c0d-4ee0-8a7e-50f2df58e502 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '454203f47b434cca952a1cef56de559f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7312d0ac9248f2bfbece5611913ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:10:24.327790 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-0e019281-9c0d-4ee0-8a7e-50f2df58e502 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] 10.222.0.23 "GET /compute/v2.1/servers/96c829cb-4dde-467c-b50f-b2f666bdab0b" status: 200 len: 1322 microversion: 2.1 time: 1.449051 Oct 13 13:10:24.330331 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 27/63] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:10:22 2022] GET /compute/v2.1/servers/96c829cb-4dde-467c-b50f-b2f666bdab0b => generated 1322 bytes in 1456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:10:24.345531 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-29e2ae88-d511-4f35-8121-ef4d4d23920d tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Calling method '>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:10:24.346991 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-29e2ae88-d511-4f35-8121-ef4d4d23920d tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] [instance: e125ab44-9111-4260-909d-95d57b7861a7] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:10:24.361283 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-29e2ae88-d511-4f35-8121-ef4d4d23920d tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:10:24.368606 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-29e2ae88-d511-4f35-8121-ef4d4d23920d tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:10:24.369569 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-29e2ae88-d511-4f35-8121-ef4d4d23920d tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:10:24.370828 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-29e2ae88-d511-4f35-8121-ef4d4d23920d tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:10:24.371798 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-29e2ae88-d511-4f35-8121-ef4d4d23920d tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:10:24.372552 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-29e2ae88-d511-4f35-8121-ef4d4d23920d tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:10:24.762429 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-85a06c20-8f82-4a27-9eb3-c640b7d5eba6 tempest-DeleteServersTestJSON-1957240839 tempest-DeleteServersTestJSON-1957240839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3a049e77aba470db21e26d1bc8caa80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6027a602300d4d2bbf33ac329b2960f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:10:24.772189 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-85a06c20-8f82-4a27-9eb3-c640b7d5eba6 tempest-DeleteServersTestJSON-1957240839 tempest-DeleteServersTestJSON-1957240839-project] 10.222.0.23 "GET /compute/v2.1/servers/dcd9bb33-bad5-4d93-ba0f-558c63746e29" status: 200 len: 1315 microversion: 2.1 time: 0.777475 Oct 13 13:10:24.779769 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 37/64] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:10:23 2022] GET /compute/v2.1/servers/dcd9bb33-bad5-4d93-ba0f-558c63746e29 => generated 1315 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:10:24.784946 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-3835d9bf-f2ad-4f03-a71b-39cc9fea15ac tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Calling method '>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:10:24.785783 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-3835d9bf-f2ad-4f03-a71b-39cc9fea15ac tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] [instance: 26bd475b-3495-4669-9985-d4a7dedb4bbf] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:10:24.799588 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-3835d9bf-f2ad-4f03-a71b-39cc9fea15ac tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:10:24.800467 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-3835d9bf-f2ad-4f03-a71b-39cc9fea15ac tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:10:24.801106 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-3835d9bf-f2ad-4f03-a71b-39cc9fea15ac tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:10:24.803818 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-3835d9bf-f2ad-4f03-a71b-39cc9fea15ac tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:10:24.804421 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-3835d9bf-f2ad-4f03-a71b-39cc9fea15ac tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:10:24.804947 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-3835d9bf-f2ad-4f03-a71b-39cc9fea15ac tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:10:24.944941 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-29e2ae88-d511-4f35-8121-ef4d4d23920d tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e783caddcad473dbdd764919286e244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecd3d5d2a3a54a07ba64f1fea4846c40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:10:24.953142 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-29e2ae88-d511-4f35-8121-ef4d4d23920d tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] 10.222.0.23 "GET /compute/v2.1/servers/e125ab44-9111-4260-909d-95d57b7861a7" status: 200 len: 1363 microversion: 2.1 time: 0.621716 Oct 13 13:10:24.957897 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 28/65] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:10:24 2022] GET /compute/v2.1/servers/e125ab44-9111-4260-909d-95d57b7861a7 => generated 1363 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:10:24.987351 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-3835d9bf-f2ad-4f03-a71b-39cc9fea15ac tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:10:25.007302 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-3835d9bf-f2ad-4f03-a71b-39cc9fea15ac tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:10:25.011836 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-3835d9bf-f2ad-4f03-a71b-39cc9fea15ac tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:10:25.017270 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-3835d9bf-f2ad-4f03-a71b-39cc9fea15ac tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] 10.222.0.23 "GET /compute/v2.1/servers/26bd475b-3495-4669-9985-d4a7dedb4bbf" status: 200 len: 1340 microversion: 2.20 time: 0.234270 Oct 13 13:10:25.019848 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 38/66] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 13:10:24 2022] GET /compute/v2.1/servers/26bd475b-3495-4669-9985-d4a7dedb4bbf => generated 1340 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 13:10:25.358823 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-557a5469-0225-4862-a0ea-fa6734eb1f4d tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Calling method '>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:10:25.361145 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-557a5469-0225-4862-a0ea-fa6734eb1f4d tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] [instance: 96c829cb-4dde-467c-b50f-b2f666bdab0b] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:10:25.370302 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-557a5469-0225-4862-a0ea-fa6734eb1f4d tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:10:25.371636 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-557a5469-0225-4862-a0ea-fa6734eb1f4d tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:10:25.372260 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-557a5469-0225-4862-a0ea-fa6734eb1f4d tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:10:25.373123 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-557a5469-0225-4862-a0ea-fa6734eb1f4d tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:10:25.373909 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-557a5469-0225-4862-a0ea-fa6734eb1f4d tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:10:25.375581 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-557a5469-0225-4862-a0ea-fa6734eb1f4d tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:10:25.613557 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-557a5469-0225-4862-a0ea-fa6734eb1f4d tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '454203f47b434cca952a1cef56de559f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7312d0ac9248f2bfbece5611913ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:10:25.626631 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-557a5469-0225-4862-a0ea-fa6734eb1f4d tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] 10.222.0.23 "GET /compute/v2.1/servers/96c829cb-4dde-467c-b50f-b2f666bdab0b" status: 200 len: 1322 microversion: 2.1 time: 0.271996 Oct 13 13:10:25.627525 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 29/67] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:10:25 2022] GET /compute/v2.1/servers/96c829cb-4dde-467c-b50f-b2f666bdab0b => generated 1322 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:10:25.763983 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [req-2b24c8ad-532b-4442-9f9d-ec96dd2b9079 req-f3fd3650-c963-4fad-bcf9-27e825827f34 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0548a3eb-e119-482c-ac70-04fbc6f83bf7", "tag": "8c64ab27-53ec-48f6-92d8-9ce773dd02d8"}]} {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 13:10:25.791710 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [req-2b24c8ad-532b-4442-9f9d-ec96dd2b9079 req-f3fd3650-c963-4fad-bcf9-27e825827f34 service nova] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:10:25.793646 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [req-2b24c8ad-532b-4442-9f9d-ec96dd2b9079 req-f3fd3650-c963-4fad-bcf9-27e825827f34 service nova] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:10:25.794667 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [req-2b24c8ad-532b-4442-9f9d-ec96dd2b9079 req-f3fd3650-c963-4fad-bcf9-27e825827f34 service nova] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:10:25.808379 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-551bf8c3-246b-4d97-a118-ddc5627c3e32 tempest-DeleteServersTestJSON-1957240839 tempest-DeleteServersTestJSON-1957240839-project] Calling method '>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:10:25.809289 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-551bf8c3-246b-4d97-a118-ddc5627c3e32 tempest-DeleteServersTestJSON-1957240839 tempest-DeleteServersTestJSON-1957240839-project] [instance: dcd9bb33-bad5-4d93-ba0f-558c63746e29] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:10:25.837836 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-551bf8c3-246b-4d97-a118-ddc5627c3e32 tempest-DeleteServersTestJSON-1957240839 tempest-DeleteServersTestJSON-1957240839-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:10:25.838570 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-551bf8c3-246b-4d97-a118-ddc5627c3e32 tempest-DeleteServersTestJSON-1957240839 tempest-DeleteServersTestJSON-1957240839-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:10:25.840093 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-551bf8c3-246b-4d97-a118-ddc5627c3e32 tempest-DeleteServersTestJSON-1957240839 tempest-DeleteServersTestJSON-1957240839-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:10:25.843921 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-551bf8c3-246b-4d97-a118-ddc5627c3e32 tempest-DeleteServersTestJSON-1957240839 tempest-DeleteServersTestJSON-1957240839-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:10:25.845870 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-551bf8c3-246b-4d97-a118-ddc5627c3e32 tempest-DeleteServersTestJSON-1957240839 tempest-DeleteServersTestJSON-1957240839-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:10:25.859484 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-551bf8c3-246b-4d97-a118-ddc5627c3e32 tempest-DeleteServersTestJSON-1957240839 tempest-DeleteServersTestJSON-1957240839-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:10:25.876671 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.compute.server_external_events [req-2b24c8ad-532b-4442-9f9d-ec96dd2b9079 req-f3fd3650-c963-4fad-bcf9-27e825827f34 service nova] Creating event network-changed:8c64ab27-53ec-48f6-92d8-9ce773dd02d8 for instance 0548a3eb-e119-482c-ac70-04fbc6f83bf7 on hv-cinder-82660 Oct 13 13:10:25.886147 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [req-2b24c8ad-532b-4442-9f9d-ec96dd2b9079 req-f3fd3650-c963-4fad-bcf9-27e825827f34 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.126529 Oct 13 13:10:25.887469 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 39/68] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 13:10:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 13:10:25.997386 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-ac19cf4e-ddf3-49d0-b355-bb1d1c47c91b tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Calling method '>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:10:25.999482 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-ac19cf4e-ddf3-49d0-b355-bb1d1c47c91b tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] [instance: e125ab44-9111-4260-909d-95d57b7861a7] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:10:26.012815 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-ac19cf4e-ddf3-49d0-b355-bb1d1c47c91b tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:10:26.015137 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-ac19cf4e-ddf3-49d0-b355-bb1d1c47c91b tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:10:26.016049 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-ac19cf4e-ddf3-49d0-b355-bb1d1c47c91b tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:10:26.017131 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-ac19cf4e-ddf3-49d0-b355-bb1d1c47c91b tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:10:26.017785 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-ac19cf4e-ddf3-49d0-b355-bb1d1c47c91b tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:10:26.018415 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-ac19cf4e-ddf3-49d0-b355-bb1d1c47c91b tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:10:26.171474 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-551bf8c3-246b-4d97-a118-ddc5627c3e32 tempest-DeleteServersTestJSON-1957240839 tempest-DeleteServersTestJSON-1957240839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3a049e77aba470db21e26d1bc8caa80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6027a602300d4d2bbf33ac329b2960f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:10:26.182391 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-551bf8c3-246b-4d97-a118-ddc5627c3e32 tempest-DeleteServersTestJSON-1957240839 tempest-DeleteServersTestJSON-1957240839-project] 10.222.0.23 "GET /compute/v2.1/servers/dcd9bb33-bad5-4d93-ba0f-558c63746e29" status: 200 len: 1315 microversion: 2.1 time: 0.379223 Oct 13 13:10:26.189165 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 30/69] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:10:25 2022] GET /compute/v2.1/servers/dcd9bb33-bad5-4d93-ba0f-558c63746e29 => generated 1315 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:10:26.196999 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-e5116fdd-82ad-4a43-8c71-d23dd2a9c96e tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Calling method '>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:10:26.197855 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-e5116fdd-82ad-4a43-8c71-d23dd2a9c96e tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] [instance: 26bd475b-3495-4669-9985-d4a7dedb4bbf] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:10:26.223309 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG dbcounter [-] [118815] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=10 {{(pid=118815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:10:26.228931 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-e5116fdd-82ad-4a43-8c71-d23dd2a9c96e tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:10:26.230228 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-e5116fdd-82ad-4a43-8c71-d23dd2a9c96e tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:10:26.233266 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-e5116fdd-82ad-4a43-8c71-d23dd2a9c96e tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:10:26.234160 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-e5116fdd-82ad-4a43-8c71-d23dd2a9c96e tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:10:26.236125 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-e5116fdd-82ad-4a43-8c71-d23dd2a9c96e tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:10:26.243414 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-e5116fdd-82ad-4a43-8c71-d23dd2a9c96e tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:10:26.362059 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-e5116fdd-82ad-4a43-8c71-d23dd2a9c96e tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:10:26.376689 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-e5116fdd-82ad-4a43-8c71-d23dd2a9c96e tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:10:26.380501 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-e5116fdd-82ad-4a43-8c71-d23dd2a9c96e tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:10:26.381908 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-e5116fdd-82ad-4a43-8c71-d23dd2a9c96e tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] 10.222.0.23 "GET /compute/v2.1/servers/26bd475b-3495-4669-9985-d4a7dedb4bbf" status: 200 len: 1340 microversion: 2.20 time: 0.191537 Oct 13 13:10:26.397019 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 31/70] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 13:10:26 2022] GET /compute/v2.1/servers/26bd475b-3495-4669-9985-d4a7dedb4bbf => generated 1340 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 13:10:26.417434 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-ac19cf4e-ddf3-49d0-b355-bb1d1c47c91b tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e783caddcad473dbdd764919286e244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecd3d5d2a3a54a07ba64f1fea4846c40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:10:26.428032 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-ac19cf4e-ddf3-49d0-b355-bb1d1c47c91b tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] 10.222.0.23 "GET /compute/v2.1/servers/e125ab44-9111-4260-909d-95d57b7861a7" status: 200 len: 1363 microversion: 2.1 time: 0.437553 Oct 13 13:10:26.429610 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 40/71] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:10:25 2022] GET /compute/v2.1/servers/e125ab44-9111-4260-909d-95d57b7861a7 => generated 1363 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:10:26.654723 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-9d1300e4-1ca4-4493-822f-fbc717b41fa6 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Calling method '>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:10:26.655395 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-9d1300e4-1ca4-4493-822f-fbc717b41fa6 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] [instance: 96c829cb-4dde-467c-b50f-b2f666bdab0b] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:10:26.667895 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-9d1300e4-1ca4-4493-822f-fbc717b41fa6 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:10:26.668581 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-9d1300e4-1ca4-4493-822f-fbc717b41fa6 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:10:26.670564 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-9d1300e4-1ca4-4493-822f-fbc717b41fa6 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:10:26.672621 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-9d1300e4-1ca4-4493-822f-fbc717b41fa6 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:10:26.673993 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-9d1300e4-1ca4-4493-822f-fbc717b41fa6 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:10:26.677531 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-9d1300e4-1ca4-4493-822f-fbc717b41fa6 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:10:26.969829 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-9d1300e4-1ca4-4493-822f-fbc717b41fa6 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '454203f47b434cca952a1cef56de559f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7312d0ac9248f2bfbece5611913ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:10:26.979612 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-9d1300e4-1ca4-4493-822f-fbc717b41fa6 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] 10.222.0.23 "GET /compute/v2.1/servers/96c829cb-4dde-467c-b50f-b2f666bdab0b" status: 200 len: 1322 microversion: 2.1 time: 0.329982 Oct 13 13:10:26.997131 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 32/72] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:10:26 2022] GET /compute/v2.1/servers/96c829cb-4dde-467c-b50f-b2f666bdab0b => generated 1322 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:10:27.214565 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-fc11db17-43fc-45d5-8021-ae101711ba3f tempest-DeleteServersTestJSON-1957240839 tempest-DeleteServersTestJSON-1957240839-project] Calling method '>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:10:27.215674 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-fc11db17-43fc-45d5-8021-ae101711ba3f tempest-DeleteServersTestJSON-1957240839 tempest-DeleteServersTestJSON-1957240839-project] [instance: dcd9bb33-bad5-4d93-ba0f-558c63746e29] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:10:27.228434 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-fc11db17-43fc-45d5-8021-ae101711ba3f tempest-DeleteServersTestJSON-1957240839 tempest-DeleteServersTestJSON-1957240839-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:10:27.229032 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-fc11db17-43fc-45d5-8021-ae101711ba3f tempest-DeleteServersTestJSON-1957240839 tempest-DeleteServersTestJSON-1957240839-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:10:27.229354 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-fc11db17-43fc-45d5-8021-ae101711ba3f tempest-DeleteServersTestJSON-1957240839 tempest-DeleteServersTestJSON-1957240839-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:10:27.230054 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-fc11db17-43fc-45d5-8021-ae101711ba3f tempest-DeleteServersTestJSON-1957240839 tempest-DeleteServersTestJSON-1957240839-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:10:27.230507 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-fc11db17-43fc-45d5-8021-ae101711ba3f tempest-DeleteServersTestJSON-1957240839 tempest-DeleteServersTestJSON-1957240839-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:10:27.230927 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-fc11db17-43fc-45d5-8021-ae101711ba3f tempest-DeleteServersTestJSON-1957240839 tempest-DeleteServersTestJSON-1957240839-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:10:27.391974 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-fc11db17-43fc-45d5-8021-ae101711ba3f tempest-DeleteServersTestJSON-1957240839 tempest-DeleteServersTestJSON-1957240839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3a049e77aba470db21e26d1bc8caa80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6027a602300d4d2bbf33ac329b2960f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:10:27.400198 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-fc11db17-43fc-45d5-8021-ae101711ba3f tempest-DeleteServersTestJSON-1957240839 tempest-DeleteServersTestJSON-1957240839-project] 10.222.0.23 "GET /compute/v2.1/servers/dcd9bb33-bad5-4d93-ba0f-558c63746e29" status: 200 len: 1315 microversion: 2.1 time: 0.192687 Oct 13 13:10:27.411704 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-3ba03dcd-3720-4e0b-9827-91d73acbbee4 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Calling method '>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:10:27.413737 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-3ba03dcd-3720-4e0b-9827-91d73acbbee4 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] [instance: 26bd475b-3495-4669-9985-d4a7dedb4bbf] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:10:27.415620 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 41/73] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:10:27 2022] GET /compute/v2.1/servers/dcd9bb33-bad5-4d93-ba0f-558c63746e29 => generated 1315 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:10:27.421636 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-3ba03dcd-3720-4e0b-9827-91d73acbbee4 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:10:27.422195 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-3ba03dcd-3720-4e0b-9827-91d73acbbee4 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:10:27.422731 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-3ba03dcd-3720-4e0b-9827-91d73acbbee4 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:10:27.423547 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-3ba03dcd-3720-4e0b-9827-91d73acbbee4 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:10:27.424074 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-3ba03dcd-3720-4e0b-9827-91d73acbbee4 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:10:27.424572 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-3ba03dcd-3720-4e0b-9827-91d73acbbee4 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:10:27.453227 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-c8991aea-edb9-40fa-9a65-bc2becff4fad tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Calling method '>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:10:27.454091 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-c8991aea-edb9-40fa-9a65-bc2becff4fad tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] [instance: e125ab44-9111-4260-909d-95d57b7861a7] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:10:27.460461 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-c8991aea-edb9-40fa-9a65-bc2becff4fad tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:10:27.467692 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-c8991aea-edb9-40fa-9a65-bc2becff4fad tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:10:27.468531 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-c8991aea-edb9-40fa-9a65-bc2becff4fad tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:10:27.469439 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-c8991aea-edb9-40fa-9a65-bc2becff4fad tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:10:27.470209 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-c8991aea-edb9-40fa-9a65-bc2becff4fad tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:10:27.471188 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-c8991aea-edb9-40fa-9a65-bc2becff4fad tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:10:27.706908 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-3ba03dcd-3720-4e0b-9827-91d73acbbee4 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:10:27.719193 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-3ba03dcd-3720-4e0b-9827-91d73acbbee4 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:10:27.726242 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-3ba03dcd-3720-4e0b-9827-91d73acbbee4 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:10:27.728350 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-3ba03dcd-3720-4e0b-9827-91d73acbbee4 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] 10.222.0.23 "GET /compute/v2.1/servers/26bd475b-3495-4669-9985-d4a7dedb4bbf" status: 200 len: 1407 microversion: 2.20 time: 0.322286 Oct 13 13:10:27.729591 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 33/74] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 13:10:27 2022] GET /compute/v2.1/servers/26bd475b-3495-4669-9985-d4a7dedb4bbf => generated 1407 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 13:10:27.807172 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-c8991aea-edb9-40fa-9a65-bc2becff4fad tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e783caddcad473dbdd764919286e244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecd3d5d2a3a54a07ba64f1fea4846c40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:10:27.815828 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-c8991aea-edb9-40fa-9a65-bc2becff4fad tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] 10.222.0.23 "GET /compute/v2.1/servers/e125ab44-9111-4260-909d-95d57b7861a7" status: 200 len: 1363 microversion: 2.1 time: 0.366557 Oct 13 13:10:27.817092 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 42/75] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:10:27 2022] GET /compute/v2.1/servers/e125ab44-9111-4260-909d-95d57b7861a7 => generated 1363 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:10:28.005814 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-98cccd89-b52a-48ae-9d8a-ff3331deb4d4 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Calling method '>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:10:28.006510 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-98cccd89-b52a-48ae-9d8a-ff3331deb4d4 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] [instance: 96c829cb-4dde-467c-b50f-b2f666bdab0b] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:10:28.014093 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-98cccd89-b52a-48ae-9d8a-ff3331deb4d4 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:10:28.015887 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-98cccd89-b52a-48ae-9d8a-ff3331deb4d4 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:10:28.016904 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-98cccd89-b52a-48ae-9d8a-ff3331deb4d4 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:10:28.019391 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-98cccd89-b52a-48ae-9d8a-ff3331deb4d4 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:10:28.019940 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-98cccd89-b52a-48ae-9d8a-ff3331deb4d4 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:10:28.020583 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-98cccd89-b52a-48ae-9d8a-ff3331deb4d4 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:10:28.027387 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [req-362d4bba-f28d-4412-a05e-6b2c69b7799c req-3d88beba-f3c3-4640-aa77-5e2728a769ff service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "96c829cb-4dde-467c-b50f-b2f666bdab0b", "tag": "68ffba56-b1dd-4e82-b93a-56dd6b99c0b9"}]} {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 13:10:28.048892 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [req-362d4bba-f28d-4412-a05e-6b2c69b7799c req-3d88beba-f3c3-4640-aa77-5e2728a769ff service nova] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:10:28.055650 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [req-362d4bba-f28d-4412-a05e-6b2c69b7799c req-3d88beba-f3c3-4640-aa77-5e2728a769ff service nova] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:10:28.060499 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [req-362d4bba-f28d-4412-a05e-6b2c69b7799c req-3d88beba-f3c3-4640-aa77-5e2728a769ff service nova] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:10:28.087367 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.compute.server_external_events [req-362d4bba-f28d-4412-a05e-6b2c69b7799c req-3d88beba-f3c3-4640-aa77-5e2728a769ff service nova] Creating event network-changed:68ffba56-b1dd-4e82-b93a-56dd6b99c0b9 for instance 96c829cb-4dde-467c-b50f-b2f666bdab0b on hv-cinder-82660 Oct 13 13:10:28.099507 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [req-362d4bba-f28d-4412-a05e-6b2c69b7799c req-3d88beba-f3c3-4640-aa77-5e2728a769ff service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075446 Oct 13 13:10:28.101160 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 43/76] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 13:10:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 13 13:10:28.259432 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-98cccd89-b52a-48ae-9d8a-ff3331deb4d4 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '454203f47b434cca952a1cef56de559f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7312d0ac9248f2bfbece5611913ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:10:28.264213 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-98cccd89-b52a-48ae-9d8a-ff3331deb4d4 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] 10.222.0.23 "GET /compute/v2.1/servers/96c829cb-4dde-467c-b50f-b2f666bdab0b" status: 200 len: 1322 microversion: 2.1 time: 0.262194 Oct 13 13:10:28.265139 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 34/77] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:10:28 2022] GET /compute/v2.1/servers/96c829cb-4dde-467c-b50f-b2f666bdab0b => generated 1322 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:10:28.429846 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-e5c107ae-e99a-42dd-a3a4-334406f18908 tempest-DeleteServersTestJSON-1957240839 tempest-DeleteServersTestJSON-1957240839-project] Calling method '>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:10:28.431498 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-e5c107ae-e99a-42dd-a3a4-334406f18908 tempest-DeleteServersTestJSON-1957240839 tempest-DeleteServersTestJSON-1957240839-project] [instance: dcd9bb33-bad5-4d93-ba0f-558c63746e29] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:10:28.440008 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-e5c107ae-e99a-42dd-a3a4-334406f18908 tempest-DeleteServersTestJSON-1957240839 tempest-DeleteServersTestJSON-1957240839-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:10:28.440883 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-e5c107ae-e99a-42dd-a3a4-334406f18908 tempest-DeleteServersTestJSON-1957240839 tempest-DeleteServersTestJSON-1957240839-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:10:28.441531 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-e5c107ae-e99a-42dd-a3a4-334406f18908 tempest-DeleteServersTestJSON-1957240839 tempest-DeleteServersTestJSON-1957240839-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:10:28.443023 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-e5c107ae-e99a-42dd-a3a4-334406f18908 tempest-DeleteServersTestJSON-1957240839 tempest-DeleteServersTestJSON-1957240839-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:10:28.443858 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-e5c107ae-e99a-42dd-a3a4-334406f18908 tempest-DeleteServersTestJSON-1957240839 tempest-DeleteServersTestJSON-1957240839-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:10:28.445016 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-e5c107ae-e99a-42dd-a3a4-334406f18908 tempest-DeleteServersTestJSON-1957240839 tempest-DeleteServersTestJSON-1957240839-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:10:28.629333 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-e5c107ae-e99a-42dd-a3a4-334406f18908 tempest-DeleteServersTestJSON-1957240839 tempest-DeleteServersTestJSON-1957240839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3a049e77aba470db21e26d1bc8caa80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6027a602300d4d2bbf33ac329b2960f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:10:28.640115 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-e5c107ae-e99a-42dd-a3a4-334406f18908 tempest-DeleteServersTestJSON-1957240839 tempest-DeleteServersTestJSON-1957240839-project] 10.222.0.23 "GET /compute/v2.1/servers/dcd9bb33-bad5-4d93-ba0f-558c63746e29" status: 200 len: 1315 microversion: 2.1 time: 0.219341 Oct 13 13:10:28.642425 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 44/78] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:10:28 2022] GET /compute/v2.1/servers/dcd9bb33-bad5-4d93-ba0f-558c63746e29 => generated 1315 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:10:28.763813 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-a4c1b5ab-5e93-48d3-955c-b02773a294bd tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Calling method '>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:10:28.767124 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-a4c1b5ab-5e93-48d3-955c-b02773a294bd tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] [instance: 26bd475b-3495-4669-9985-d4a7dedb4bbf] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:10:28.789271 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-a4c1b5ab-5e93-48d3-955c-b02773a294bd tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:10:28.790783 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-a4c1b5ab-5e93-48d3-955c-b02773a294bd tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:10:28.792288 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-a4c1b5ab-5e93-48d3-955c-b02773a294bd tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:10:28.795537 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-a4c1b5ab-5e93-48d3-955c-b02773a294bd tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:10:28.798971 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-a4c1b5ab-5e93-48d3-955c-b02773a294bd tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:10:28.802882 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-a4c1b5ab-5e93-48d3-955c-b02773a294bd tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:10:28.845378 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-c6f414d0-bbf4-4d68-801d-c623b05e9792 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Calling method '>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:10:28.846511 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-c6f414d0-bbf4-4d68-801d-c623b05e9792 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] [instance: e125ab44-9111-4260-909d-95d57b7861a7] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:10:28.854378 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-c6f414d0-bbf4-4d68-801d-c623b05e9792 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:10:28.856514 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-c6f414d0-bbf4-4d68-801d-c623b05e9792 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:10:28.857112 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-c6f414d0-bbf4-4d68-801d-c623b05e9792 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:10:28.860339 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-c6f414d0-bbf4-4d68-801d-c623b05e9792 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:10:28.860996 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-c6f414d0-bbf4-4d68-801d-c623b05e9792 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:10:28.861568 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-c6f414d0-bbf4-4d68-801d-c623b05e9792 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:10:29.288604 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-c6f414d0-bbf4-4d68-801d-c623b05e9792 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e783caddcad473dbdd764919286e244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecd3d5d2a3a54a07ba64f1fea4846c40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:10:29.303326 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-c6f414d0-bbf4-4d68-801d-c623b05e9792 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] 10.222.0.23 "GET /compute/v2.1/servers/e125ab44-9111-4260-909d-95d57b7861a7" status: 200 len: 1363 microversion: 2.1 time: 0.459323 Oct 13 13:10:29.304888 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 45/79] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:10:28 2022] GET /compute/v2.1/servers/e125ab44-9111-4260-909d-95d57b7861a7 => generated 1363 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:10:29.331724 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-4f1b3545-e8c8-4517-9125-3731a5d7d609 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Calling method '>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:10:29.333974 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-4f1b3545-e8c8-4517-9125-3731a5d7d609 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] [instance: 96c829cb-4dde-467c-b50f-b2f666bdab0b] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:10:29.345124 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-4f1b3545-e8c8-4517-9125-3731a5d7d609 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:10:29.345925 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-4f1b3545-e8c8-4517-9125-3731a5d7d609 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:10:29.346632 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-4f1b3545-e8c8-4517-9125-3731a5d7d609 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:10:29.348451 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-4f1b3545-e8c8-4517-9125-3731a5d7d609 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:10:29.349161 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-4f1b3545-e8c8-4517-9125-3731a5d7d609 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:10:29.350447 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-4f1b3545-e8c8-4517-9125-3731a5d7d609 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:10:29.473174 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-a4c1b5ab-5e93-48d3-955c-b02773a294bd tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:10:29.479601 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG dbcounter [-] [118815] Writing DB stats nova_cell1:SELECT=100 {{(pid=118815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:10:29.483885 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-a4c1b5ab-5e93-48d3-955c-b02773a294bd tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:10:29.493463 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-a4c1b5ab-5e93-48d3-955c-b02773a294bd tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:10:29.494648 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-a4c1b5ab-5e93-48d3-955c-b02773a294bd tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] 10.222.0.23 "GET /compute/v2.1/servers/26bd475b-3495-4669-9985-d4a7dedb4bbf" status: 200 len: 1407 microversion: 2.20 time: 0.744309 Oct 13 13:10:29.495244 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 35/80] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 13:10:28 2022] GET /compute/v2.1/servers/26bd475b-3495-4669-9985-d4a7dedb4bbf => generated 1407 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 13:10:29.667467 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-90329d2c-e4ef-4b49-9223-9f3954de0f4b tempest-DeleteServersTestJSON-1957240839 tempest-DeleteServersTestJSON-1957240839-project] Calling method '>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:10:29.668091 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-90329d2c-e4ef-4b49-9223-9f3954de0f4b tempest-DeleteServersTestJSON-1957240839 tempest-DeleteServersTestJSON-1957240839-project] [instance: dcd9bb33-bad5-4d93-ba0f-558c63746e29] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:10:29.671192 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG dbcounter [-] [118815] Writing DB stats nova_cell0:SELECT=24 {{(pid=118815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:10:29.696889 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-90329d2c-e4ef-4b49-9223-9f3954de0f4b tempest-DeleteServersTestJSON-1957240839 tempest-DeleteServersTestJSON-1957240839-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:10:29.697392 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-90329d2c-e4ef-4b49-9223-9f3954de0f4b tempest-DeleteServersTestJSON-1957240839 tempest-DeleteServersTestJSON-1957240839-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:10:29.716342 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-90329d2c-e4ef-4b49-9223-9f3954de0f4b tempest-DeleteServersTestJSON-1957240839 tempest-DeleteServersTestJSON-1957240839-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:10:29.719358 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-90329d2c-e4ef-4b49-9223-9f3954de0f4b tempest-DeleteServersTestJSON-1957240839 tempest-DeleteServersTestJSON-1957240839-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:10:29.721960 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-90329d2c-e4ef-4b49-9223-9f3954de0f4b tempest-DeleteServersTestJSON-1957240839 tempest-DeleteServersTestJSON-1957240839-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:10:29.723628 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-90329d2c-e4ef-4b49-9223-9f3954de0f4b tempest-DeleteServersTestJSON-1957240839 tempest-DeleteServersTestJSON-1957240839-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:10:30.081119 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-4f1b3545-e8c8-4517-9125-3731a5d7d609 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '454203f47b434cca952a1cef56de559f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7312d0ac9248f2bfbece5611913ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:10:30.094176 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-4f1b3545-e8c8-4517-9125-3731a5d7d609 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] 10.222.0.23 "GET /compute/v2.1/servers/96c829cb-4dde-467c-b50f-b2f666bdab0b" status: 200 len: 1322 microversion: 2.1 time: 0.767735 Oct 13 13:10:30.100981 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 46/81] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:10:29 2022] GET /compute/v2.1/servers/96c829cb-4dde-467c-b50f-b2f666bdab0b => generated 1322 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:10:30.184541 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [req-bf71d50f-4b2f-4ab7-bca4-ab64419cda07 req-55a92ce0-979d-4af4-a887-8750de582500 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "26bd475b-3495-4669-9985-d4a7dedb4bbf", "tag": "bd0eddba-ab0b-4c35-805b-853067734898"}]} {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 13:10:30.203611 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [req-bf71d50f-4b2f-4ab7-bca4-ab64419cda07 req-55a92ce0-979d-4af4-a887-8750de582500 service nova] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:10:30.205228 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [req-bf71d50f-4b2f-4ab7-bca4-ab64419cda07 req-55a92ce0-979d-4af4-a887-8750de582500 service nova] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:10:30.206766 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [req-bf71d50f-4b2f-4ab7-bca4-ab64419cda07 req-55a92ce0-979d-4af4-a887-8750de582500 service nova] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:10:30.219904 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG dbcounter [-] [118814] Writing DB stats nova_cell0:SELECT=22 {{(pid=118814) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:10:30.238749 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.compute.server_external_events [req-bf71d50f-4b2f-4ab7-bca4-ab64419cda07 req-55a92ce0-979d-4af4-a887-8750de582500 service nova] Creating event network-changed:bd0eddba-ab0b-4c35-805b-853067734898 for instance 26bd475b-3495-4669-9985-d4a7dedb4bbf on hv-cinder-82660 Oct 13 13:10:30.255170 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [req-bf71d50f-4b2f-4ab7-bca4-ab64419cda07 req-55a92ce0-979d-4af4-a887-8750de582500 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076431 Oct 13 13:10:30.260129 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 47/82] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 13:10:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 13:10:30.340788 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-21ec24c5-5874-4031-b401-e3486847fe18 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Calling method '>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:10:30.341964 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-21ec24c5-5874-4031-b401-e3486847fe18 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] [instance: e125ab44-9111-4260-909d-95d57b7861a7] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:10:30.355201 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-21ec24c5-5874-4031-b401-e3486847fe18 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:10:30.357067 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-21ec24c5-5874-4031-b401-e3486847fe18 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:10:30.359732 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-21ec24c5-5874-4031-b401-e3486847fe18 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:10:30.362139 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-21ec24c5-5874-4031-b401-e3486847fe18 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:10:30.364098 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-21ec24c5-5874-4031-b401-e3486847fe18 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:10:30.364957 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-21ec24c5-5874-4031-b401-e3486847fe18 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:10:30.495722 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-90329d2c-e4ef-4b49-9223-9f3954de0f4b tempest-DeleteServersTestJSON-1957240839 tempest-DeleteServersTestJSON-1957240839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3a049e77aba470db21e26d1bc8caa80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6027a602300d4d2bbf33ac329b2960f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:10:30.508149 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-90329d2c-e4ef-4b49-9223-9f3954de0f4b tempest-DeleteServersTestJSON-1957240839 tempest-DeleteServersTestJSON-1957240839-project] 10.222.0.23 "GET /compute/v2.1/servers/dcd9bb33-bad5-4d93-ba0f-558c63746e29" status: 200 len: 1315 microversion: 2.1 time: 0.843436 Oct 13 13:10:30.526107 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 36/83] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:10:29 2022] GET /compute/v2.1/servers/dcd9bb33-bad5-4d93-ba0f-558c63746e29 => generated 1315 bytes in 864 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:10:30.532044 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-9ff0caaf-5cae-494a-a717-24845b7661a3 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Calling method '>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:10:30.532842 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-9ff0caaf-5cae-494a-a717-24845b7661a3 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] [instance: 26bd475b-3495-4669-9985-d4a7dedb4bbf] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:10:30.540715 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-9ff0caaf-5cae-494a-a717-24845b7661a3 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:10:30.541538 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-9ff0caaf-5cae-494a-a717-24845b7661a3 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:10:30.542204 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-9ff0caaf-5cae-494a-a717-24845b7661a3 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:10:30.543124 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-9ff0caaf-5cae-494a-a717-24845b7661a3 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:10:30.543773 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-9ff0caaf-5cae-494a-a717-24845b7661a3 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:10:30.544400 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-9ff0caaf-5cae-494a-a717-24845b7661a3 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:10:30.684605 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-21ec24c5-5874-4031-b401-e3486847fe18 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e783caddcad473dbdd764919286e244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecd3d5d2a3a54a07ba64f1fea4846c40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:10:30.693257 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-21ec24c5-5874-4031-b401-e3486847fe18 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] 10.222.0.23 "GET /compute/v2.1/servers/e125ab44-9111-4260-909d-95d57b7861a7" status: 200 len: 1363 microversion: 2.1 time: 0.364415 Oct 13 13:10:30.694111 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 48/84] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:10:30 2022] GET /compute/v2.1/servers/e125ab44-9111-4260-909d-95d57b7861a7 => generated 1363 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:10:30.737570 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-9ff0caaf-5cae-494a-a717-24845b7661a3 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:10:30.747030 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-9ff0caaf-5cae-494a-a717-24845b7661a3 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:10:30.748563 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-9ff0caaf-5cae-494a-a717-24845b7661a3 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:10:30.749914 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-9ff0caaf-5cae-494a-a717-24845b7661a3 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] 10.222.0.23 "GET /compute/v2.1/servers/26bd475b-3495-4669-9985-d4a7dedb4bbf" status: 200 len: 1407 microversion: 2.20 time: 0.221677 Oct 13 13:10:30.750629 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 37/85] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 13:10:30 2022] GET /compute/v2.1/servers/26bd475b-3495-4669-9985-d4a7dedb4bbf => generated 1407 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 13:10:31.126072 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-4a594ddf-5db2-45cf-83e9-8396e485ff76 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Calling method '>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:10:31.126567 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-4a594ddf-5db2-45cf-83e9-8396e485ff76 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] [instance: 96c829cb-4dde-467c-b50f-b2f666bdab0b] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:10:31.141487 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-4a594ddf-5db2-45cf-83e9-8396e485ff76 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:10:31.141983 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-4a594ddf-5db2-45cf-83e9-8396e485ff76 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:10:31.142519 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-4a594ddf-5db2-45cf-83e9-8396e485ff76 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:10:31.143140 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-4a594ddf-5db2-45cf-83e9-8396e485ff76 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:10:31.143584 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-4a594ddf-5db2-45cf-83e9-8396e485ff76 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:10:31.147295 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-4a594ddf-5db2-45cf-83e9-8396e485ff76 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:10:31.531295 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-0d0599c5-27f6-4b0b-a575-55c840bc9db4 tempest-DeleteServersTestJSON-1957240839 tempest-DeleteServersTestJSON-1957240839-project] Calling method '>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:10:31.532489 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-0d0599c5-27f6-4b0b-a575-55c840bc9db4 tempest-DeleteServersTestJSON-1957240839 tempest-DeleteServersTestJSON-1957240839-project] [instance: dcd9bb33-bad5-4d93-ba0f-558c63746e29] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:10:31.541429 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG dbcounter [-] [118815] Writing DB stats nova_cell0:SELECT=8 {{(pid=118815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:10:31.543885 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-0d0599c5-27f6-4b0b-a575-55c840bc9db4 tempest-DeleteServersTestJSON-1957240839 tempest-DeleteServersTestJSON-1957240839-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:10:31.551172 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-0d0599c5-27f6-4b0b-a575-55c840bc9db4 tempest-DeleteServersTestJSON-1957240839 tempest-DeleteServersTestJSON-1957240839-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:10:31.551959 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-0d0599c5-27f6-4b0b-a575-55c840bc9db4 tempest-DeleteServersTestJSON-1957240839 tempest-DeleteServersTestJSON-1957240839-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:10:31.554113 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-0d0599c5-27f6-4b0b-a575-55c840bc9db4 tempest-DeleteServersTestJSON-1957240839 tempest-DeleteServersTestJSON-1957240839-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:10:31.558175 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-0d0599c5-27f6-4b0b-a575-55c840bc9db4 tempest-DeleteServersTestJSON-1957240839 tempest-DeleteServersTestJSON-1957240839-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:10:31.558794 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-0d0599c5-27f6-4b0b-a575-55c840bc9db4 tempest-DeleteServersTestJSON-1957240839 tempest-DeleteServersTestJSON-1957240839-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:10:31.778728 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-4a594ddf-5db2-45cf-83e9-8396e485ff76 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '454203f47b434cca952a1cef56de559f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7312d0ac9248f2bfbece5611913ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:10:31.788005 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-4a594ddf-5db2-45cf-83e9-8396e485ff76 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] 10.222.0.23 "GET /compute/v2.1/servers/96c829cb-4dde-467c-b50f-b2f666bdab0b" status: 200 len: 1322 microversion: 2.1 time: 0.666089 Oct 13 13:10:31.805718 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 49/86] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:10:31 2022] GET /compute/v2.1/servers/96c829cb-4dde-467c-b50f-b2f666bdab0b => generated 1322 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:10:31.810538 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-62d3da33-2f55-48c4-9a17-91cc965bb253 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Calling method '>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:10:31.818099 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-62d3da33-2f55-48c4-9a17-91cc965bb253 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] [instance: e125ab44-9111-4260-909d-95d57b7861a7] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:10:31.829851 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-62d3da33-2f55-48c4-9a17-91cc965bb253 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:10:31.830676 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-62d3da33-2f55-48c4-9a17-91cc965bb253 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:10:31.831346 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-62d3da33-2f55-48c4-9a17-91cc965bb253 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:10:31.832297 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-62d3da33-2f55-48c4-9a17-91cc965bb253 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:10:31.832960 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-62d3da33-2f55-48c4-9a17-91cc965bb253 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:10:31.833583 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-62d3da33-2f55-48c4-9a17-91cc965bb253 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:10:32.075923 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-0d0599c5-27f6-4b0b-a575-55c840bc9db4 tempest-DeleteServersTestJSON-1957240839 tempest-DeleteServersTestJSON-1957240839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3a049e77aba470db21e26d1bc8caa80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6027a602300d4d2bbf33ac329b2960f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:10:32.091801 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-0d0599c5-27f6-4b0b-a575-55c840bc9db4 tempest-DeleteServersTestJSON-1957240839 tempest-DeleteServersTestJSON-1957240839-project] 10.222.0.23 "GET /compute/v2.1/servers/dcd9bb33-bad5-4d93-ba0f-558c63746e29" status: 200 len: 1315 microversion: 2.1 time: 0.565702 Oct 13 13:10:32.093682 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 38/87] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:10:31 2022] GET /compute/v2.1/servers/dcd9bb33-bad5-4d93-ba0f-558c63746e29 => generated 1315 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 13:10:32.109677 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-8a2c4acb-57c8-4f4b-b487-281fc89d1663 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Calling method '>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:10:32.111787 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-8a2c4acb-57c8-4f4b-b487-281fc89d1663 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] [instance: 26bd475b-3495-4669-9985-d4a7dedb4bbf] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:10:32.142000 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-8a2c4acb-57c8-4f4b-b487-281fc89d1663 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:10:32.147162 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-8a2c4acb-57c8-4f4b-b487-281fc89d1663 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:10:32.147947 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-62d3da33-2f55-48c4-9a17-91cc965bb253 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e783caddcad473dbdd764919286e244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecd3d5d2a3a54a07ba64f1fea4846c40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:10:32.150824 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-8a2c4acb-57c8-4f4b-b487-281fc89d1663 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:10:32.160459 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-62d3da33-2f55-48c4-9a17-91cc965bb253 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] 10.222.0.23 "GET /compute/v2.1/servers/e125ab44-9111-4260-909d-95d57b7861a7" status: 200 len: 1363 microversion: 2.1 time: 0.353079 Oct 13 13:10:32.162352 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 50/88] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:10:31 2022] GET /compute/v2.1/servers/e125ab44-9111-4260-909d-95d57b7861a7 => generated 1363 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:10:32.168077 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-8a2c4acb-57c8-4f4b-b487-281fc89d1663 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:10:32.168751 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-8a2c4acb-57c8-4f4b-b487-281fc89d1663 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:10:32.169216 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-8a2c4acb-57c8-4f4b-b487-281fc89d1663 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:10:32.395400 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-8a2c4acb-57c8-4f4b-b487-281fc89d1663 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:10:32.404862 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-8a2c4acb-57c8-4f4b-b487-281fc89d1663 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:10:32.407325 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-8a2c4acb-57c8-4f4b-b487-281fc89d1663 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:10:32.408454 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-8a2c4acb-57c8-4f4b-b487-281fc89d1663 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] 10.222.0.23 "GET /compute/v2.1/servers/26bd475b-3495-4669-9985-d4a7dedb4bbf" status: 200 len: 1407 microversion: 2.20 time: 0.313546 Oct 13 13:10:32.409061 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 39/89] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 13:10:32 2022] GET /compute/v2.1/servers/26bd475b-3495-4669-9985-d4a7dedb4bbf => generated 1407 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 13:10:32.450504 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [req-bd9c7cce-a6b2-4e37-a8cd-65f95b684259 req-2df19dd2-7b48-4600-a2f3-bcc1def0481b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dcd9bb33-bad5-4d93-ba0f-558c63746e29", "name": "network-vif-plugged", "status": "completed", "tag": "56f9f92a-e0d4-4a2d-b2f3-734fabaf36a0"}]} {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 13:10:32.460185 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [req-bd9c7cce-a6b2-4e37-a8cd-65f95b684259 req-2df19dd2-7b48-4600-a2f3-bcc1def0481b service nova] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:10:32.460888 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [req-bd9c7cce-a6b2-4e37-a8cd-65f95b684259 req-2df19dd2-7b48-4600-a2f3-bcc1def0481b service nova] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:10:32.461486 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [req-bd9c7cce-a6b2-4e37-a8cd-65f95b684259 req-2df19dd2-7b48-4600-a2f3-bcc1def0481b service nova] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:10:32.479268 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.compute.server_external_events [req-bd9c7cce-a6b2-4e37-a8cd-65f95b684259 req-2df19dd2-7b48-4600-a2f3-bcc1def0481b service nova] Creating event network-vif-plugged:56f9f92a-e0d4-4a2d-b2f3-734fabaf36a0 for instance dcd9bb33-bad5-4d93-ba0f-558c63746e29 on hv-cinder-82660 Oct 13 13:10:32.484341 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [req-bd9c7cce-a6b2-4e37-a8cd-65f95b684259 req-2df19dd2-7b48-4600-a2f3-bcc1def0481b service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.115888 Oct 13 13:10:32.485032 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 51/90] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 13:10:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 13 13:10:32.819509 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-c0dcc558-cd1f-4405-968d-28ec8cbdb199 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Calling method '>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:10:32.820194 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-c0dcc558-cd1f-4405-968d-28ec8cbdb199 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] [instance: 96c829cb-4dde-467c-b50f-b2f666bdab0b] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:10:32.826288 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-c0dcc558-cd1f-4405-968d-28ec8cbdb199 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:10:32.826787 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-c0dcc558-cd1f-4405-968d-28ec8cbdb199 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:10:32.827283 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-c0dcc558-cd1f-4405-968d-28ec8cbdb199 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:10:32.827983 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-c0dcc558-cd1f-4405-968d-28ec8cbdb199 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:10:32.828446 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-c0dcc558-cd1f-4405-968d-28ec8cbdb199 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:10:32.829007 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-c0dcc558-cd1f-4405-968d-28ec8cbdb199 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:10:32.987843 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-c0dcc558-cd1f-4405-968d-28ec8cbdb199 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '454203f47b434cca952a1cef56de559f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7312d0ac9248f2bfbece5611913ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:10:32.998826 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-c0dcc558-cd1f-4405-968d-28ec8cbdb199 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] 10.222.0.23 "GET /compute/v2.1/servers/96c829cb-4dde-467c-b50f-b2f666bdab0b" status: 200 len: 1322 microversion: 2.1 time: 0.183396 Oct 13 13:10:33.014361 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 40/91] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:10:32 2022] GET /compute/v2.1/servers/96c829cb-4dde-467c-b50f-b2f666bdab0b => generated 1322 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:10:33.120753 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-6b12f16f-4160-4d16-9c23-066c775d55fd tempest-DeleteServersTestJSON-1957240839 tempest-DeleteServersTestJSON-1957240839-project] Calling method '>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:10:33.121602 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-6b12f16f-4160-4d16-9c23-066c775d55fd tempest-DeleteServersTestJSON-1957240839 tempest-DeleteServersTestJSON-1957240839-project] [instance: dcd9bb33-bad5-4d93-ba0f-558c63746e29] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:10:33.128005 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-6b12f16f-4160-4d16-9c23-066c775d55fd tempest-DeleteServersTestJSON-1957240839 tempest-DeleteServersTestJSON-1957240839-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:10:33.128699 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-6b12f16f-4160-4d16-9c23-066c775d55fd tempest-DeleteServersTestJSON-1957240839 tempest-DeleteServersTestJSON-1957240839-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:10:33.129204 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-6b12f16f-4160-4d16-9c23-066c775d55fd tempest-DeleteServersTestJSON-1957240839 tempest-DeleteServersTestJSON-1957240839-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:10:33.129966 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-6b12f16f-4160-4d16-9c23-066c775d55fd tempest-DeleteServersTestJSON-1957240839 tempest-DeleteServersTestJSON-1957240839-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:10:33.130493 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-6b12f16f-4160-4d16-9c23-066c775d55fd tempest-DeleteServersTestJSON-1957240839 tempest-DeleteServersTestJSON-1957240839-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:10:33.130987 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-6b12f16f-4160-4d16-9c23-066c775d55fd tempest-DeleteServersTestJSON-1957240839 tempest-DeleteServersTestJSON-1957240839-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:10:33.186682 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-7adba6b5-6839-4e73-9182-645cce114a18 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Calling method '>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:10:33.187336 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-7adba6b5-6839-4e73-9182-645cce114a18 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] [instance: e125ab44-9111-4260-909d-95d57b7861a7] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:10:33.193677 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-7adba6b5-6839-4e73-9182-645cce114a18 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:10:33.195221 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-7adba6b5-6839-4e73-9182-645cce114a18 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:10:33.196334 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-7adba6b5-6839-4e73-9182-645cce114a18 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:10:33.197113 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-7adba6b5-6839-4e73-9182-645cce114a18 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:10:33.197786 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-7adba6b5-6839-4e73-9182-645cce114a18 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:10:33.198598 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-7adba6b5-6839-4e73-9182-645cce114a18 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:10:33.315396 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-6b12f16f-4160-4d16-9c23-066c775d55fd tempest-DeleteServersTestJSON-1957240839 tempest-DeleteServersTestJSON-1957240839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3a049e77aba470db21e26d1bc8caa80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6027a602300d4d2bbf33ac329b2960f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:10:33.344623 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-6b12f16f-4160-4d16-9c23-066c775d55fd tempest-DeleteServersTestJSON-1957240839 tempest-DeleteServersTestJSON-1957240839-project] 10.222.0.23 "GET /compute/v2.1/servers/dcd9bb33-bad5-4d93-ba0f-558c63746e29" status: 200 len: 1315 microversion: 2.1 time: 0.229097 Oct 13 13:10:33.353488 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 52/92] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:10:33 2022] GET /compute/v2.1/servers/dcd9bb33-bad5-4d93-ba0f-558c63746e29 => generated 1315 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:10:33.369218 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-7adba6b5-6839-4e73-9182-645cce114a18 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e783caddcad473dbdd764919286e244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecd3d5d2a3a54a07ba64f1fea4846c40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:10:33.376905 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-7adba6b5-6839-4e73-9182-645cce114a18 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] 10.222.0.23 "GET /compute/v2.1/servers/e125ab44-9111-4260-909d-95d57b7861a7" status: 200 len: 1363 microversion: 2.1 time: 0.194078 Oct 13 13:10:33.377478 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 41/93] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:10:33 2022] GET /compute/v2.1/servers/e125ab44-9111-4260-909d-95d57b7861a7 => generated 1363 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:10:33.433809 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-d3a3f436-5bdb-4cbc-a2e9-d1faf3d654c7 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Calling method '>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:10:33.434422 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-d3a3f436-5bdb-4cbc-a2e9-d1faf3d654c7 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] [instance: 26bd475b-3495-4669-9985-d4a7dedb4bbf] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:10:33.442002 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-d3a3f436-5bdb-4cbc-a2e9-d1faf3d654c7 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:10:33.442002 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-d3a3f436-5bdb-4cbc-a2e9-d1faf3d654c7 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:10:33.442002 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-d3a3f436-5bdb-4cbc-a2e9-d1faf3d654c7 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:10:33.442412 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-d3a3f436-5bdb-4cbc-a2e9-d1faf3d654c7 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:10:33.442956 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-d3a3f436-5bdb-4cbc-a2e9-d1faf3d654c7 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:10:33.443182 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-d3a3f436-5bdb-4cbc-a2e9-d1faf3d654c7 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:10:33.579530 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-d3a3f436-5bdb-4cbc-a2e9-d1faf3d654c7 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:10:33.588502 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-d3a3f436-5bdb-4cbc-a2e9-d1faf3d654c7 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:10:33.589948 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-d3a3f436-5bdb-4cbc-a2e9-d1faf3d654c7 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:10:33.591084 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-d3a3f436-5bdb-4cbc-a2e9-d1faf3d654c7 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] 10.222.0.23 "GET /compute/v2.1/servers/26bd475b-3495-4669-9985-d4a7dedb4bbf" status: 200 len: 1407 microversion: 2.20 time: 0.161177 Oct 13 13:10:33.591645 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 53/94] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 13:10:33 2022] GET /compute/v2.1/servers/26bd475b-3495-4669-9985-d4a7dedb4bbf => generated 1407 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 13:10:34.021258 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-128623de-efb9-40dc-ab26-ed0944bc71b2 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Calling method '>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:10:34.021935 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-128623de-efb9-40dc-ab26-ed0944bc71b2 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] [instance: 96c829cb-4dde-467c-b50f-b2f666bdab0b] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:10:34.028030 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-128623de-efb9-40dc-ab26-ed0944bc71b2 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:10:34.028517 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-128623de-efb9-40dc-ab26-ed0944bc71b2 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:10:34.028960 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-128623de-efb9-40dc-ab26-ed0944bc71b2 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:10:34.029651 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-128623de-efb9-40dc-ab26-ed0944bc71b2 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:10:34.030115 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-128623de-efb9-40dc-ab26-ed0944bc71b2 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:10:34.030539 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-128623de-efb9-40dc-ab26-ed0944bc71b2 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:10:34.169441 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-128623de-efb9-40dc-ab26-ed0944bc71b2 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '454203f47b434cca952a1cef56de559f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7312d0ac9248f2bfbece5611913ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:10:34.177995 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-128623de-efb9-40dc-ab26-ed0944bc71b2 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] 10.222.0.23 "GET /compute/v2.1/servers/96c829cb-4dde-467c-b50f-b2f666bdab0b" status: 200 len: 1322 microversion: 2.1 time: 0.160453 Oct 13 13:10:34.178914 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 42/95] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:10:34 2022] GET /compute/v2.1/servers/96c829cb-4dde-467c-b50f-b2f666bdab0b => generated 1322 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:10:34.368402 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-0776fbab-8efc-416b-b295-a3352a0d11b1 tempest-DeleteServersTestJSON-1957240839 tempest-DeleteServersTestJSON-1957240839-project] Calling method '>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:10:34.369006 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-0776fbab-8efc-416b-b295-a3352a0d11b1 tempest-DeleteServersTestJSON-1957240839 tempest-DeleteServersTestJSON-1957240839-project] [instance: dcd9bb33-bad5-4d93-ba0f-558c63746e29] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:10:34.371344 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG dbcounter [-] [118814] Writing DB stats nova_cell0:SELECT=2 {{(pid=118814) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:10:34.376782 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-0776fbab-8efc-416b-b295-a3352a0d11b1 tempest-DeleteServersTestJSON-1957240839 tempest-DeleteServersTestJSON-1957240839-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:10:34.377252 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-0776fbab-8efc-416b-b295-a3352a0d11b1 tempest-DeleteServersTestJSON-1957240839 tempest-DeleteServersTestJSON-1957240839-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:10:34.377845 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-0776fbab-8efc-416b-b295-a3352a0d11b1 tempest-DeleteServersTestJSON-1957240839 tempest-DeleteServersTestJSON-1957240839-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:10:34.378551 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-0776fbab-8efc-416b-b295-a3352a0d11b1 tempest-DeleteServersTestJSON-1957240839 tempest-DeleteServersTestJSON-1957240839-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:10:34.379008 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-0776fbab-8efc-416b-b295-a3352a0d11b1 tempest-DeleteServersTestJSON-1957240839 tempest-DeleteServersTestJSON-1957240839-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:10:34.379525 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-0776fbab-8efc-416b-b295-a3352a0d11b1 tempest-DeleteServersTestJSON-1957240839 tempest-DeleteServersTestJSON-1957240839-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:10:34.400299 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-e1af4133-ffd7-4685-a220-2c766a9e0554 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Calling method '>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:10:34.401231 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-e1af4133-ffd7-4685-a220-2c766a9e0554 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] [instance: e125ab44-9111-4260-909d-95d57b7861a7] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:10:34.407570 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-e1af4133-ffd7-4685-a220-2c766a9e0554 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:10:34.407980 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-e1af4133-ffd7-4685-a220-2c766a9e0554 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:10:34.408483 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-e1af4133-ffd7-4685-a220-2c766a9e0554 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:10:34.409173 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-e1af4133-ffd7-4685-a220-2c766a9e0554 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:10:34.409628 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-e1af4133-ffd7-4685-a220-2c766a9e0554 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:10:34.410049 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-e1af4133-ffd7-4685-a220-2c766a9e0554 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:10:34.577569 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-0776fbab-8efc-416b-b295-a3352a0d11b1 tempest-DeleteServersTestJSON-1957240839 tempest-DeleteServersTestJSON-1957240839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3a049e77aba470db21e26d1bc8caa80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6027a602300d4d2bbf33ac329b2960f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:10:34.580404 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-e1af4133-ffd7-4685-a220-2c766a9e0554 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e783caddcad473dbdd764919286e244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecd3d5d2a3a54a07ba64f1fea4846c40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:10:34.585900 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-0776fbab-8efc-416b-b295-a3352a0d11b1 tempest-DeleteServersTestJSON-1957240839 tempest-DeleteServersTestJSON-1957240839-project] 10.222.0.23 "GET /compute/v2.1/servers/dcd9bb33-bad5-4d93-ba0f-558c63746e29" status: 200 len: 1315 microversion: 2.1 time: 0.221858 Oct 13 13:10:34.586531 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 54/96] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:10:34 2022] GET /compute/v2.1/servers/dcd9bb33-bad5-4d93-ba0f-558c63746e29 => generated 1315 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 13:10:34.588178 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-e1af4133-ffd7-4685-a220-2c766a9e0554 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] 10.222.0.23 "GET /compute/v2.1/servers/e125ab44-9111-4260-909d-95d57b7861a7" status: 200 len: 1363 microversion: 2.1 time: 0.191854 Oct 13 13:10:34.588932 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 43/97] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:10:34 2022] GET /compute/v2.1/servers/e125ab44-9111-4260-909d-95d57b7861a7 => generated 1363 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 13:10:34.590990 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [req-63ebdd1c-0cf2-4028-bbab-b6452c8df85d req-218cf144-42af-48a8-b47e-2ba3ae49e9bf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e125ab44-9111-4260-909d-95d57b7861a7", "name": "network-vif-plugged", "status": "completed", "tag": "95c8323b-318e-4698-a732-2714f447a0ff"}]} {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 13:10:34.600325 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [req-63ebdd1c-0cf2-4028-bbab-b6452c8df85d req-218cf144-42af-48a8-b47e-2ba3ae49e9bf service nova] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:10:34.600799 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [req-63ebdd1c-0cf2-4028-bbab-b6452c8df85d req-218cf144-42af-48a8-b47e-2ba3ae49e9bf service nova] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:10:34.601229 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [req-63ebdd1c-0cf2-4028-bbab-b6452c8df85d req-218cf144-42af-48a8-b47e-2ba3ae49e9bf service nova] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:10:34.612750 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.compute.server_external_events [req-63ebdd1c-0cf2-4028-bbab-b6452c8df85d req-218cf144-42af-48a8-b47e-2ba3ae49e9bf service nova] Creating event network-vif-plugged:95c8323b-318e-4698-a732-2714f447a0ff for instance e125ab44-9111-4260-909d-95d57b7861a7 on hv-cinder-82660 Oct 13 13:10:34.616414 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-d81de868-4935-4e0a-af29-de3daff6320c tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Calling method '>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:10:34.617312 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-d81de868-4935-4e0a-af29-de3daff6320c tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] [instance: 26bd475b-3495-4669-9985-d4a7dedb4bbf] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:10:34.618169 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [req-63ebdd1c-0cf2-4028-bbab-b6452c8df85d req-218cf144-42af-48a8-b47e-2ba3ae49e9bf service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029882 Oct 13 13:10:34.618746 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 55/98] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 13:10:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 13:10:34.623966 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-d81de868-4935-4e0a-af29-de3daff6320c tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:10:34.624437 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-d81de868-4935-4e0a-af29-de3daff6320c tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:10:34.624866 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-d81de868-4935-4e0a-af29-de3daff6320c tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:10:34.625544 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-d81de868-4935-4e0a-af29-de3daff6320c tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:10:34.625987 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-d81de868-4935-4e0a-af29-de3daff6320c tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:10:34.626402 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-d81de868-4935-4e0a-af29-de3daff6320c tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:10:34.753846 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-d81de868-4935-4e0a-af29-de3daff6320c tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:10:34.761708 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-d81de868-4935-4e0a-af29-de3daff6320c tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:10:34.763169 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-d81de868-4935-4e0a-af29-de3daff6320c tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:10:34.764264 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-d81de868-4935-4e0a-af29-de3daff6320c tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] 10.222.0.23 "GET /compute/v2.1/servers/26bd475b-3495-4669-9985-d4a7dedb4bbf" status: 200 len: 1407 microversion: 2.20 time: 0.152485 Oct 13 13:10:34.764817 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 44/99] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 13:10:34 2022] GET /compute/v2.1/servers/26bd475b-3495-4669-9985-d4a7dedb4bbf => generated 1407 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 13 13:10:35.202471 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-0335b439-8c70-4474-802e-fc0b65fd9e09 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Calling method '>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:10:35.203207 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-0335b439-8c70-4474-802e-fc0b65fd9e09 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] [instance: 96c829cb-4dde-467c-b50f-b2f666bdab0b] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:10:35.209560 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-0335b439-8c70-4474-802e-fc0b65fd9e09 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:10:35.210050 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-0335b439-8c70-4474-802e-fc0b65fd9e09 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:10:35.210488 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-0335b439-8c70-4474-802e-fc0b65fd9e09 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:10:35.211851 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-0335b439-8c70-4474-802e-fc0b65fd9e09 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:10:35.212314 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-0335b439-8c70-4474-802e-fc0b65fd9e09 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:10:35.212744 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-0335b439-8c70-4474-802e-fc0b65fd9e09 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:10:35.216787 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG dbcounter [-] [118814] Writing DB stats nova_cell1:SELECT=100 {{(pid=118814) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:10:35.341848 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-0335b439-8c70-4474-802e-fc0b65fd9e09 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '454203f47b434cca952a1cef56de559f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7312d0ac9248f2bfbece5611913ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:10:35.349449 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-0335b439-8c70-4474-802e-fc0b65fd9e09 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] 10.222.0.23 "GET /compute/v2.1/servers/96c829cb-4dde-467c-b50f-b2f666bdab0b" status: 200 len: 1322 microversion: 2.1 time: 0.151189 Oct 13 13:10:35.350005 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 56/100] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:10:35 2022] GET /compute/v2.1/servers/96c829cb-4dde-467c-b50f-b2f666bdab0b => generated 1322 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:10:35.610712 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-285485ae-8244-4e4f-afed-3e5383a93e36 tempest-DeleteServersTestJSON-1957240839 tempest-DeleteServersTestJSON-1957240839-project] Calling method '>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:10:35.611357 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-285485ae-8244-4e4f-afed-3e5383a93e36 tempest-DeleteServersTestJSON-1957240839 tempest-DeleteServersTestJSON-1957240839-project] [instance: dcd9bb33-bad5-4d93-ba0f-558c63746e29] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:10:35.614734 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-f4e85fdc-58f1-46bc-bd41-cb15f1930cce tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Calling method '>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:10:35.616153 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-f4e85fdc-58f1-46bc-bd41-cb15f1930cce tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] [instance: e125ab44-9111-4260-909d-95d57b7861a7] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:10:35.625132 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-f4e85fdc-58f1-46bc-bd41-cb15f1930cce tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:10:35.626150 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-f4e85fdc-58f1-46bc-bd41-cb15f1930cce tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:10:35.627088 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-f4e85fdc-58f1-46bc-bd41-cb15f1930cce tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:10:35.628815 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-f4e85fdc-58f1-46bc-bd41-cb15f1930cce tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:10:35.629442 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-285485ae-8244-4e4f-afed-3e5383a93e36 tempest-DeleteServersTestJSON-1957240839 tempest-DeleteServersTestJSON-1957240839-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:10:35.629981 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-285485ae-8244-4e4f-afed-3e5383a93e36 tempest-DeleteServersTestJSON-1957240839 tempest-DeleteServersTestJSON-1957240839-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:10:35.630086 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-f4e85fdc-58f1-46bc-bd41-cb15f1930cce tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:10:35.630413 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-285485ae-8244-4e4f-afed-3e5383a93e36 tempest-DeleteServersTestJSON-1957240839 tempest-DeleteServersTestJSON-1957240839-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:10:35.631592 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-f4e85fdc-58f1-46bc-bd41-cb15f1930cce tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:10:35.644087 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-285485ae-8244-4e4f-afed-3e5383a93e36 tempest-DeleteServersTestJSON-1957240839 tempest-DeleteServersTestJSON-1957240839-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:10:35.644775 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-285485ae-8244-4e4f-afed-3e5383a93e36 tempest-DeleteServersTestJSON-1957240839 tempest-DeleteServersTestJSON-1957240839-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:10:35.645233 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-285485ae-8244-4e4f-afed-3e5383a93e36 tempest-DeleteServersTestJSON-1957240839 tempest-DeleteServersTestJSON-1957240839-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:10:35.945057 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-f4e85fdc-58f1-46bc-bd41-cb15f1930cce tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e783caddcad473dbdd764919286e244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecd3d5d2a3a54a07ba64f1fea4846c40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:10:35.949571 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-285485ae-8244-4e4f-afed-3e5383a93e36 tempest-DeleteServersTestJSON-1957240839 tempest-DeleteServersTestJSON-1957240839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3a049e77aba470db21e26d1bc8caa80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6027a602300d4d2bbf33ac329b2960f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:10:35.953496 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-f4e85fdc-58f1-46bc-bd41-cb15f1930cce tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] 10.222.0.23 "GET /compute/v2.1/servers/e125ab44-9111-4260-909d-95d57b7861a7" status: 200 len: 1363 microversion: 2.1 time: 0.345312 Oct 13 13:10:35.954155 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 57/101] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:10:35 2022] GET /compute/v2.1/servers/e125ab44-9111-4260-909d-95d57b7861a7 => generated 1363 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:10:35.958605 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-285485ae-8244-4e4f-afed-3e5383a93e36 tempest-DeleteServersTestJSON-1957240839 tempest-DeleteServersTestJSON-1957240839-project] 10.222.0.23 "GET /compute/v2.1/servers/dcd9bb33-bad5-4d93-ba0f-558c63746e29" status: 200 len: 1315 microversion: 2.1 time: 0.353721 Oct 13 13:10:35.959210 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 45/102] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:10:35 2022] GET /compute/v2.1/servers/dcd9bb33-bad5-4d93-ba0f-558c63746e29 => generated 1315 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:10:35.959489 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-c9e3bb83-89a0-4a8b-ae24-f7ce1e8dba1a tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Calling method '>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:10:35.960267 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-c9e3bb83-89a0-4a8b-ae24-f7ce1e8dba1a tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] [instance: 26bd475b-3495-4669-9985-d4a7dedb4bbf] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:10:35.966323 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-c9e3bb83-89a0-4a8b-ae24-f7ce1e8dba1a tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:10:35.966815 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-c9e3bb83-89a0-4a8b-ae24-f7ce1e8dba1a tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:10:35.967282 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-c9e3bb83-89a0-4a8b-ae24-f7ce1e8dba1a tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:10:35.967978 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-c9e3bb83-89a0-4a8b-ae24-f7ce1e8dba1a tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:10:35.968425 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-c9e3bb83-89a0-4a8b-ae24-f7ce1e8dba1a tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:10:35.968844 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-c9e3bb83-89a0-4a8b-ae24-f7ce1e8dba1a tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:10:36.104655 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-c9e3bb83-89a0-4a8b-ae24-f7ce1e8dba1a tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:10:36.112872 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-c9e3bb83-89a0-4a8b-ae24-f7ce1e8dba1a tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:10:36.114321 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-c9e3bb83-89a0-4a8b-ae24-f7ce1e8dba1a tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:10:36.115494 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-c9e3bb83-89a0-4a8b-ae24-f7ce1e8dba1a tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] 10.222.0.23 "GET /compute/v2.1/servers/26bd475b-3495-4669-9985-d4a7dedb4bbf" status: 200 len: 1407 microversion: 2.20 time: 0.160156 Oct 13 13:10:36.116051 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 58/103] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 13:10:35 2022] GET /compute/v2.1/servers/26bd475b-3495-4669-9985-d4a7dedb4bbf => generated 1407 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 13:10:36.371706 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-6ac0389b-aa32-423c-bbae-6788d54b0fd5 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Calling method '>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:10:36.372316 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-6ac0389b-aa32-423c-bbae-6788d54b0fd5 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] [instance: 96c829cb-4dde-467c-b50f-b2f666bdab0b] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:10:36.378257 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-6ac0389b-aa32-423c-bbae-6788d54b0fd5 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:10:36.378740 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-6ac0389b-aa32-423c-bbae-6788d54b0fd5 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:10:36.379205 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-6ac0389b-aa32-423c-bbae-6788d54b0fd5 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:10:36.379886 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-6ac0389b-aa32-423c-bbae-6788d54b0fd5 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:10:36.380337 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-6ac0389b-aa32-423c-bbae-6788d54b0fd5 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:10:36.380756 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-6ac0389b-aa32-423c-bbae-6788d54b0fd5 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:10:36.509198 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-6ac0389b-aa32-423c-bbae-6788d54b0fd5 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '454203f47b434cca952a1cef56de559f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7312d0ac9248f2bfbece5611913ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:10:36.517122 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-6ac0389b-aa32-423c-bbae-6788d54b0fd5 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] 10.222.0.23 "GET /compute/v2.1/servers/96c829cb-4dde-467c-b50f-b2f666bdab0b" status: 200 len: 1322 microversion: 2.1 time: 0.149227 Oct 13 13:10:36.518038 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 46/104] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:10:36 2022] GET /compute/v2.1/servers/96c829cb-4dde-467c-b50f-b2f666bdab0b => generated 1322 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:10:36.632569 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [req-85c17d3b-be26-4e9f-9af6-c45f1a2dd7d7 req-cc6580f5-5e9b-4b99-9474-d82afdf4f09a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0548a3eb-e119-482c-ac70-04fbc6f83bf7", "name": "network-vif-plugged", "status": "completed", "tag": "8c64ab27-53ec-48f6-92d8-9ce773dd02d8"}]} {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 13:10:36.644428 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [req-85c17d3b-be26-4e9f-9af6-c45f1a2dd7d7 req-cc6580f5-5e9b-4b99-9474-d82afdf4f09a service nova] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:10:36.645411 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [req-85c17d3b-be26-4e9f-9af6-c45f1a2dd7d7 req-cc6580f5-5e9b-4b99-9474-d82afdf4f09a service nova] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:10:36.646052 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [req-85c17d3b-be26-4e9f-9af6-c45f1a2dd7d7 req-cc6580f5-5e9b-4b99-9474-d82afdf4f09a service nova] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:10:36.659093 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.compute.server_external_events [req-85c17d3b-be26-4e9f-9af6-c45f1a2dd7d7 req-cc6580f5-5e9b-4b99-9474-d82afdf4f09a service nova] Creating event network-vif-plugged:8c64ab27-53ec-48f6-92d8-9ce773dd02d8 for instance 0548a3eb-e119-482c-ac70-04fbc6f83bf7 on hv-cinder-82660 Oct 13 13:10:36.664306 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [req-85c17d3b-be26-4e9f-9af6-c45f1a2dd7d7 req-cc6580f5-5e9b-4b99-9474-d82afdf4f09a service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035383 Oct 13 13:10:36.664948 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 59/105] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 13:10:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 13:10:36.976352 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-449a0b5a-24cc-4f25-8571-ba60b6c54bc1 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Calling method '>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:10:36.976947 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-449a0b5a-24cc-4f25-8571-ba60b6c54bc1 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] [instance: e125ab44-9111-4260-909d-95d57b7861a7] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:10:36.982997 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-449a0b5a-24cc-4f25-8571-ba60b6c54bc1 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:10:36.983502 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-449a0b5a-24cc-4f25-8571-ba60b6c54bc1 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:10:36.983933 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-449a0b5a-24cc-4f25-8571-ba60b6c54bc1 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:10:36.984607 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-449a0b5a-24cc-4f25-8571-ba60b6c54bc1 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:10:36.985053 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-449a0b5a-24cc-4f25-8571-ba60b6c54bc1 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:10:36.985467 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-449a0b5a-24cc-4f25-8571-ba60b6c54bc1 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:10:36.985918 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-ba50cd7e-c897-45b9-9cae-7b288ab73fdd tempest-DeleteServersTestJSON-1957240839 tempest-DeleteServersTestJSON-1957240839-project] Calling method '>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:10:36.986608 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-ba50cd7e-c897-45b9-9cae-7b288ab73fdd tempest-DeleteServersTestJSON-1957240839 tempest-DeleteServersTestJSON-1957240839-project] [instance: dcd9bb33-bad5-4d93-ba0f-558c63746e29] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:10:36.993197 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-ba50cd7e-c897-45b9-9cae-7b288ab73fdd tempest-DeleteServersTestJSON-1957240839 tempest-DeleteServersTestJSON-1957240839-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:10:36.993674 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-ba50cd7e-c897-45b9-9cae-7b288ab73fdd tempest-DeleteServersTestJSON-1957240839 tempest-DeleteServersTestJSON-1957240839-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:10:36.994108 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-ba50cd7e-c897-45b9-9cae-7b288ab73fdd tempest-DeleteServersTestJSON-1957240839 tempest-DeleteServersTestJSON-1957240839-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:10:36.994809 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-ba50cd7e-c897-45b9-9cae-7b288ab73fdd tempest-DeleteServersTestJSON-1957240839 tempest-DeleteServersTestJSON-1957240839-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:10:36.995290 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-ba50cd7e-c897-45b9-9cae-7b288ab73fdd tempest-DeleteServersTestJSON-1957240839 tempest-DeleteServersTestJSON-1957240839-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:10:36.995710 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-ba50cd7e-c897-45b9-9cae-7b288ab73fdd tempest-DeleteServersTestJSON-1957240839 tempest-DeleteServersTestJSON-1957240839-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:10:37.178140 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-449a0b5a-24cc-4f25-8571-ba60b6c54bc1 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e783caddcad473dbdd764919286e244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecd3d5d2a3a54a07ba64f1fea4846c40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:10:37.181702 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-ba50cd7e-c897-45b9-9cae-7b288ab73fdd tempest-DeleteServersTestJSON-1957240839 tempest-DeleteServersTestJSON-1957240839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3a049e77aba470db21e26d1bc8caa80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6027a602300d4d2bbf33ac329b2960f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:10:37.186269 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-449a0b5a-24cc-4f25-8571-ba60b6c54bc1 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] 10.222.0.23 "GET /compute/v2.1/servers/e125ab44-9111-4260-909d-95d57b7861a7" status: 200 len: 1363 microversion: 2.1 time: 0.213781 Oct 13 13:10:37.186837 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 47/106] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:10:36 2022] GET /compute/v2.1/servers/e125ab44-9111-4260-909d-95d57b7861a7 => generated 1363 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:10:37.189442 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-ba50cd7e-c897-45b9-9cae-7b288ab73fdd tempest-DeleteServersTestJSON-1957240839 tempest-DeleteServersTestJSON-1957240839-project] 10.222.0.23 "GET /compute/v2.1/servers/dcd9bb33-bad5-4d93-ba0f-558c63746e29" status: 200 len: 1315 microversion: 2.1 time: 0.207565 Oct 13 13:10:37.190142 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 60/107] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:10:36 2022] GET /compute/v2.1/servers/dcd9bb33-bad5-4d93-ba0f-558c63746e29 => generated 1315 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 13:10:37.191526 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-af2c96c3-a047-4488-9f48-0b4f4ce6416c tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Calling method '>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:10:37.192123 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-af2c96c3-a047-4488-9f48-0b4f4ce6416c tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] [instance: 26bd475b-3495-4669-9985-d4a7dedb4bbf] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:10:37.198296 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-af2c96c3-a047-4488-9f48-0b4f4ce6416c tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:10:37.198774 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-af2c96c3-a047-4488-9f48-0b4f4ce6416c tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:10:37.199248 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-af2c96c3-a047-4488-9f48-0b4f4ce6416c tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:10:37.199925 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-af2c96c3-a047-4488-9f48-0b4f4ce6416c tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:10:37.200370 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-af2c96c3-a047-4488-9f48-0b4f4ce6416c tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:10:37.200786 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-af2c96c3-a047-4488-9f48-0b4f4ce6416c tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:10:37.323169 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-af2c96c3-a047-4488-9f48-0b4f4ce6416c tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:10:37.330999 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-af2c96c3-a047-4488-9f48-0b4f4ce6416c tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:10:37.332460 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-af2c96c3-a047-4488-9f48-0b4f4ce6416c tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:10:37.333548 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-af2c96c3-a047-4488-9f48-0b4f4ce6416c tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] 10.222.0.23 "GET /compute/v2.1/servers/26bd475b-3495-4669-9985-d4a7dedb4bbf" status: 200 len: 1407 microversion: 2.20 time: 0.145780 Oct 13 13:10:37.334098 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 48/108] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 13:10:37 2022] GET /compute/v2.1/servers/26bd475b-3495-4669-9985-d4a7dedb4bbf => generated 1407 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 13:10:37.540563 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-e7528c59-e53c-4ffc-b04c-bbaff0110e09 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Calling method '>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:10:37.541166 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-e7528c59-e53c-4ffc-b04c-bbaff0110e09 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] [instance: 96c829cb-4dde-467c-b50f-b2f666bdab0b] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:10:37.547354 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-e7528c59-e53c-4ffc-b04c-bbaff0110e09 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:10:37.547844 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-e7528c59-e53c-4ffc-b04c-bbaff0110e09 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:10:37.548285 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-e7528c59-e53c-4ffc-b04c-bbaff0110e09 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:10:37.548987 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-e7528c59-e53c-4ffc-b04c-bbaff0110e09 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:10:37.549452 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-e7528c59-e53c-4ffc-b04c-bbaff0110e09 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:10:37.549878 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-e7528c59-e53c-4ffc-b04c-bbaff0110e09 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:10:37.684778 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-e7528c59-e53c-4ffc-b04c-bbaff0110e09 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '454203f47b434cca952a1cef56de559f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7312d0ac9248f2bfbece5611913ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:10:37.692465 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-e7528c59-e53c-4ffc-b04c-bbaff0110e09 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] 10.222.0.23 "GET /compute/v2.1/servers/96c829cb-4dde-467c-b50f-b2f666bdab0b" status: 200 len: 1322 microversion: 2.1 time: 0.155690 Oct 13 13:10:37.693031 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 61/109] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:10:37 2022] GET /compute/v2.1/servers/96c829cb-4dde-467c-b50f-b2f666bdab0b => generated 1322 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:10:38.209424 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-23afe0d4-87db-4793-b77a-d0348ea75684 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Calling method '>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:10:38.210033 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-23afe0d4-87db-4793-b77a-d0348ea75684 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] [instance: e125ab44-9111-4260-909d-95d57b7861a7] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:10:38.212202 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-ad647611-b86a-4ff5-b9e2-f8cbb0e62616 tempest-DeleteServersTestJSON-1957240839 tempest-DeleteServersTestJSON-1957240839-project] Calling method '>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:10:38.212824 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-ad647611-b86a-4ff5-b9e2-f8cbb0e62616 tempest-DeleteServersTestJSON-1957240839 tempest-DeleteServersTestJSON-1957240839-project] [instance: dcd9bb33-bad5-4d93-ba0f-558c63746e29] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:10:38.216540 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-23afe0d4-87db-4793-b77a-d0348ea75684 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:10:38.217031 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-23afe0d4-87db-4793-b77a-d0348ea75684 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:10:38.217472 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-23afe0d4-87db-4793-b77a-d0348ea75684 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:10:38.218198 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-23afe0d4-87db-4793-b77a-d0348ea75684 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:10:38.218650 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-23afe0d4-87db-4793-b77a-d0348ea75684 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:10:38.219086 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-23afe0d4-87db-4793-b77a-d0348ea75684 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:10:38.220104 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-ad647611-b86a-4ff5-b9e2-f8cbb0e62616 tempest-DeleteServersTestJSON-1957240839 tempest-DeleteServersTestJSON-1957240839-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:10:38.220669 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-ad647611-b86a-4ff5-b9e2-f8cbb0e62616 tempest-DeleteServersTestJSON-1957240839 tempest-DeleteServersTestJSON-1957240839-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:10:38.221459 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-ad647611-b86a-4ff5-b9e2-f8cbb0e62616 tempest-DeleteServersTestJSON-1957240839 tempest-DeleteServersTestJSON-1957240839-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:10:38.222117 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-ad647611-b86a-4ff5-b9e2-f8cbb0e62616 tempest-DeleteServersTestJSON-1957240839 tempest-DeleteServersTestJSON-1957240839-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:10:38.222576 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-ad647611-b86a-4ff5-b9e2-f8cbb0e62616 tempest-DeleteServersTestJSON-1957240839 tempest-DeleteServersTestJSON-1957240839-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:10:38.223009 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-ad647611-b86a-4ff5-b9e2-f8cbb0e62616 tempest-DeleteServersTestJSON-1957240839 tempest-DeleteServersTestJSON-1957240839-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:10:38.423109 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-23afe0d4-87db-4793-b77a-d0348ea75684 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e783caddcad473dbdd764919286e244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecd3d5d2a3a54a07ba64f1fea4846c40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:10:38.429472 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-ad647611-b86a-4ff5-b9e2-f8cbb0e62616 tempest-DeleteServersTestJSON-1957240839 tempest-DeleteServersTestJSON-1957240839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3a049e77aba470db21e26d1bc8caa80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6027a602300d4d2bbf33ac329b2960f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:10:38.437191 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-23afe0d4-87db-4793-b77a-d0348ea75684 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] 10.222.0.23 "GET /compute/v2.1/servers/e125ab44-9111-4260-909d-95d57b7861a7" status: 200 len: 1363 microversion: 2.1 time: 0.231652 Oct 13 13:10:38.439292 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-ad647611-b86a-4ff5-b9e2-f8cbb0e62616 tempest-DeleteServersTestJSON-1957240839 tempest-DeleteServersTestJSON-1957240839-project] 10.222.0.23 "GET /compute/v2.1/servers/dcd9bb33-bad5-4d93-ba0f-558c63746e29" status: 200 len: 1315 microversion: 2.1 time: 0.230668 Oct 13 13:10:38.440414 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 62/110] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:10:38 2022] GET /compute/v2.1/servers/dcd9bb33-bad5-4d93-ba0f-558c63746e29 => generated 1315 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 13:10:38.447678 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 49/111] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:10:38 2022] GET /compute/v2.1/servers/e125ab44-9111-4260-909d-95d57b7861a7 => generated 1363 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:10:38.451839 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-e5dd37eb-ac60-4764-8351-404d2cf23c4a tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Calling method '>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:10:38.452597 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-e5dd37eb-ac60-4764-8351-404d2cf23c4a tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] [instance: 26bd475b-3495-4669-9985-d4a7dedb4bbf] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:10:38.459995 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-e5dd37eb-ac60-4764-8351-404d2cf23c4a tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:10:38.460759 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-e5dd37eb-ac60-4764-8351-404d2cf23c4a tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:10:38.465252 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-e5dd37eb-ac60-4764-8351-404d2cf23c4a tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:10:38.466159 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-e5dd37eb-ac60-4764-8351-404d2cf23c4a tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:10:38.466965 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-e5dd37eb-ac60-4764-8351-404d2cf23c4a tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:10:38.467508 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-e5dd37eb-ac60-4764-8351-404d2cf23c4a tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:10:38.630266 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-e5dd37eb-ac60-4764-8351-404d2cf23c4a tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:10:38.640460 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-e5dd37eb-ac60-4764-8351-404d2cf23c4a tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:10:38.643667 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-e5dd37eb-ac60-4764-8351-404d2cf23c4a tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:10:38.645606 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-e5dd37eb-ac60-4764-8351-404d2cf23c4a tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] 10.222.0.23 "GET /compute/v2.1/servers/26bd475b-3495-4669-9985-d4a7dedb4bbf" status: 200 len: 1407 microversion: 2.20 time: 0.204003 Oct 13 13:10:38.646836 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 63/112] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 13:10:38 2022] GET /compute/v2.1/servers/26bd475b-3495-4669-9985-d4a7dedb4bbf => generated 1407 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 13:10:38.722872 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-112117c4-37dc-4685-ad65-df1fd57d922f tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Calling method '>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:10:38.723554 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-112117c4-37dc-4685-ad65-df1fd57d922f tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] [instance: 96c829cb-4dde-467c-b50f-b2f666bdab0b] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:10:38.733724 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-112117c4-37dc-4685-ad65-df1fd57d922f tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:10:38.738706 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-112117c4-37dc-4685-ad65-df1fd57d922f tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:10:38.740112 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-112117c4-37dc-4685-ad65-df1fd57d922f tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:10:38.742972 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-112117c4-37dc-4685-ad65-df1fd57d922f tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:10:38.743759 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-112117c4-37dc-4685-ad65-df1fd57d922f tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:10:38.745559 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-112117c4-37dc-4685-ad65-df1fd57d922f tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:10:39.018539 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-112117c4-37dc-4685-ad65-df1fd57d922f tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '454203f47b434cca952a1cef56de559f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7312d0ac9248f2bfbece5611913ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:10:39.028115 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-112117c4-37dc-4685-ad65-df1fd57d922f tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] 10.222.0.23 "GET /compute/v2.1/servers/96c829cb-4dde-467c-b50f-b2f666bdab0b" status: 200 len: 1322 microversion: 2.1 time: 0.314234 Oct 13 13:10:39.028689 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 50/113] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:10:38 2022] GET /compute/v2.1/servers/96c829cb-4dde-467c-b50f-b2f666bdab0b => generated 1322 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:10:39.461892 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-c119b7a5-123e-463e-9a25-b4b38ad2a96a tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Calling method '>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:10:39.462581 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-c119b7a5-123e-463e-9a25-b4b38ad2a96a tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] [instance: e125ab44-9111-4260-909d-95d57b7861a7] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:10:39.468768 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-c119b7a5-123e-463e-9a25-b4b38ad2a96a tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:10:39.469256 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-c119b7a5-123e-463e-9a25-b4b38ad2a96a tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:10:39.469688 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-c119b7a5-123e-463e-9a25-b4b38ad2a96a tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:10:39.470380 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-c119b7a5-123e-463e-9a25-b4b38ad2a96a tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:10:39.470829 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-c119b7a5-123e-463e-9a25-b4b38ad2a96a tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:10:39.471292 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-c119b7a5-123e-463e-9a25-b4b38ad2a96a tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:10:39.473681 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-102ee91f-43c6-44fd-bd33-9d3b8da175e9 tempest-DeleteServersTestJSON-1957240839 tempest-DeleteServersTestJSON-1957240839-project] Calling method '>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:10:39.474287 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-102ee91f-43c6-44fd-bd33-9d3b8da175e9 tempest-DeleteServersTestJSON-1957240839 tempest-DeleteServersTestJSON-1957240839-project] [instance: dcd9bb33-bad5-4d93-ba0f-558c63746e29] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:10:39.481060 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-102ee91f-43c6-44fd-bd33-9d3b8da175e9 tempest-DeleteServersTestJSON-1957240839 tempest-DeleteServersTestJSON-1957240839-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:10:39.481344 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-102ee91f-43c6-44fd-bd33-9d3b8da175e9 tempest-DeleteServersTestJSON-1957240839 tempest-DeleteServersTestJSON-1957240839-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:10:39.481786 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-102ee91f-43c6-44fd-bd33-9d3b8da175e9 tempest-DeleteServersTestJSON-1957240839 tempest-DeleteServersTestJSON-1957240839-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:10:39.482486 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-102ee91f-43c6-44fd-bd33-9d3b8da175e9 tempest-DeleteServersTestJSON-1957240839 tempest-DeleteServersTestJSON-1957240839-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:10:39.482937 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-102ee91f-43c6-44fd-bd33-9d3b8da175e9 tempest-DeleteServersTestJSON-1957240839 tempest-DeleteServersTestJSON-1957240839-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:10:39.483393 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-102ee91f-43c6-44fd-bd33-9d3b8da175e9 tempest-DeleteServersTestJSON-1957240839 tempest-DeleteServersTestJSON-1957240839-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:10:39.712427 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-102ee91f-43c6-44fd-bd33-9d3b8da175e9 tempest-DeleteServersTestJSON-1957240839 tempest-DeleteServersTestJSON-1957240839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3a049e77aba470db21e26d1bc8caa80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6027a602300d4d2bbf33ac329b2960f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:10:39.725552 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-102ee91f-43c6-44fd-bd33-9d3b8da175e9 tempest-DeleteServersTestJSON-1957240839 tempest-DeleteServersTestJSON-1957240839-project] 10.222.0.23 "GET /compute/v2.1/servers/dcd9bb33-bad5-4d93-ba0f-558c63746e29" status: 200 len: 1315 microversion: 2.1 time: 0.254312 Oct 13 13:10:39.728151 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-c119b7a5-123e-463e-9a25-b4b38ad2a96a tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e783caddcad473dbdd764919286e244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecd3d5d2a3a54a07ba64f1fea4846c40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:10:39.741132 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 51/114] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:10:39 2022] GET /compute/v2.1/servers/dcd9bb33-bad5-4d93-ba0f-558c63746e29 => generated 1315 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 13:10:39.747792 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-dcb9b810-f7d7-455a-a9ba-e60b22b70537 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Calling method '>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:10:39.748405 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-dcb9b810-f7d7-455a-a9ba-e60b22b70537 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] [instance: 26bd475b-3495-4669-9985-d4a7dedb4bbf] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:10:39.751965 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-c119b7a5-123e-463e-9a25-b4b38ad2a96a tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] 10.222.0.23 "GET /compute/v2.1/servers/e125ab44-9111-4260-909d-95d57b7861a7" status: 200 len: 1363 microversion: 2.1 time: 0.292216 Oct 13 13:10:39.752769 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 64/115] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:10:39 2022] GET /compute/v2.1/servers/e125ab44-9111-4260-909d-95d57b7861a7 => generated 1363 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:10:39.758891 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-dcb9b810-f7d7-455a-a9ba-e60b22b70537 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:10:39.759403 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-dcb9b810-f7d7-455a-a9ba-e60b22b70537 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:10:39.759842 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-dcb9b810-f7d7-455a-a9ba-e60b22b70537 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:10:39.760518 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-dcb9b810-f7d7-455a-a9ba-e60b22b70537 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:10:39.762801 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-dcb9b810-f7d7-455a-a9ba-e60b22b70537 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:10:39.763410 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-dcb9b810-f7d7-455a-a9ba-e60b22b70537 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:10:39.786934 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG dbcounter [-] [118815] Writing DB stats nova_cell1:SELECT=100 {{(pid=118815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:10:40.051506 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-a9825324-8bb0-4de1-848a-b24e1276a57a tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Calling method '>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:10:40.052833 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-a9825324-8bb0-4de1-848a-b24e1276a57a tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] [instance: 96c829cb-4dde-467c-b50f-b2f666bdab0b] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:10:40.067734 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-a9825324-8bb0-4de1-848a-b24e1276a57a tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:10:40.068965 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-a9825324-8bb0-4de1-848a-b24e1276a57a tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:10:40.069850 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-a9825324-8bb0-4de1-848a-b24e1276a57a tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:10:40.071873 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-a9825324-8bb0-4de1-848a-b24e1276a57a tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:10:40.072796 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-a9825324-8bb0-4de1-848a-b24e1276a57a tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:10:40.073885 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-a9825324-8bb0-4de1-848a-b24e1276a57a tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:10:40.124793 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-dcb9b810-f7d7-455a-a9ba-e60b22b70537 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:10:40.146782 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-dcb9b810-f7d7-455a-a9ba-e60b22b70537 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:10:40.148265 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-dcb9b810-f7d7-455a-a9ba-e60b22b70537 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:10:40.149431 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-dcb9b810-f7d7-455a-a9ba-e60b22b70537 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] 10.222.0.23 "GET /compute/v2.1/servers/26bd475b-3495-4669-9985-d4a7dedb4bbf" status: 200 len: 1407 microversion: 2.20 time: 0.407064 Oct 13 13:10:40.150303 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 52/116] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 13:10:39 2022] GET /compute/v2.1/servers/26bd475b-3495-4669-9985-d4a7dedb4bbf => generated 1407 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 13:10:40.255564 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-a9825324-8bb0-4de1-848a-b24e1276a57a tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '454203f47b434cca952a1cef56de559f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7312d0ac9248f2bfbece5611913ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:10:40.274592 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-a9825324-8bb0-4de1-848a-b24e1276a57a tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] 10.222.0.23 "GET /compute/v2.1/servers/96c829cb-4dde-467c-b50f-b2f666bdab0b" status: 200 len: 1322 microversion: 2.1 time: 0.226933 Oct 13 13:10:40.275488 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 65/117] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:10:40 2022] GET /compute/v2.1/servers/96c829cb-4dde-467c-b50f-b2f666bdab0b => generated 1322 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 13:10:40.750399 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-692a1f42-2099-49bc-9c69-d0c1861e5908 tempest-DeleteServersTestJSON-1957240839 tempest-DeleteServersTestJSON-1957240839-project] Calling method '>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:10:40.751954 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-692a1f42-2099-49bc-9c69-d0c1861e5908 tempest-DeleteServersTestJSON-1957240839 tempest-DeleteServersTestJSON-1957240839-project] [instance: dcd9bb33-bad5-4d93-ba0f-558c63746e29] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:10:40.760015 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-692a1f42-2099-49bc-9c69-d0c1861e5908 tempest-DeleteServersTestJSON-1957240839 tempest-DeleteServersTestJSON-1957240839-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:10:40.760863 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-692a1f42-2099-49bc-9c69-d0c1861e5908 tempest-DeleteServersTestJSON-1957240839 tempest-DeleteServersTestJSON-1957240839-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:10:40.761823 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-692a1f42-2099-49bc-9c69-d0c1861e5908 tempest-DeleteServersTestJSON-1957240839 tempest-DeleteServersTestJSON-1957240839-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:10:40.762909 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-692a1f42-2099-49bc-9c69-d0c1861e5908 tempest-DeleteServersTestJSON-1957240839 tempest-DeleteServersTestJSON-1957240839-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:10:40.763812 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-692a1f42-2099-49bc-9c69-d0c1861e5908 tempest-DeleteServersTestJSON-1957240839 tempest-DeleteServersTestJSON-1957240839-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:10:40.764767 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-692a1f42-2099-49bc-9c69-d0c1861e5908 tempest-DeleteServersTestJSON-1957240839 tempest-DeleteServersTestJSON-1957240839-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:10:40.779233 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-41493555-3bae-4075-a1d1-ac7894e440ea tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Calling method '>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:10:40.780407 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-41493555-3bae-4075-a1d1-ac7894e440ea tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] [instance: e125ab44-9111-4260-909d-95d57b7861a7] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:10:40.790884 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-41493555-3bae-4075-a1d1-ac7894e440ea tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:10:40.791627 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-41493555-3bae-4075-a1d1-ac7894e440ea tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:10:40.792362 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-41493555-3bae-4075-a1d1-ac7894e440ea tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:10:40.793319 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-41493555-3bae-4075-a1d1-ac7894e440ea tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:10:40.797350 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-41493555-3bae-4075-a1d1-ac7894e440ea tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:10:40.798037 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-41493555-3bae-4075-a1d1-ac7894e440ea tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:10:41.123509 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-41493555-3bae-4075-a1d1-ac7894e440ea tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e783caddcad473dbdd764919286e244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecd3d5d2a3a54a07ba64f1fea4846c40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:10:41.133373 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-41493555-3bae-4075-a1d1-ac7894e440ea tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] 10.222.0.23 "GET /compute/v2.1/servers/e125ab44-9111-4260-909d-95d57b7861a7" status: 200 len: 1363 microversion: 2.1 time: 0.359367 Oct 13 13:10:41.147731 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 66/118] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:10:40 2022] GET /compute/v2.1/servers/e125ab44-9111-4260-909d-95d57b7861a7 => generated 1363 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 13:10:41.152229 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-692a1f42-2099-49bc-9c69-d0c1861e5908 tempest-DeleteServersTestJSON-1957240839 tempest-DeleteServersTestJSON-1957240839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3a049e77aba470db21e26d1bc8caa80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6027a602300d4d2bbf33ac329b2960f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:10:41.167001 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-692a1f42-2099-49bc-9c69-d0c1861e5908 tempest-DeleteServersTestJSON-1957240839 tempest-DeleteServersTestJSON-1957240839-project] 10.222.0.23 "GET /compute/v2.1/servers/dcd9bb33-bad5-4d93-ba0f-558c63746e29" status: 200 len: 1315 microversion: 2.1 time: 0.421585 Oct 13 13:10:41.169204 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 53/119] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:10:40 2022] GET /compute/v2.1/servers/dcd9bb33-bad5-4d93-ba0f-558c63746e29 => generated 1315 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:10:41.174821 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-88752011-7a1c-4c6c-8444-9e153f803d05 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Calling method '>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:10:41.175426 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-88752011-7a1c-4c6c-8444-9e153f803d05 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] [instance: 26bd475b-3495-4669-9985-d4a7dedb4bbf] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:10:41.185877 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-88752011-7a1c-4c6c-8444-9e153f803d05 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:10:41.186507 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-88752011-7a1c-4c6c-8444-9e153f803d05 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:10:41.187041 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-88752011-7a1c-4c6c-8444-9e153f803d05 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:10:41.187875 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-88752011-7a1c-4c6c-8444-9e153f803d05 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:10:41.188337 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-88752011-7a1c-4c6c-8444-9e153f803d05 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:10:41.188775 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-88752011-7a1c-4c6c-8444-9e153f803d05 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:10:41.303955 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-111a1a15-01d7-45e0-aeaf-3a3db67da12f tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Calling method '>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:10:41.305363 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-111a1a15-01d7-45e0-aeaf-3a3db67da12f tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] [instance: 96c829cb-4dde-467c-b50f-b2f666bdab0b] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:10:41.319942 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-111a1a15-01d7-45e0-aeaf-3a3db67da12f tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:10:41.321925 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-111a1a15-01d7-45e0-aeaf-3a3db67da12f tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:10:41.324411 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-111a1a15-01d7-45e0-aeaf-3a3db67da12f tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:10:41.326575 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-111a1a15-01d7-45e0-aeaf-3a3db67da12f tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:10:41.331586 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-111a1a15-01d7-45e0-aeaf-3a3db67da12f tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:10:41.332153 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-111a1a15-01d7-45e0-aeaf-3a3db67da12f tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:10:41.436707 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-88752011-7a1c-4c6c-8444-9e153f803d05 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:10:41.454311 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-88752011-7a1c-4c6c-8444-9e153f803d05 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:10:41.463184 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-88752011-7a1c-4c6c-8444-9e153f803d05 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:10:41.465531 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-88752011-7a1c-4c6c-8444-9e153f803d05 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] 10.222.0.23 "GET /compute/v2.1/servers/26bd475b-3495-4669-9985-d4a7dedb4bbf" status: 200 len: 1407 microversion: 2.20 time: 0.295371 Oct 13 13:10:41.474734 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 67/120] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 13:10:41 2022] GET /compute/v2.1/servers/26bd475b-3495-4669-9985-d4a7dedb4bbf => generated 1407 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 13:10:41.570283 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-111a1a15-01d7-45e0-aeaf-3a3db67da12f tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '454203f47b434cca952a1cef56de559f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7312d0ac9248f2bfbece5611913ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:10:41.584882 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-111a1a15-01d7-45e0-aeaf-3a3db67da12f tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] 10.222.0.23 "GET /compute/v2.1/servers/96c829cb-4dde-467c-b50f-b2f666bdab0b" status: 200 len: 1322 microversion: 2.1 time: 0.290560 Oct 13 13:10:41.585647 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 54/121] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:10:41 2022] GET /compute/v2.1/servers/96c829cb-4dde-467c-b50f-b2f666bdab0b => generated 1322 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:10:41.848691 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [req-66301ebf-29d6-4c13-952c-cc50b9f2fc94 req-ccfdab29-33ed-4072-a815-64623a8ac692 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "26bd475b-3495-4669-9985-d4a7dedb4bbf", "name": "network-vif-plugged", "status": "completed", "tag": "bd0eddba-ab0b-4c35-805b-853067734898"}]} {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 13:10:41.862601 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [req-66301ebf-29d6-4c13-952c-cc50b9f2fc94 req-ccfdab29-33ed-4072-a815-64623a8ac692 service nova] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:10:41.863576 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [req-66301ebf-29d6-4c13-952c-cc50b9f2fc94 req-ccfdab29-33ed-4072-a815-64623a8ac692 service nova] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:10:41.864524 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [req-66301ebf-29d6-4c13-952c-cc50b9f2fc94 req-ccfdab29-33ed-4072-a815-64623a8ac692 service nova] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:10:41.880417 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.compute.server_external_events [req-66301ebf-29d6-4c13-952c-cc50b9f2fc94 req-ccfdab29-33ed-4072-a815-64623a8ac692 service nova] Creating event network-vif-plugged:bd0eddba-ab0b-4c35-805b-853067734898 for instance 26bd475b-3495-4669-9985-d4a7dedb4bbf on hv-cinder-82660 Oct 13 13:10:41.887473 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [req-66301ebf-29d6-4c13-952c-cc50b9f2fc94 req-ccfdab29-33ed-4072-a815-64623a8ac692 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046543 Oct 13 13:10:41.888760 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 68/122] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 13:10:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 13:10:42.159904 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-06d513a4-93b4-431c-9f1b-bb6873258762 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Calling method '>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:10:42.160624 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-06d513a4-93b4-431c-9f1b-bb6873258762 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] [instance: e125ab44-9111-4260-909d-95d57b7861a7] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:10:42.166885 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-06d513a4-93b4-431c-9f1b-bb6873258762 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:10:42.167807 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-06d513a4-93b4-431c-9f1b-bb6873258762 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:10:42.168279 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-06d513a4-93b4-431c-9f1b-bb6873258762 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:10:42.168974 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-06d513a4-93b4-431c-9f1b-bb6873258762 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:10:42.169477 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-06d513a4-93b4-431c-9f1b-bb6873258762 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:10:42.169962 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-06d513a4-93b4-431c-9f1b-bb6873258762 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:10:42.196430 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-b837abea-eefb-46fb-9ae5-b336d4a2c1e1 tempest-DeleteServersTestJSON-1957240839 tempest-DeleteServersTestJSON-1957240839-project] Calling method '>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:10:42.196665 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-b837abea-eefb-46fb-9ae5-b336d4a2c1e1 tempest-DeleteServersTestJSON-1957240839 tempest-DeleteServersTestJSON-1957240839-project] [instance: dcd9bb33-bad5-4d93-ba0f-558c63746e29] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:10:42.208569 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-b837abea-eefb-46fb-9ae5-b336d4a2c1e1 tempest-DeleteServersTestJSON-1957240839 tempest-DeleteServersTestJSON-1957240839-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:10:42.209261 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-b837abea-eefb-46fb-9ae5-b336d4a2c1e1 tempest-DeleteServersTestJSON-1957240839 tempest-DeleteServersTestJSON-1957240839-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:10:42.212414 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-b837abea-eefb-46fb-9ae5-b336d4a2c1e1 tempest-DeleteServersTestJSON-1957240839 tempest-DeleteServersTestJSON-1957240839-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:10:42.213296 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-b837abea-eefb-46fb-9ae5-b336d4a2c1e1 tempest-DeleteServersTestJSON-1957240839 tempest-DeleteServersTestJSON-1957240839-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:10:42.214071 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-b837abea-eefb-46fb-9ae5-b336d4a2c1e1 tempest-DeleteServersTestJSON-1957240839 tempest-DeleteServersTestJSON-1957240839-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:10:42.214663 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-b837abea-eefb-46fb-9ae5-b336d4a2c1e1 tempest-DeleteServersTestJSON-1957240839 tempest-DeleteServersTestJSON-1957240839-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:10:42.440240 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-06d513a4-93b4-431c-9f1b-bb6873258762 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e783caddcad473dbdd764919286e244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecd3d5d2a3a54a07ba64f1fea4846c40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:10:42.468967 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-06d513a4-93b4-431c-9f1b-bb6873258762 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] 10.222.0.23 "GET /compute/v2.1/servers/e125ab44-9111-4260-909d-95d57b7861a7" status: 200 len: 1363 microversion: 2.1 time: 0.312821 Oct 13 13:10:42.479175 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 55/123] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:10:42 2022] GET /compute/v2.1/servers/e125ab44-9111-4260-909d-95d57b7861a7 => generated 1363 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:10:42.505671 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-95c03636-9639-4190-b062-83f6a2a0b95c tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Calling method '>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:10:42.511527 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-95c03636-9639-4190-b062-83f6a2a0b95c tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] [instance: 26bd475b-3495-4669-9985-d4a7dedb4bbf] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:10:42.521834 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-95c03636-9639-4190-b062-83f6a2a0b95c tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:10:42.522829 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-95c03636-9639-4190-b062-83f6a2a0b95c tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:10:42.523572 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-95c03636-9639-4190-b062-83f6a2a0b95c tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:10:42.524860 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-95c03636-9639-4190-b062-83f6a2a0b95c tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:10:42.525783 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-95c03636-9639-4190-b062-83f6a2a0b95c tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:10:42.527977 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-b837abea-eefb-46fb-9ae5-b336d4a2c1e1 tempest-DeleteServersTestJSON-1957240839 tempest-DeleteServersTestJSON-1957240839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3a049e77aba470db21e26d1bc8caa80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6027a602300d4d2bbf33ac329b2960f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:10:42.528520 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-95c03636-9639-4190-b062-83f6a2a0b95c tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:10:42.536379 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-b837abea-eefb-46fb-9ae5-b336d4a2c1e1 tempest-DeleteServersTestJSON-1957240839 tempest-DeleteServersTestJSON-1957240839-project] 10.222.0.23 "GET /compute/v2.1/servers/dcd9bb33-bad5-4d93-ba0f-558c63746e29" status: 200 len: 1315 microversion: 2.1 time: 0.346185 Oct 13 13:10:42.536953 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 69/124] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:10:42 2022] GET /compute/v2.1/servers/dcd9bb33-bad5-4d93-ba0f-558c63746e29 => generated 1315 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 13:10:42.611029 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-6071c25c-84eb-4fe0-9fe8-2f05e375681e tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Calling method '>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:10:42.611965 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-6071c25c-84eb-4fe0-9fe8-2f05e375681e tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] [instance: 96c829cb-4dde-467c-b50f-b2f666bdab0b] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:10:42.621086 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-6071c25c-84eb-4fe0-9fe8-2f05e375681e tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:10:42.621852 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-6071c25c-84eb-4fe0-9fe8-2f05e375681e tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:10:42.629770 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-6071c25c-84eb-4fe0-9fe8-2f05e375681e tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:10:42.631362 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-6071c25c-84eb-4fe0-9fe8-2f05e375681e tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:10:42.632795 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-6071c25c-84eb-4fe0-9fe8-2f05e375681e tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:10:42.634030 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-6071c25c-84eb-4fe0-9fe8-2f05e375681e tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:10:42.854750 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-95c03636-9639-4190-b062-83f6a2a0b95c tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:10:42.873508 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-95c03636-9639-4190-b062-83f6a2a0b95c tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:10:42.875649 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-95c03636-9639-4190-b062-83f6a2a0b95c tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:10:42.876940 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-95c03636-9639-4190-b062-83f6a2a0b95c tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] 10.222.0.23 "GET /compute/v2.1/servers/26bd475b-3495-4669-9985-d4a7dedb4bbf" status: 200 len: 1407 microversion: 2.20 time: 0.382616 Oct 13 13:10:42.878098 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 56/125] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 13:10:42 2022] GET /compute/v2.1/servers/26bd475b-3495-4669-9985-d4a7dedb4bbf => generated 1407 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 13:10:42.949279 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-6071c25c-84eb-4fe0-9fe8-2f05e375681e tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '454203f47b434cca952a1cef56de559f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7312d0ac9248f2bfbece5611913ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:10:42.962811 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-6071c25c-84eb-4fe0-9fe8-2f05e375681e tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] 10.222.0.23 "GET /compute/v2.1/servers/96c829cb-4dde-467c-b50f-b2f666bdab0b" status: 200 len: 1322 microversion: 2.1 time: 0.357587 Oct 13 13:10:42.975616 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 70/126] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:10:42 2022] GET /compute/v2.1/servers/96c829cb-4dde-467c-b50f-b2f666bdab0b => generated 1322 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 13:10:43.503616 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-0e266af9-6973-44bd-9665-f6b6bb1eae30 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Calling method '>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:10:43.504233 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-0e266af9-6973-44bd-9665-f6b6bb1eae30 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] [instance: e125ab44-9111-4260-909d-95d57b7861a7] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:10:43.517573 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-0e266af9-6973-44bd-9665-f6b6bb1eae30 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:10:43.517984 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-0e266af9-6973-44bd-9665-f6b6bb1eae30 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:10:43.518429 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-0e266af9-6973-44bd-9665-f6b6bb1eae30 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:10:43.519164 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-0e266af9-6973-44bd-9665-f6b6bb1eae30 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:10:43.519620 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-0e266af9-6973-44bd-9665-f6b6bb1eae30 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:10:43.520047 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-0e266af9-6973-44bd-9665-f6b6bb1eae30 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:10:43.563297 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-c8a28a99-ac7c-40be-82c0-9d0809746b3a tempest-DeleteServersTestJSON-1957240839 tempest-DeleteServersTestJSON-1957240839-project] Calling method '>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:10:43.563938 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-c8a28a99-ac7c-40be-82c0-9d0809746b3a tempest-DeleteServersTestJSON-1957240839 tempest-DeleteServersTestJSON-1957240839-project] [instance: dcd9bb33-bad5-4d93-ba0f-558c63746e29] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:10:43.579753 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-c8a28a99-ac7c-40be-82c0-9d0809746b3a tempest-DeleteServersTestJSON-1957240839 tempest-DeleteServersTestJSON-1957240839-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:10:43.580787 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-c8a28a99-ac7c-40be-82c0-9d0809746b3a tempest-DeleteServersTestJSON-1957240839 tempest-DeleteServersTestJSON-1957240839-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:10:43.582157 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-c8a28a99-ac7c-40be-82c0-9d0809746b3a tempest-DeleteServersTestJSON-1957240839 tempest-DeleteServersTestJSON-1957240839-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:10:43.588002 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-c8a28a99-ac7c-40be-82c0-9d0809746b3a tempest-DeleteServersTestJSON-1957240839 tempest-DeleteServersTestJSON-1957240839-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:10:43.588949 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-c8a28a99-ac7c-40be-82c0-9d0809746b3a tempest-DeleteServersTestJSON-1957240839 tempest-DeleteServersTestJSON-1957240839-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:10:43.589582 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-c8a28a99-ac7c-40be-82c0-9d0809746b3a tempest-DeleteServersTestJSON-1957240839 tempest-DeleteServersTestJSON-1957240839-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:10:43.692315 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-0e266af9-6973-44bd-9665-f6b6bb1eae30 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e783caddcad473dbdd764919286e244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecd3d5d2a3a54a07ba64f1fea4846c40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:10:43.703208 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-0e266af9-6973-44bd-9665-f6b6bb1eae30 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] 10.222.0.23 "GET /compute/v2.1/servers/e125ab44-9111-4260-909d-95d57b7861a7" status: 200 len: 1550 microversion: 2.1 time: 0.205666 Oct 13 13:10:43.704192 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 57/127] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:10:43 2022] GET /compute/v2.1/servers/e125ab44-9111-4260-909d-95d57b7861a7 => generated 1550 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:10:43.732732 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-d252fd41-dc38-4e9b-b32d-4cc7d25bf88a tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Calling method '>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:10:43.733328 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-d252fd41-dc38-4e9b-b32d-4cc7d25bf88a tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] [instance: e125ab44-9111-4260-909d-95d57b7861a7] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:10:43.740313 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-d252fd41-dc38-4e9b-b32d-4cc7d25bf88a tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:10:43.741357 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-d252fd41-dc38-4e9b-b32d-4cc7d25bf88a tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:10:43.741870 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-d252fd41-dc38-4e9b-b32d-4cc7d25bf88a tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:10:43.742616 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-d252fd41-dc38-4e9b-b32d-4cc7d25bf88a tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:10:43.743475 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-d252fd41-dc38-4e9b-b32d-4cc7d25bf88a tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:10:43.743914 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-d252fd41-dc38-4e9b-b32d-4cc7d25bf88a tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:10:43.772873 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-c8a28a99-ac7c-40be-82c0-9d0809746b3a tempest-DeleteServersTestJSON-1957240839 tempest-DeleteServersTestJSON-1957240839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3a049e77aba470db21e26d1bc8caa80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6027a602300d4d2bbf33ac329b2960f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:10:43.782707 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-c8a28a99-ac7c-40be-82c0-9d0809746b3a tempest-DeleteServersTestJSON-1957240839 tempest-DeleteServersTestJSON-1957240839-project] 10.222.0.23 "GET /compute/v2.1/servers/dcd9bb33-bad5-4d93-ba0f-558c63746e29" status: 200 len: 1503 microversion: 2.1 time: 0.225147 Oct 13 13:10:43.787248 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 71/128] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:10:43 2022] GET /compute/v2.1/servers/dcd9bb33-bad5-4d93-ba0f-558c63746e29 => generated 1503 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 13:10:43.902992 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-5d0e7191-2628-470a-8da6-4341172609bf tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Calling method '>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:10:43.903611 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-5d0e7191-2628-470a-8da6-4341172609bf tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] [instance: 26bd475b-3495-4669-9985-d4a7dedb4bbf] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:10:43.905456 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-d252fd41-dc38-4e9b-b32d-4cc7d25bf88a tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] 10.222.0.23 "GET /compute/v2.1/servers/e125ab44-9111-4260-909d-95d57b7861a7/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.178808 Oct 13 13:10:43.906110 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 58/129] 10.222.0.23 () {58 vars in 1275 bytes} [Thu Oct 13 13:10:43 2022] GET /compute/v2.1/servers/e125ab44-9111-4260-909d-95d57b7861a7/os-interface => generated 285 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 13:10:43.910891 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [req-21738865-bd61-4298-954b-8e17ffca580f req-28159674-a4e3-452b-84b2-54d575456dad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "96c829cb-4dde-467c-b50f-b2f666bdab0b", "name": "network-vif-plugged", "status": "completed", "tag": "68ffba56-b1dd-4e82-b93a-56dd6b99c0b9"}]} {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 13:10:43.918585 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-5d0e7191-2628-470a-8da6-4341172609bf tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:10:43.919093 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-5d0e7191-2628-470a-8da6-4341172609bf tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:10:43.919545 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-5d0e7191-2628-470a-8da6-4341172609bf tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:10:43.920248 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-5d0e7191-2628-470a-8da6-4341172609bf tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:10:43.920703 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-5d0e7191-2628-470a-8da6-4341172609bf tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:10:43.925131 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [req-21738865-bd61-4298-954b-8e17ffca580f req-28159674-a4e3-452b-84b2-54d575456dad service nova] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:10:43.925618 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [req-21738865-bd61-4298-954b-8e17ffca580f req-28159674-a4e3-452b-84b2-54d575456dad service nova] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:10:43.926047 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [req-21738865-bd61-4298-954b-8e17ffca580f req-28159674-a4e3-452b-84b2-54d575456dad service nova] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:10:43.929695 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-5d0e7191-2628-470a-8da6-4341172609bf tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:10:43.941036 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.compute.server_external_events [req-21738865-bd61-4298-954b-8e17ffca580f req-28159674-a4e3-452b-84b2-54d575456dad service nova] Creating event network-vif-plugged:68ffba56-b1dd-4e82-b93a-56dd6b99c0b9 for instance 96c829cb-4dde-467c-b50f-b2f666bdab0b on hv-cinder-82660 Oct 13 13:10:43.952070 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [req-21738865-bd61-4298-954b-8e17ffca580f req-28159674-a4e3-452b-84b2-54d575456dad service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043853 Oct 13 13:10:43.952743 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 59/130] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 13:10:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 13:10:43.989841 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-f67cb5fe-d978-494c-bf58-fe4b0f043d6f tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Calling method '>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:10:43.992299 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-f67cb5fe-d978-494c-bf58-fe4b0f043d6f tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] [instance: 96c829cb-4dde-467c-b50f-b2f666bdab0b] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:10:44.003631 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-f67cb5fe-d978-494c-bf58-fe4b0f043d6f tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:10:44.004755 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-f67cb5fe-d978-494c-bf58-fe4b0f043d6f tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:10:44.005355 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-f67cb5fe-d978-494c-bf58-fe4b0f043d6f tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:10:44.006359 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-f67cb5fe-d978-494c-bf58-fe4b0f043d6f tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:10:44.008004 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-f67cb5fe-d978-494c-bf58-fe4b0f043d6f tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:10:44.008614 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-f67cb5fe-d978-494c-bf58-fe4b0f043d6f tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:10:44.470903 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-f67cb5fe-d978-494c-bf58-fe4b0f043d6f tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '454203f47b434cca952a1cef56de559f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7312d0ac9248f2bfbece5611913ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:10:44.488778 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-f67cb5fe-d978-494c-bf58-fe4b0f043d6f tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] 10.222.0.23 "GET /compute/v2.1/servers/96c829cb-4dde-467c-b50f-b2f666bdab0b" status: 200 len: 1322 microversion: 2.1 time: 0.505928 Oct 13 13:10:44.491909 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 60/131] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:10:43 2022] GET /compute/v2.1/servers/96c829cb-4dde-467c-b50f-b2f666bdab0b => generated 1322 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:10:44.530580 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-5d0e7191-2628-470a-8da6-4341172609bf tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:10:44.549660 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-5d0e7191-2628-470a-8da6-4341172609bf tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:10:44.562952 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-5d0e7191-2628-470a-8da6-4341172609bf tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:10:44.564236 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-5d0e7191-2628-470a-8da6-4341172609bf tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] 10.222.0.23 "GET /compute/v2.1/servers/26bd475b-3495-4669-9985-d4a7dedb4bbf" status: 200 len: 1407 microversion: 2.20 time: 0.666339 Oct 13 13:10:44.565434 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 72/132] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 13:10:43 2022] GET /compute/v2.1/servers/26bd475b-3495-4669-9985-d4a7dedb4bbf => generated 1407 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 13 13:10:45.428439 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-2c34dd1e-2301-4b42-b06e-d1c4ad661e5c tempest-DeleteServersTestJSON-1957240839 tempest-DeleteServersTestJSON-1957240839-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e5993def-eb0d-46b6-a086-6e0cb40cbd91"}} {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 13:10:45.430892 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-2c34dd1e-2301-4b42-b06e-d1c4ad661e5c tempest-DeleteServersTestJSON-1957240839 tempest-DeleteServersTestJSON-1957240839-project] [instance: dcd9bb33-bad5-4d93-ba0f-558c63746e29] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:10:45.437156 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-2c34dd1e-2301-4b42-b06e-d1c4ad661e5c tempest-DeleteServersTestJSON-1957240839 tempest-DeleteServersTestJSON-1957240839-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:10:45.437569 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-2c34dd1e-2301-4b42-b06e-d1c4ad661e5c tempest-DeleteServersTestJSON-1957240839 tempest-DeleteServersTestJSON-1957240839-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:10:45.438003 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-2c34dd1e-2301-4b42-b06e-d1c4ad661e5c tempest-DeleteServersTestJSON-1957240839 tempest-DeleteServersTestJSON-1957240839-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:10:45.438693 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-2c34dd1e-2301-4b42-b06e-d1c4ad661e5c tempest-DeleteServersTestJSON-1957240839 tempest-DeleteServersTestJSON-1957240839-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:10:45.439165 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-2c34dd1e-2301-4b42-b06e-d1c4ad661e5c tempest-DeleteServersTestJSON-1957240839 tempest-DeleteServersTestJSON-1957240839-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:10:45.439793 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-2c34dd1e-2301-4b42-b06e-d1c4ad661e5c tempest-DeleteServersTestJSON-1957240839 tempest-DeleteServersTestJSON-1957240839-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:10:45.517220 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-be601f3c-a2db-4063-8c00-eef54b36dfe6 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Calling method '>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:10:45.518453 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-be601f3c-a2db-4063-8c00-eef54b36dfe6 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] [instance: 96c829cb-4dde-467c-b50f-b2f666bdab0b] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:10:45.528597 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-be601f3c-a2db-4063-8c00-eef54b36dfe6 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:10:45.529425 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-be601f3c-a2db-4063-8c00-eef54b36dfe6 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:10:45.530285 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-be601f3c-a2db-4063-8c00-eef54b36dfe6 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:10:45.531272 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-be601f3c-a2db-4063-8c00-eef54b36dfe6 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:10:45.532362 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-be601f3c-a2db-4063-8c00-eef54b36dfe6 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:10:45.533199 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-be601f3c-a2db-4063-8c00-eef54b36dfe6 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:10:45.824057 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-be601f3c-a2db-4063-8c00-eef54b36dfe6 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '454203f47b434cca952a1cef56de559f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7312d0ac9248f2bfbece5611913ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:10:45.834570 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-be601f3c-a2db-4063-8c00-eef54b36dfe6 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] 10.222.0.23 "GET /compute/v2.1/servers/96c829cb-4dde-467c-b50f-b2f666bdab0b" status: 200 len: 1322 microversion: 2.1 time: 0.322104 Oct 13 13:10:45.841434 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 73/133] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:10:45 2022] GET /compute/v2.1/servers/96c829cb-4dde-467c-b50f-b2f666bdab0b => generated 1322 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:10:45.855785 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-28c78325-37d8-4b85-b322-47116ee2a83f tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Calling method '>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:10:45.856539 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-28c78325-37d8-4b85-b322-47116ee2a83f tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] [instance: 26bd475b-3495-4669-9985-d4a7dedb4bbf] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:10:45.871839 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-28c78325-37d8-4b85-b322-47116ee2a83f tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:10:45.872761 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-28c78325-37d8-4b85-b322-47116ee2a83f tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:10:45.873346 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-28c78325-37d8-4b85-b322-47116ee2a83f tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:10:45.874084 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-28c78325-37d8-4b85-b322-47116ee2a83f tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:10:45.874539 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-28c78325-37d8-4b85-b322-47116ee2a83f tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:10:45.874963 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-28c78325-37d8-4b85-b322-47116ee2a83f tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:10:45.880214 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG dbcounter [-] [118814] Writing DB stats nova_cell1:SELECT=100 {{(pid=118814) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:10:46.193963 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-28c78325-37d8-4b85-b322-47116ee2a83f tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:10:46.210362 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-28c78325-37d8-4b85-b322-47116ee2a83f tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:10:46.215683 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-28c78325-37d8-4b85-b322-47116ee2a83f tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:10:46.219113 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-28c78325-37d8-4b85-b322-47116ee2a83f tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] 10.222.0.23 "GET /compute/v2.1/servers/26bd475b-3495-4669-9985-d4a7dedb4bbf" status: 200 len: 1599 microversion: 2.20 time: 0.374990 Oct 13 13:10:46.222282 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 74/134] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 13:10:45 2022] GET /compute/v2.1/servers/26bd475b-3495-4669-9985-d4a7dedb4bbf => generated 1599 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 13:10:46.230382 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [req-3ba015d5-5b67-4dee-8cb0-f4a179d9ada4 req-0723bcb0-dccd-4283-916f-791d4535435e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e125ab44-9111-4260-909d-95d57b7861a7", "tag": "95c8323b-318e-4698-a732-2714f447a0ff"}]} {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 13:10:46.258838 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [req-3ba015d5-5b67-4dee-8cb0-f4a179d9ada4 req-0723bcb0-dccd-4283-916f-791d4535435e service nova] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:10:46.259565 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [req-3ba015d5-5b67-4dee-8cb0-f4a179d9ada4 req-0723bcb0-dccd-4283-916f-791d4535435e service nova] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:10:46.260100 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [req-3ba015d5-5b67-4dee-8cb0-f4a179d9ada4 req-0723bcb0-dccd-4283-916f-791d4535435e service nova] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:10:46.284207 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.compute.server_external_events [req-3ba015d5-5b67-4dee-8cb0-f4a179d9ada4 req-0723bcb0-dccd-4283-916f-791d4535435e service nova] Creating event network-changed:95c8323b-318e-4698-a732-2714f447a0ff for instance e125ab44-9111-4260-909d-95d57b7861a7 on hv-cinder-82660 Oct 13 13:10:46.300894 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [req-3ba015d5-5b67-4dee-8cb0-f4a179d9ada4 req-0723bcb0-dccd-4283-916f-791d4535435e service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070004 Oct 13 13:10:46.306433 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 75/135] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 13:10:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 13:10:46.319979 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-84661aa2-66f1-41a0-8cc6-e64de22fc2f1 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Calling method '>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:10:46.321906 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-84661aa2-66f1-41a0-8cc6-e64de22fc2f1 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] [instance: 26bd475b-3495-4669-9985-d4a7dedb4bbf] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:10:46.337724 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-84661aa2-66f1-41a0-8cc6-e64de22fc2f1 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:10:46.338413 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-84661aa2-66f1-41a0-8cc6-e64de22fc2f1 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:10:46.339014 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-84661aa2-66f1-41a0-8cc6-e64de22fc2f1 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:10:46.340374 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-84661aa2-66f1-41a0-8cc6-e64de22fc2f1 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:10:46.341162 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-84661aa2-66f1-41a0-8cc6-e64de22fc2f1 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:10:46.343939 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-84661aa2-66f1-41a0-8cc6-e64de22fc2f1 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:10:46.515880 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-84661aa2-66f1-41a0-8cc6-e64de22fc2f1 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] 10.222.0.23 "GET /compute/v2.1/servers/26bd475b-3495-4669-9985-d4a7dedb4bbf/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.207324 Oct 13 13:10:46.516831 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 76/136] 10.222.0.23 () {60 vars in 1316 bytes} [Thu Oct 13 13:10:46 2022] GET /compute/v2.1/servers/26bd475b-3495-4669-9985-d4a7dedb4bbf/os-interface => generated 285 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 13 13:10:46.706949 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-2c34dd1e-2301-4b42-b06e-d1c4ad661e5c tempest-DeleteServersTestJSON-1957240839 tempest-DeleteServersTestJSON-1957240839-project] 10.222.0.23 "POST /compute/v2.1/servers/dcd9bb33-bad5-4d93-ba0f-558c63746e29/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.282014 Oct 13 13:10:46.712942 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 61/137] 10.222.0.23 () {60 vars in 1323 bytes} [Thu Oct 13 13:10:45 2022] POST /compute/v2.1/servers/dcd9bb33-bad5-4d93-ba0f-558c63746e29/os-volume_attachments => generated 194 bytes in 1289 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 13:10:46.863028 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-ff854005-ec3f-4e3e-b872-bd1fc94feaf0 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Calling method '>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:10:46.863768 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-ff854005-ec3f-4e3e-b872-bd1fc94feaf0 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] [instance: 96c829cb-4dde-467c-b50f-b2f666bdab0b] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:10:46.874548 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-ff854005-ec3f-4e3e-b872-bd1fc94feaf0 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:10:46.875235 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-ff854005-ec3f-4e3e-b872-bd1fc94feaf0 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:10:46.875776 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-ff854005-ec3f-4e3e-b872-bd1fc94feaf0 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:10:46.876582 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-ff854005-ec3f-4e3e-b872-bd1fc94feaf0 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:10:46.878529 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-ff854005-ec3f-4e3e-b872-bd1fc94feaf0 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:10:46.879362 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-ff854005-ec3f-4e3e-b872-bd1fc94feaf0 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:10:47.262179 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-ff854005-ec3f-4e3e-b872-bd1fc94feaf0 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '454203f47b434cca952a1cef56de559f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7312d0ac9248f2bfbece5611913ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:10:47.270040 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-ff854005-ec3f-4e3e-b872-bd1fc94feaf0 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] 10.222.0.23 "GET /compute/v2.1/servers/96c829cb-4dde-467c-b50f-b2f666bdab0b" status: 200 len: 1516 microversion: 2.1 time: 0.411219 Oct 13 13:10:47.270803 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 77/138] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:10:46 2022] GET /compute/v2.1/servers/96c829cb-4dde-467c-b50f-b2f666bdab0b => generated 1516 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 13:10:47.295294 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-61e91600-a55b-4f84-9b5f-0d9dea4bf089 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 13:10:47.298439 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-61e91600-a55b-4f84-9b5f-0d9dea4bf089 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] [instance: 96c829cb-4dde-467c-b50f-b2f666bdab0b] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:10:47.305608 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-61e91600-a55b-4f84-9b5f-0d9dea4bf089 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:10:47.306280 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-61e91600-a55b-4f84-9b5f-0d9dea4bf089 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:10:47.306909 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-61e91600-a55b-4f84-9b5f-0d9dea4bf089 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:10:47.307801 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-61e91600-a55b-4f84-9b5f-0d9dea4bf089 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:10:47.308401 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-61e91600-a55b-4f84-9b5f-0d9dea4bf089 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:10:47.308975 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-61e91600-a55b-4f84-9b5f-0d9dea4bf089 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:10:47.335619 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.objects.instance [None req-61e91600-a55b-4f84-9b5f-0d9dea4bf089 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lazy-loading 'flavor' on Instance uuid 96c829cb-4dde-467c-b50f-b2f666bdab0b {{(pid=118815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 13 13:10:47.470851 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-61e91600-a55b-4f84-9b5f-0d9dea4bf089 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] 10.222.0.23 "POST /compute/v2.1/servers/96c829cb-4dde-467c-b50f-b2f666bdab0b/action" status: 200 len: 32 microversion: 2.1 time: 0.180390 Oct 13 13:10:47.471674 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 62/139] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Oct 13 13:10:47 2022] POST /compute/v2.1/servers/96c829cb-4dde-467c-b50f-b2f666bdab0b/action => generated 32 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 13 13:10:47.482092 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-0b7ec139-e087-436a-b057-ec3107754bfc tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Calling method '>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:10:47.483045 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-0b7ec139-e087-436a-b057-ec3107754bfc tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] [instance: 96c829cb-4dde-467c-b50f-b2f666bdab0b] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:10:47.490219 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-0b7ec139-e087-436a-b057-ec3107754bfc tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:10:47.491575 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-0b7ec139-e087-436a-b057-ec3107754bfc tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:10:47.492747 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-0b7ec139-e087-436a-b057-ec3107754bfc tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:10:47.493697 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-0b7ec139-e087-436a-b057-ec3107754bfc tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:10:47.494521 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-0b7ec139-e087-436a-b057-ec3107754bfc tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:10:47.495230 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-0b7ec139-e087-436a-b057-ec3107754bfc tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:10:47.960061 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-0b7ec139-e087-436a-b057-ec3107754bfc tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '454203f47b434cca952a1cef56de559f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7312d0ac9248f2bfbece5611913ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:10:47.974063 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-0b7ec139-e087-436a-b057-ec3107754bfc tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] 10.222.0.23 "GET /compute/v2.1/servers/96c829cb-4dde-467c-b50f-b2f666bdab0b" status: 200 len: 1522 microversion: 2.1 time: 0.496214 Oct 13 13:10:47.988916 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 78/140] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:10:47 2022] GET /compute/v2.1/servers/96c829cb-4dde-467c-b50f-b2f666bdab0b => generated 1522 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:10:48.319815 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [req-2bb61145-71a0-4eff-b31e-d119142de258 req-ba2eb12a-9ca4-47e3-803e-24e23309900a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "26bd475b-3495-4669-9985-d4a7dedb4bbf", "tag": "bd0eddba-ab0b-4c35-805b-853067734898"}]} {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 13:10:48.331799 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [req-2bb61145-71a0-4eff-b31e-d119142de258 req-ba2eb12a-9ca4-47e3-803e-24e23309900a service nova] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:10:48.332273 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [req-2bb61145-71a0-4eff-b31e-d119142de258 req-ba2eb12a-9ca4-47e3-803e-24e23309900a service nova] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:10:48.332861 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [req-2bb61145-71a0-4eff-b31e-d119142de258 req-ba2eb12a-9ca4-47e3-803e-24e23309900a service nova] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:10:48.343594 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.compute.server_external_events [req-2bb61145-71a0-4eff-b31e-d119142de258 req-ba2eb12a-9ca4-47e3-803e-24e23309900a service nova] Creating event network-changed:bd0eddba-ab0b-4c35-805b-853067734898 for instance 26bd475b-3495-4669-9985-d4a7dedb4bbf on hv-cinder-82660 Oct 13 13:10:48.348997 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [req-2bb61145-71a0-4eff-b31e-d119142de258 req-ba2eb12a-9ca4-47e3-803e-24e23309900a service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033627 Oct 13 13:10:48.349684 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 63/141] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 13:10:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 13:10:49.002306 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-eb030cf9-ba0c-4a0c-8f0c-834c167a470f tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Calling method '>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:10:49.002923 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-eb030cf9-ba0c-4a0c-8f0c-834c167a470f tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] [instance: 96c829cb-4dde-467c-b50f-b2f666bdab0b] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:10:49.013482 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-eb030cf9-ba0c-4a0c-8f0c-834c167a470f tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:10:49.014328 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-eb030cf9-ba0c-4a0c-8f0c-834c167a470f tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:10:49.014774 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-eb030cf9-ba0c-4a0c-8f0c-834c167a470f tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:10:49.015768 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-eb030cf9-ba0c-4a0c-8f0c-834c167a470f tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:10:49.018282 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-eb030cf9-ba0c-4a0c-8f0c-834c167a470f tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:10:49.018726 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-eb030cf9-ba0c-4a0c-8f0c-834c167a470f tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:10:49.193917 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-eb030cf9-ba0c-4a0c-8f0c-834c167a470f tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '454203f47b434cca952a1cef56de559f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7312d0ac9248f2bfbece5611913ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:10:49.201984 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-eb030cf9-ba0c-4a0c-8f0c-834c167a470f tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] 10.222.0.23 "GET /compute/v2.1/servers/96c829cb-4dde-467c-b50f-b2f666bdab0b" status: 200 len: 1522 microversion: 2.1 time: 0.206573 Oct 13 13:10:49.202562 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 79/142] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:10:48 2022] GET /compute/v2.1/servers/96c829cb-4dde-467c-b50f-b2f666bdab0b => generated 1522 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:10:50.227618 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-6b6db847-450c-434e-b4a9-3616c62f1d35 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Calling method '>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:10:50.228309 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-6b6db847-450c-434e-b4a9-3616c62f1d35 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] [instance: 96c829cb-4dde-467c-b50f-b2f666bdab0b] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:10:50.234600 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-6b6db847-450c-434e-b4a9-3616c62f1d35 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:10:50.235108 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-6b6db847-450c-434e-b4a9-3616c62f1d35 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:10:50.235544 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-6b6db847-450c-434e-b4a9-3616c62f1d35 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:10:50.236230 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-6b6db847-450c-434e-b4a9-3616c62f1d35 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:10:50.236677 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-6b6db847-450c-434e-b4a9-3616c62f1d35 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:10:50.237095 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-6b6db847-450c-434e-b4a9-3616c62f1d35 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:10:50.386496 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-6b6db847-450c-434e-b4a9-3616c62f1d35 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '454203f47b434cca952a1cef56de559f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7312d0ac9248f2bfbece5611913ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:10:50.395572 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-6b6db847-450c-434e-b4a9-3616c62f1d35 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] 10.222.0.23 "GET /compute/v2.1/servers/96c829cb-4dde-467c-b50f-b2f666bdab0b" status: 200 len: 1522 microversion: 2.1 time: 0.173675 Oct 13 13:10:50.396151 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 64/143] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:10:50 2022] GET /compute/v2.1/servers/96c829cb-4dde-467c-b50f-b2f666bdab0b => generated 1522 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:10:50.504001 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-6276b73c-9166-403f-b0af-5d1e4823de6e tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1694150199", "imageRef": "e2cdd20b-2540-48bc-a05c-d6a2e7e9a66e", "flavorRef": "452", "networks": [{"uuid": "5b4f82fe-1259-480a-b97a-2403a9b4130d"}]}} {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 13:10:50.562682 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.network.neutron [None req-6276b73c-9166-403f-b0af-5d1e4823de6e tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] validate_networks() for [('5b4f82fe-1259-480a-b97a-2403a9b4130d', None, None, None, None, None)] {{(pid=118814) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 13 13:10:50.941764 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.virt.hardware [None req-6276b73c-9166-403f-b0af-5d1e4823de6e tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Flavor limits 0:0:0 {{(pid=118814) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 13 13:10:50.942956 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.virt.hardware [None req-6276b73c-9166-403f-b0af-5d1e4823de6e tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Image limits 0:0:0 {{(pid=118814) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 13 13:10:50.943551 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.virt.hardware [None req-6276b73c-9166-403f-b0af-5d1e4823de6e tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Flavor pref 0:0:0 {{(pid=118814) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 13 13:10:50.943972 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.virt.hardware [None req-6276b73c-9166-403f-b0af-5d1e4823de6e tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Image pref 0:0:0 {{(pid=118814) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 13 13:10:50.944419 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.virt.hardware [None req-6276b73c-9166-403f-b0af-5d1e4823de6e tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118814) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 13 13:10:50.954443 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-6276b73c-9166-403f-b0af-5d1e4823de6e tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:10:50.954921 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-6276b73c-9166-403f-b0af-5d1e4823de6e tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:10:50.955410 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-6276b73c-9166-403f-b0af-5d1e4823de6e tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:10:50.956133 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-6276b73c-9166-403f-b0af-5d1e4823de6e tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:10:50.956586 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-6276b73c-9166-403f-b0af-5d1e4823de6e tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:10:50.957320 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-6276b73c-9166-403f-b0af-5d1e4823de6e tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:10:50.977116 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.quota [None req-6276b73c-9166-403f-b0af-5d1e4823de6e tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Getting quotas for project f85144e13e254365a86aa785093c8575. Resources: {'instances', 'cores', 'ram'} {{(pid=118814) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 13 13:10:50.979442 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG dbcounter [-] [118814] Writing DB stats nova_api:SELECT=100 {{(pid=118814) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:10:50.984379 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.quota [None req-6276b73c-9166-403f-b0af-5d1e4823de6e tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Getting quotas for user 8569afc405f24a0993a023c818a0c272 and project f85144e13e254365a86aa785093c8575. Resources: {'instances', 'cores', 'ram'} {{(pid=118814) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 13 13:10:51.003266 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-6276b73c-9166-403f-b0af-5d1e4823de6e tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Going to run 1 instances... {{(pid=118814) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 13 13:10:51.006001 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-6276b73c-9166-403f-b0af-5d1e4823de6e tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] [instance: 6a4a7328-d884-4015-aadc-aa5062a77724] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e2cdd20b-2540-48bc-a05c-d6a2e7e9a66e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118814) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 13 13:10:51.076493 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-6276b73c-9166-403f-b0af-5d1e4823de6e tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.575981 Oct 13 13:10:51.077166 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 80/144] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Oct 13 13:10:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 578 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 13 13:10:51.091110 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-05920ffe-c62c-4863-82b3-8cea850c7bba tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Calling method '>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:10:51.091934 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-05920ffe-c62c-4863-82b3-8cea850c7bba tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] [instance: 6a4a7328-d884-4015-aadc-aa5062a77724] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:10:51.193335 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-05920ffe-c62c-4863-82b3-8cea850c7bba tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8569afc405f24a0993a023c818a0c272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f85144e13e254365a86aa785093c8575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:10:51.219241 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-05920ffe-c62c-4863-82b3-8cea850c7bba tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] 10.222.0.23 "GET /compute/v2.1/servers/6a4a7328-d884-4015-aadc-aa5062a77724" status: 200 len: 1219 microversion: 2.1 time: 0.133534 Oct 13 13:10:51.222701 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 65/145] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:10:51 2022] GET /compute/v2.1/servers/6a4a7328-d884-4015-aadc-aa5062a77724 => generated 1219 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:10:51.420590 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-7a006a2b-d971-4b94-9ff8-d08978d44c28 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Calling method '>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:10:51.421270 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-7a006a2b-d971-4b94-9ff8-d08978d44c28 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] [instance: 96c829cb-4dde-467c-b50f-b2f666bdab0b] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:10:51.439282 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-7a006a2b-d971-4b94-9ff8-d08978d44c28 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:10:51.439788 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-7a006a2b-d971-4b94-9ff8-d08978d44c28 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:10:51.440289 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-7a006a2b-d971-4b94-9ff8-d08978d44c28 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:10:51.441359 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-7a006a2b-d971-4b94-9ff8-d08978d44c28 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:10:51.442035 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-7a006a2b-d971-4b94-9ff8-d08978d44c28 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:10:51.442616 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-7a006a2b-d971-4b94-9ff8-d08978d44c28 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:10:51.749136 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-7a006a2b-d971-4b94-9ff8-d08978d44c28 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '454203f47b434cca952a1cef56de559f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7312d0ac9248f2bfbece5611913ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:10:51.761131 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-7a006a2b-d971-4b94-9ff8-d08978d44c28 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] 10.222.0.23 "GET /compute/v2.1/servers/96c829cb-4dde-467c-b50f-b2f666bdab0b" status: 200 len: 1522 microversion: 2.1 time: 0.345663 Oct 13 13:10:51.762133 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 81/146] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:10:51 2022] GET /compute/v2.1/servers/96c829cb-4dde-467c-b50f-b2f666bdab0b => generated 1522 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:10:52.249893 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-cd3157ae-1321-428a-bba0-5aeaa61bfeac tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Calling method '>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:10:52.250690 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-cd3157ae-1321-428a-bba0-5aeaa61bfeac tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] [instance: 6a4a7328-d884-4015-aadc-aa5062a77724] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:10:52.258735 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-cd3157ae-1321-428a-bba0-5aeaa61bfeac tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:10:52.259240 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-cd3157ae-1321-428a-bba0-5aeaa61bfeac tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:10:52.259680 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-cd3157ae-1321-428a-bba0-5aeaa61bfeac tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:10:52.260375 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-cd3157ae-1321-428a-bba0-5aeaa61bfeac tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:10:52.260829 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-cd3157ae-1321-428a-bba0-5aeaa61bfeac tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:10:52.261253 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-cd3157ae-1321-428a-bba0-5aeaa61bfeac tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:10:52.326578 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-cd3157ae-1321-428a-bba0-5aeaa61bfeac tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8569afc405f24a0993a023c818a0c272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f85144e13e254365a86aa785093c8575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:10:52.334525 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-cd3157ae-1321-428a-bba0-5aeaa61bfeac tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] 10.222.0.23 "GET /compute/v2.1/servers/6a4a7328-d884-4015-aadc-aa5062a77724" status: 200 len: 1271 microversion: 2.1 time: 0.088639 Oct 13 13:10:52.336190 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 66/147] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:10:52 2022] GET /compute/v2.1/servers/6a4a7328-d884-4015-aadc-aa5062a77724 => generated 1271 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:10:52.788583 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-ef58c938-783c-4dc2-ab57-944091b76d3b tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Calling method '>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:10:52.789760 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-ef58c938-783c-4dc2-ab57-944091b76d3b tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] [instance: 96c829cb-4dde-467c-b50f-b2f666bdab0b] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:10:52.802965 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-ef58c938-783c-4dc2-ab57-944091b76d3b tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:10:52.803557 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-ef58c938-783c-4dc2-ab57-944091b76d3b tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:10:52.804062 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-ef58c938-783c-4dc2-ab57-944091b76d3b tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:10:52.804875 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-ef58c938-783c-4dc2-ab57-944091b76d3b tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:10:52.805391 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-ef58c938-783c-4dc2-ab57-944091b76d3b tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:10:52.805874 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-ef58c938-783c-4dc2-ab57-944091b76d3b tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:10:52.938015 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-ef58c938-783c-4dc2-ab57-944091b76d3b tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '454203f47b434cca952a1cef56de559f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7312d0ac9248f2bfbece5611913ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:10:52.946331 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-ef58c938-783c-4dc2-ab57-944091b76d3b tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] 10.222.0.23 "GET /compute/v2.1/servers/96c829cb-4dde-467c-b50f-b2f666bdab0b" status: 200 len: 1522 microversion: 2.1 time: 0.162087 Oct 13 13:10:52.946904 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 82/148] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:10:52 2022] GET /compute/v2.1/servers/96c829cb-4dde-467c-b50f-b2f666bdab0b => generated 1522 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:10:53.358929 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-d26a982a-2278-4204-b7bb-0659aa56d598 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Calling method '>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:10:53.359738 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-d26a982a-2278-4204-b7bb-0659aa56d598 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] [instance: 6a4a7328-d884-4015-aadc-aa5062a77724] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:10:53.368909 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-d26a982a-2278-4204-b7bb-0659aa56d598 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:10:53.371486 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-d26a982a-2278-4204-b7bb-0659aa56d598 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:10:53.372993 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-d26a982a-2278-4204-b7bb-0659aa56d598 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:10:53.378617 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-d26a982a-2278-4204-b7bb-0659aa56d598 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:10:53.379291 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-d26a982a-2278-4204-b7bb-0659aa56d598 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:10:53.380149 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-d26a982a-2278-4204-b7bb-0659aa56d598 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:10:53.572973 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-d26a982a-2278-4204-b7bb-0659aa56d598 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8569afc405f24a0993a023c818a0c272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f85144e13e254365a86aa785093c8575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:10:53.585629 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-d26a982a-2278-4204-b7bb-0659aa56d598 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] 10.222.0.23 "GET /compute/v2.1/servers/6a4a7328-d884-4015-aadc-aa5062a77724" status: 200 len: 1319 microversion: 2.1 time: 0.231117 Oct 13 13:10:53.586854 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 67/149] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:10:53 2022] GET /compute/v2.1/servers/6a4a7328-d884-4015-aadc-aa5062a77724 => generated 1319 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:10:53.972340 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-39cde0ab-dff7-44e7-a8f8-951d9cf7da71 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Calling method '>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:10:53.973831 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-39cde0ab-dff7-44e7-a8f8-951d9cf7da71 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] [instance: 96c829cb-4dde-467c-b50f-b2f666bdab0b] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:10:53.981000 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-39cde0ab-dff7-44e7-a8f8-951d9cf7da71 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:10:53.981766 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-39cde0ab-dff7-44e7-a8f8-951d9cf7da71 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:10:53.982350 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-39cde0ab-dff7-44e7-a8f8-951d9cf7da71 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:10:53.983424 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-39cde0ab-dff7-44e7-a8f8-951d9cf7da71 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:10:53.984417 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-39cde0ab-dff7-44e7-a8f8-951d9cf7da71 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:10:53.984987 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-39cde0ab-dff7-44e7-a8f8-951d9cf7da71 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:10:54.183622 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-39cde0ab-dff7-44e7-a8f8-951d9cf7da71 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '454203f47b434cca952a1cef56de559f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7312d0ac9248f2bfbece5611913ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:10:54.194571 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-39cde0ab-dff7-44e7-a8f8-951d9cf7da71 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] 10.222.0.23 "GET /compute/v2.1/servers/96c829cb-4dde-467c-b50f-b2f666bdab0b" status: 200 len: 1522 microversion: 2.1 time: 0.227562 Oct 13 13:10:54.196353 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 83/150] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:10:53 2022] GET /compute/v2.1/servers/96c829cb-4dde-467c-b50f-b2f666bdab0b => generated 1522 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:10:54.392828 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [req-9e3bd75a-2eb7-4320-899b-8b9e7c31ea7a req-060a244b-911c-4587-9118-c5a1af174cae service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6a4a7328-d884-4015-aadc-aa5062a77724", "tag": "879af4f7-b860-4ff7-afae-5448deb00962"}]} {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 13:10:54.415119 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [req-9e3bd75a-2eb7-4320-899b-8b9e7c31ea7a req-060a244b-911c-4587-9118-c5a1af174cae service nova] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:10:54.415713 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [req-9e3bd75a-2eb7-4320-899b-8b9e7c31ea7a req-060a244b-911c-4587-9118-c5a1af174cae service nova] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:10:54.416143 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [req-9e3bd75a-2eb7-4320-899b-8b9e7c31ea7a req-060a244b-911c-4587-9118-c5a1af174cae service nova] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:10:54.428127 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.compute.server_external_events [req-9e3bd75a-2eb7-4320-899b-8b9e7c31ea7a req-060a244b-911c-4587-9118-c5a1af174cae service nova] Creating event network-changed:879af4f7-b860-4ff7-afae-5448deb00962 for instance 6a4a7328-d884-4015-aadc-aa5062a77724 on hv-cinder-82660 Oct 13 13:10:54.435038 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [req-9e3bd75a-2eb7-4320-899b-8b9e7c31ea7a req-060a244b-911c-4587-9118-c5a1af174cae service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046261 Oct 13 13:10:54.435945 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 68/151] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 13:10:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 13:10:54.614537 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-e35bd49c-96d0-430b-9091-cc9249431526 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Calling method '>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:10:54.615228 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-e35bd49c-96d0-430b-9091-cc9249431526 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] [instance: 6a4a7328-d884-4015-aadc-aa5062a77724] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:10:54.623480 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-e35bd49c-96d0-430b-9091-cc9249431526 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:10:54.623983 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-e35bd49c-96d0-430b-9091-cc9249431526 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:10:54.624430 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-e35bd49c-96d0-430b-9091-cc9249431526 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:10:54.625126 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-e35bd49c-96d0-430b-9091-cc9249431526 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:10:54.627232 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-e35bd49c-96d0-430b-9091-cc9249431526 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:10:54.628284 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-e35bd49c-96d0-430b-9091-cc9249431526 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:10:54.805002 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-e35bd49c-96d0-430b-9091-cc9249431526 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8569afc405f24a0993a023c818a0c272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f85144e13e254365a86aa785093c8575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:10:54.819575 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-e35bd49c-96d0-430b-9091-cc9249431526 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] 10.222.0.23 "GET /compute/v2.1/servers/6a4a7328-d884-4015-aadc-aa5062a77724" status: 200 len: 1319 microversion: 2.1 time: 0.209804 Oct 13 13:10:54.822831 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 84/152] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:10:54 2022] GET /compute/v2.1/servers/6a4a7328-d884-4015-aadc-aa5062a77724 => generated 1319 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:10:55.219024 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-3930887c-5181-4bf8-94fe-0bafe5c3cfa5 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Calling method '>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:10:55.219754 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-3930887c-5181-4bf8-94fe-0bafe5c3cfa5 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] [instance: 96c829cb-4dde-467c-b50f-b2f666bdab0b] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:10:55.227088 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-3930887c-5181-4bf8-94fe-0bafe5c3cfa5 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:10:55.227580 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-3930887c-5181-4bf8-94fe-0bafe5c3cfa5 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:10:55.228166 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-3930887c-5181-4bf8-94fe-0bafe5c3cfa5 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:10:55.228875 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-3930887c-5181-4bf8-94fe-0bafe5c3cfa5 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:10:55.229329 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-3930887c-5181-4bf8-94fe-0bafe5c3cfa5 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:10:55.229752 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-3930887c-5181-4bf8-94fe-0bafe5c3cfa5 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:10:55.234039 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG dbcounter [-] [118815] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=118815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:10:55.442047 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-3930887c-5181-4bf8-94fe-0bafe5c3cfa5 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '454203f47b434cca952a1cef56de559f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7312d0ac9248f2bfbece5611913ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:10:55.452255 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-3930887c-5181-4bf8-94fe-0bafe5c3cfa5 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] 10.222.0.23 "GET /compute/v2.1/servers/96c829cb-4dde-467c-b50f-b2f666bdab0b" status: 200 len: 1522 microversion: 2.1 time: 0.237878 Oct 13 13:10:55.453188 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 69/153] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:10:55 2022] GET /compute/v2.1/servers/96c829cb-4dde-467c-b50f-b2f666bdab0b => generated 1522 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:10:55.845131 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-b504399b-de47-4c49-ad04-971e03045e35 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Calling method '>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:10:55.845669 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-b504399b-de47-4c49-ad04-971e03045e35 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] [instance: 6a4a7328-d884-4015-aadc-aa5062a77724] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:10:55.851641 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-b504399b-de47-4c49-ad04-971e03045e35 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:10:55.852124 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-b504399b-de47-4c49-ad04-971e03045e35 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:10:55.852559 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-b504399b-de47-4c49-ad04-971e03045e35 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:10:55.853246 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-b504399b-de47-4c49-ad04-971e03045e35 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:10:55.853693 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-b504399b-de47-4c49-ad04-971e03045e35 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:10:55.854114 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-b504399b-de47-4c49-ad04-971e03045e35 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:10:55.989849 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-b504399b-de47-4c49-ad04-971e03045e35 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8569afc405f24a0993a023c818a0c272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f85144e13e254365a86aa785093c8575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:10:55.998001 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-b504399b-de47-4c49-ad04-971e03045e35 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] 10.222.0.23 "GET /compute/v2.1/servers/6a4a7328-d884-4015-aadc-aa5062a77724" status: 200 len: 1319 microversion: 2.1 time: 0.156866 Oct 13 13:10:55.998568 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 85/154] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:10:55 2022] GET /compute/v2.1/servers/6a4a7328-d884-4015-aadc-aa5062a77724 => generated 1319 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:10:56.475747 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-493ad588-7c83-4648-9e4f-5f9126c40117 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Calling method '>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:10:56.477036 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-493ad588-7c83-4648-9e4f-5f9126c40117 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] [instance: 96c829cb-4dde-467c-b50f-b2f666bdab0b] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:10:56.482376 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG dbcounter [-] [118815] Writing DB stats nova_api:SELECT=80 {{(pid=118815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:10:56.484168 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-493ad588-7c83-4648-9e4f-5f9126c40117 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:10:56.484653 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-493ad588-7c83-4648-9e4f-5f9126c40117 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:10:56.485083 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-493ad588-7c83-4648-9e4f-5f9126c40117 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:10:56.485794 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-493ad588-7c83-4648-9e4f-5f9126c40117 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:10:56.486263 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-493ad588-7c83-4648-9e4f-5f9126c40117 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:10:56.486659 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-493ad588-7c83-4648-9e4f-5f9126c40117 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:10:56.643223 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-493ad588-7c83-4648-9e4f-5f9126c40117 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '454203f47b434cca952a1cef56de559f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7312d0ac9248f2bfbece5611913ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:10:56.651626 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-493ad588-7c83-4648-9e4f-5f9126c40117 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] 10.222.0.23 "GET /compute/v2.1/servers/96c829cb-4dde-467c-b50f-b2f666bdab0b" status: 200 len: 1522 microversion: 2.1 time: 0.180476 Oct 13 13:10:56.652193 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 70/155] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:10:56 2022] GET /compute/v2.1/servers/96c829cb-4dde-467c-b50f-b2f666bdab0b => generated 1522 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:10:57.026789 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-9a2f41f5-dbe1-4ffc-8c84-40f08b2c4d05 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Calling method '>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:10:57.031618 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-9a2f41f5-dbe1-4ffc-8c84-40f08b2c4d05 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] [instance: 6a4a7328-d884-4015-aadc-aa5062a77724] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:10:57.041982 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-9a2f41f5-dbe1-4ffc-8c84-40f08b2c4d05 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:10:57.042480 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-9a2f41f5-dbe1-4ffc-8c84-40f08b2c4d05 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:10:57.042919 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-9a2f41f5-dbe1-4ffc-8c84-40f08b2c4d05 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:10:57.043702 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-9a2f41f5-dbe1-4ffc-8c84-40f08b2c4d05 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:10:57.044158 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-9a2f41f5-dbe1-4ffc-8c84-40f08b2c4d05 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:10:57.044584 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-9a2f41f5-dbe1-4ffc-8c84-40f08b2c4d05 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:10:57.201941 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-9a2f41f5-dbe1-4ffc-8c84-40f08b2c4d05 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8569afc405f24a0993a023c818a0c272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f85144e13e254365a86aa785093c8575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:10:57.211456 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-9a2f41f5-dbe1-4ffc-8c84-40f08b2c4d05 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] 10.222.0.23 "GET /compute/v2.1/servers/6a4a7328-d884-4015-aadc-aa5062a77724" status: 200 len: 1319 microversion: 2.1 time: 0.193110 Oct 13 13:10:57.212309 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 86/156] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:10:57 2022] GET /compute/v2.1/servers/6a4a7328-d884-4015-aadc-aa5062a77724 => generated 1319 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:10:57.675036 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-5fd94bde-c12e-4a4d-8be6-3c787fb9dacf tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Calling method '>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:10:57.675731 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-5fd94bde-c12e-4a4d-8be6-3c787fb9dacf tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] [instance: 96c829cb-4dde-467c-b50f-b2f666bdab0b] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:10:57.682955 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-5fd94bde-c12e-4a4d-8be6-3c787fb9dacf tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:10:57.683452 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-5fd94bde-c12e-4a4d-8be6-3c787fb9dacf tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:10:57.683884 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-5fd94bde-c12e-4a4d-8be6-3c787fb9dacf tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:10:57.684558 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-5fd94bde-c12e-4a4d-8be6-3c787fb9dacf tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:10:57.685003 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-5fd94bde-c12e-4a4d-8be6-3c787fb9dacf tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:10:57.685420 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-5fd94bde-c12e-4a4d-8be6-3c787fb9dacf tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:10:57.816192 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-5fd94bde-c12e-4a4d-8be6-3c787fb9dacf tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '454203f47b434cca952a1cef56de559f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7312d0ac9248f2bfbece5611913ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:10:57.823884 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-5fd94bde-c12e-4a4d-8be6-3c787fb9dacf tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] 10.222.0.23 "GET /compute/v2.1/servers/96c829cb-4dde-467c-b50f-b2f666bdab0b" status: 200 len: 1522 microversion: 2.1 time: 0.152576 Oct 13 13:10:57.824438 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 71/157] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:10:57 2022] GET /compute/v2.1/servers/96c829cb-4dde-467c-b50f-b2f666bdab0b => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:10:58.233643 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-2b77189b-7b24-4d9a-9ab2-01e92235d0ea tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Calling method '>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:10:58.234184 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-2b77189b-7b24-4d9a-9ab2-01e92235d0ea tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] [instance: 6a4a7328-d884-4015-aadc-aa5062a77724] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:10:58.240187 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-2b77189b-7b24-4d9a-9ab2-01e92235d0ea tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:10:58.240672 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-2b77189b-7b24-4d9a-9ab2-01e92235d0ea tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:10:58.241107 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-2b77189b-7b24-4d9a-9ab2-01e92235d0ea tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:10:58.241796 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-2b77189b-7b24-4d9a-9ab2-01e92235d0ea tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:10:58.242245 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-2b77189b-7b24-4d9a-9ab2-01e92235d0ea tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:10:58.242669 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-2b77189b-7b24-4d9a-9ab2-01e92235d0ea tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:10:58.369827 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-2b77189b-7b24-4d9a-9ab2-01e92235d0ea tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8569afc405f24a0993a023c818a0c272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f85144e13e254365a86aa785093c8575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:10:58.377924 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-2b77189b-7b24-4d9a-9ab2-01e92235d0ea tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] 10.222.0.23 "GET /compute/v2.1/servers/6a4a7328-d884-4015-aadc-aa5062a77724" status: 200 len: 1319 microversion: 2.1 time: 0.148067 Oct 13 13:10:58.378531 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 87/158] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:10:58 2022] GET /compute/v2.1/servers/6a4a7328-d884-4015-aadc-aa5062a77724 => generated 1319 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:10:58.845410 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-01d8f8c7-6cdd-4372-b3c4-7a887587b260 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Calling method '>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:10:58.846009 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-01d8f8c7-6cdd-4372-b3c4-7a887587b260 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] [instance: 96c829cb-4dde-467c-b50f-b2f666bdab0b] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:10:58.852300 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-01d8f8c7-6cdd-4372-b3c4-7a887587b260 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:10:58.852777 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-01d8f8c7-6cdd-4372-b3c4-7a887587b260 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:10:58.853211 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-01d8f8c7-6cdd-4372-b3c4-7a887587b260 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:10:58.853886 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-01d8f8c7-6cdd-4372-b3c4-7a887587b260 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:10:58.854329 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-01d8f8c7-6cdd-4372-b3c4-7a887587b260 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:10:58.854744 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-01d8f8c7-6cdd-4372-b3c4-7a887587b260 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:10:58.980133 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-01d8f8c7-6cdd-4372-b3c4-7a887587b260 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '454203f47b434cca952a1cef56de559f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7312d0ac9248f2bfbece5611913ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:10:58.987957 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-01d8f8c7-6cdd-4372-b3c4-7a887587b260 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] 10.222.0.23 "GET /compute/v2.1/servers/96c829cb-4dde-467c-b50f-b2f666bdab0b" status: 200 len: 1522 microversion: 2.1 time: 0.146300 Oct 13 13:10:58.988514 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 72/159] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:10:58 2022] GET /compute/v2.1/servers/96c829cb-4dde-467c-b50f-b2f666bdab0b => generated 1522 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:10:59.401138 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-252fc038-4b3a-471d-ba4b-00bcc719f071 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Calling method '>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:10:59.402019 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-252fc038-4b3a-471d-ba4b-00bcc719f071 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] [instance: 6a4a7328-d884-4015-aadc-aa5062a77724] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:10:59.408128 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-252fc038-4b3a-471d-ba4b-00bcc719f071 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:10:59.408633 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-252fc038-4b3a-471d-ba4b-00bcc719f071 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:10:59.409063 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-252fc038-4b3a-471d-ba4b-00bcc719f071 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:10:59.409743 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-252fc038-4b3a-471d-ba4b-00bcc719f071 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:10:59.410188 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-252fc038-4b3a-471d-ba4b-00bcc719f071 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:10:59.410608 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-252fc038-4b3a-471d-ba4b-00bcc719f071 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:10:59.537676 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-252fc038-4b3a-471d-ba4b-00bcc719f071 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8569afc405f24a0993a023c818a0c272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f85144e13e254365a86aa785093c8575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:10:59.545919 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-252fc038-4b3a-471d-ba4b-00bcc719f071 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] 10.222.0.23 "GET /compute/v2.1/servers/6a4a7328-d884-4015-aadc-aa5062a77724" status: 200 len: 1319 microversion: 2.1 time: 0.149115 Oct 13 13:10:59.546477 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 88/160] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:10:59 2022] GET /compute/v2.1/servers/6a4a7328-d884-4015-aadc-aa5062a77724 => generated 1319 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:11:00.014320 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-8f29f85c-31e1-4a48-93e7-a88e1b4f7bd2 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Calling method '>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:11:00.014934 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-8f29f85c-31e1-4a48-93e7-a88e1b4f7bd2 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] [instance: 96c829cb-4dde-467c-b50f-b2f666bdab0b] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:11:00.021409 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-8f29f85c-31e1-4a48-93e7-a88e1b4f7bd2 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:11:00.021896 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-8f29f85c-31e1-4a48-93e7-a88e1b4f7bd2 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:11:00.022339 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-8f29f85c-31e1-4a48-93e7-a88e1b4f7bd2 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:11:00.023932 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-8f29f85c-31e1-4a48-93e7-a88e1b4f7bd2 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:11:00.024399 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-8f29f85c-31e1-4a48-93e7-a88e1b4f7bd2 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:11:00.024825 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-8f29f85c-31e1-4a48-93e7-a88e1b4f7bd2 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:11:00.158153 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-8f29f85c-31e1-4a48-93e7-a88e1b4f7bd2 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '454203f47b434cca952a1cef56de559f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7312d0ac9248f2bfbece5611913ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:11:00.166018 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-8f29f85c-31e1-4a48-93e7-a88e1b4f7bd2 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] 10.222.0.23 "GET /compute/v2.1/servers/96c829cb-4dde-467c-b50f-b2f666bdab0b" status: 200 len: 1522 microversion: 2.1 time: 0.158705 Oct 13 13:11:00.166699 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 73/161] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:11:00 2022] GET /compute/v2.1/servers/96c829cb-4dde-467c-b50f-b2f666bdab0b => generated 1522 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 13:11:00.567956 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-1c940937-8cdb-45b9-90b7-940c793a6992 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Calling method '>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:11:00.568657 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-1c940937-8cdb-45b9-90b7-940c793a6992 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] [instance: 6a4a7328-d884-4015-aadc-aa5062a77724] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:11:00.574620 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-1c940937-8cdb-45b9-90b7-940c793a6992 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:11:00.575126 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-1c940937-8cdb-45b9-90b7-940c793a6992 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:11:00.575589 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-1c940937-8cdb-45b9-90b7-940c793a6992 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:11:00.576503 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-1c940937-8cdb-45b9-90b7-940c793a6992 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:11:00.576961 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-1c940937-8cdb-45b9-90b7-940c793a6992 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:11:00.577380 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-1c940937-8cdb-45b9-90b7-940c793a6992 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:11:00.711913 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-1c940937-8cdb-45b9-90b7-940c793a6992 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8569afc405f24a0993a023c818a0c272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f85144e13e254365a86aa785093c8575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:11:00.720976 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-1c940937-8cdb-45b9-90b7-940c793a6992 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] 10.222.0.23 "GET /compute/v2.1/servers/6a4a7328-d884-4015-aadc-aa5062a77724" status: 200 len: 1319 microversion: 2.1 time: 0.156723 Oct 13 13:11:00.721701 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 89/162] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:11:00 2022] GET /compute/v2.1/servers/6a4a7328-d884-4015-aadc-aa5062a77724 => generated 1319 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:11:01.189454 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-67d92cb9-cac6-4d60-aa56-6c1025b6b171 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Calling method '>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:11:01.190807 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-67d92cb9-cac6-4d60-aa56-6c1025b6b171 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] [instance: 96c829cb-4dde-467c-b50f-b2f666bdab0b] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:11:01.197489 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-67d92cb9-cac6-4d60-aa56-6c1025b6b171 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:11:01.198231 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-67d92cb9-cac6-4d60-aa56-6c1025b6b171 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:11:01.199024 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-67d92cb9-cac6-4d60-aa56-6c1025b6b171 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:11:01.200375 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-67d92cb9-cac6-4d60-aa56-6c1025b6b171 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:11:01.200885 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-67d92cb9-cac6-4d60-aa56-6c1025b6b171 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:11:01.201596 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-67d92cb9-cac6-4d60-aa56-6c1025b6b171 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:11:01.202330 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG dbcounter [-] [118815] Writing DB stats nova_cell0:SELECT=2 {{(pid=118815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:11:01.368616 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-67d92cb9-cac6-4d60-aa56-6c1025b6b171 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '454203f47b434cca952a1cef56de559f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7312d0ac9248f2bfbece5611913ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:11:01.376992 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-67d92cb9-cac6-4d60-aa56-6c1025b6b171 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] 10.222.0.23 "GET /compute/v2.1/servers/96c829cb-4dde-467c-b50f-b2f666bdab0b" status: 200 len: 1522 microversion: 2.1 time: 0.191151 Oct 13 13:11:01.377720 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 74/163] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:11:01 2022] GET /compute/v2.1/servers/96c829cb-4dde-467c-b50f-b2f666bdab0b => generated 1522 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:11:01.744347 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-0c94402f-4840-412f-8a78-27259c482f3e tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Calling method '>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:11:01.744958 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-0c94402f-4840-412f-8a78-27259c482f3e tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] [instance: 6a4a7328-d884-4015-aadc-aa5062a77724] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:11:01.748357 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG dbcounter [-] [118814] Writing DB stats nova_cell0:SELECT=2 {{(pid=118814) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:11:01.749070 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG dbcounter [-] [118814] Writing DB stats nova_cell0:SELECT=6 {{(pid=118814) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:11:01.752886 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-0c94402f-4840-412f-8a78-27259c482f3e tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:11:01.753543 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-0c94402f-4840-412f-8a78-27259c482f3e tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:11:01.754188 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-0c94402f-4840-412f-8a78-27259c482f3e tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:11:01.754821 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-0c94402f-4840-412f-8a78-27259c482f3e tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:11:01.755329 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-0c94402f-4840-412f-8a78-27259c482f3e tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:11:01.755757 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-0c94402f-4840-412f-8a78-27259c482f3e tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:11:01.889682 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-0c94402f-4840-412f-8a78-27259c482f3e tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8569afc405f24a0993a023c818a0c272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f85144e13e254365a86aa785093c8575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:11:01.898219 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-0c94402f-4840-412f-8a78-27259c482f3e tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] 10.222.0.23 "GET /compute/v2.1/servers/6a4a7328-d884-4015-aadc-aa5062a77724" status: 200 len: 1319 microversion: 2.1 time: 0.157140 Oct 13 13:11:01.898816 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 90/164] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:11:01 2022] GET /compute/v2.1/servers/6a4a7328-d884-4015-aadc-aa5062a77724 => generated 1319 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:11:02.401249 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-c1441bd4-af17-45e4-9072-cc7ec994ff93 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Calling method '>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:11:02.401895 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-c1441bd4-af17-45e4-9072-cc7ec994ff93 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] [instance: 96c829cb-4dde-467c-b50f-b2f666bdab0b] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:11:02.408424 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-c1441bd4-af17-45e4-9072-cc7ec994ff93 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:11:02.409393 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-c1441bd4-af17-45e4-9072-cc7ec994ff93 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:11:02.409528 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-c1441bd4-af17-45e4-9072-cc7ec994ff93 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:11:02.410297 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-c1441bd4-af17-45e4-9072-cc7ec994ff93 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:11:02.410812 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-c1441bd4-af17-45e4-9072-cc7ec994ff93 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:11:02.411283 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-c1441bd4-af17-45e4-9072-cc7ec994ff93 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:11:02.544713 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-c1441bd4-af17-45e4-9072-cc7ec994ff93 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '454203f47b434cca952a1cef56de559f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7312d0ac9248f2bfbece5611913ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:11:02.552613 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-c1441bd4-af17-45e4-9072-cc7ec994ff93 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] 10.222.0.23 "GET /compute/v2.1/servers/96c829cb-4dde-467c-b50f-b2f666bdab0b" status: 200 len: 1522 microversion: 2.1 time: 0.156703 Oct 13 13:11:02.553175 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 75/165] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:11:02 2022] GET /compute/v2.1/servers/96c829cb-4dde-467c-b50f-b2f666bdab0b => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:11:02.920408 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-9b09237b-1264-4791-8c45-1a74788cbbdf tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Calling method '>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:11:02.921030 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-9b09237b-1264-4791-8c45-1a74788cbbdf tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] [instance: 6a4a7328-d884-4015-aadc-aa5062a77724] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:11:02.927305 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-9b09237b-1264-4791-8c45-1a74788cbbdf tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:11:02.927800 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-9b09237b-1264-4791-8c45-1a74788cbbdf tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:11:02.928241 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-9b09237b-1264-4791-8c45-1a74788cbbdf tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:11:02.928993 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-9b09237b-1264-4791-8c45-1a74788cbbdf tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:11:02.929978 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-9b09237b-1264-4791-8c45-1a74788cbbdf tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:11:02.930409 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-9b09237b-1264-4791-8c45-1a74788cbbdf tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:11:03.063208 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-9b09237b-1264-4791-8c45-1a74788cbbdf tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8569afc405f24a0993a023c818a0c272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f85144e13e254365a86aa785093c8575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:11:03.071001 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-9b09237b-1264-4791-8c45-1a74788cbbdf tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] 10.222.0.23 "GET /compute/v2.1/servers/6a4a7328-d884-4015-aadc-aa5062a77724" status: 200 len: 1319 microversion: 2.1 time: 0.154325 Oct 13 13:11:03.072019 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 91/166] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:11:02 2022] GET /compute/v2.1/servers/6a4a7328-d884-4015-aadc-aa5062a77724 => generated 1319 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:11:03.575774 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-292c8ca2-8cd0-429f-b083-c97d3d1cb0cc tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Calling method '>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:11:03.576376 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-292c8ca2-8cd0-429f-b083-c97d3d1cb0cc tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] [instance: 96c829cb-4dde-467c-b50f-b2f666bdab0b] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:11:03.582605 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-292c8ca2-8cd0-429f-b083-c97d3d1cb0cc tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:11:03.583095 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-292c8ca2-8cd0-429f-b083-c97d3d1cb0cc tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:11:03.583534 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-292c8ca2-8cd0-429f-b083-c97d3d1cb0cc tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:11:03.584211 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-292c8ca2-8cd0-429f-b083-c97d3d1cb0cc tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:11:03.584663 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-292c8ca2-8cd0-429f-b083-c97d3d1cb0cc tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:11:03.585079 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-292c8ca2-8cd0-429f-b083-c97d3d1cb0cc tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:11:03.727260 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-292c8ca2-8cd0-429f-b083-c97d3d1cb0cc tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '454203f47b434cca952a1cef56de559f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7312d0ac9248f2bfbece5611913ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:11:03.749913 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-292c8ca2-8cd0-429f-b083-c97d3d1cb0cc tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] 10.222.0.23 "GET /compute/v2.1/servers/96c829cb-4dde-467c-b50f-b2f666bdab0b" status: 200 len: 1522 microversion: 2.1 time: 0.176160 Oct 13 13:11:03.752072 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 76/167] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:11:03 2022] GET /compute/v2.1/servers/96c829cb-4dde-467c-b50f-b2f666bdab0b => generated 1522 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:11:04.094026 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-5c8e7417-8156-4c16-92e4-cd529fd73e96 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Calling method '>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:11:04.094677 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-5c8e7417-8156-4c16-92e4-cd529fd73e96 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] [instance: 6a4a7328-d884-4015-aadc-aa5062a77724] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:11:04.101011 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-5c8e7417-8156-4c16-92e4-cd529fd73e96 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:11:04.101500 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-5c8e7417-8156-4c16-92e4-cd529fd73e96 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:11:04.101943 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-5c8e7417-8156-4c16-92e4-cd529fd73e96 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:11:04.102718 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-5c8e7417-8156-4c16-92e4-cd529fd73e96 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:11:04.103286 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-5c8e7417-8156-4c16-92e4-cd529fd73e96 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:11:04.103748 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-5c8e7417-8156-4c16-92e4-cd529fd73e96 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:11:04.123862 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG dbcounter [-] [118814] Writing DB stats nova_cell1:SELECT=100 {{(pid=118814) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:11:04.247738 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-5c8e7417-8156-4c16-92e4-cd529fd73e96 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8569afc405f24a0993a023c818a0c272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f85144e13e254365a86aa785093c8575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:11:04.257809 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-5c8e7417-8156-4c16-92e4-cd529fd73e96 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] 10.222.0.23 "GET /compute/v2.1/servers/6a4a7328-d884-4015-aadc-aa5062a77724" status: 200 len: 1319 microversion: 2.1 time: 0.167112 Oct 13 13:11:04.258530 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 92/168] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:11:04 2022] GET /compute/v2.1/servers/6a4a7328-d884-4015-aadc-aa5062a77724 => generated 1319 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:11:04.266654 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-db9d1e23-37b7-468b-9c19-b7ab9e43e255 tempest-DeleteServersTestJSON-1957240839 tempest-DeleteServersTestJSON-1957240839-project] Calling method '>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:11:04.267522 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-db9d1e23-37b7-468b-9c19-b7ab9e43e255 tempest-DeleteServersTestJSON-1957240839 tempest-DeleteServersTestJSON-1957240839-project] [instance: dcd9bb33-bad5-4d93-ba0f-558c63746e29] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:11:04.273483 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-db9d1e23-37b7-468b-9c19-b7ab9e43e255 tempest-DeleteServersTestJSON-1957240839 tempest-DeleteServersTestJSON-1957240839-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:11:04.274144 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-db9d1e23-37b7-468b-9c19-b7ab9e43e255 tempest-DeleteServersTestJSON-1957240839 tempest-DeleteServersTestJSON-1957240839-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:11:04.274577 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-db9d1e23-37b7-468b-9c19-b7ab9e43e255 tempest-DeleteServersTestJSON-1957240839 tempest-DeleteServersTestJSON-1957240839-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:11:04.275294 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-db9d1e23-37b7-468b-9c19-b7ab9e43e255 tempest-DeleteServersTestJSON-1957240839 tempest-DeleteServersTestJSON-1957240839-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:11:04.275744 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-db9d1e23-37b7-468b-9c19-b7ab9e43e255 tempest-DeleteServersTestJSON-1957240839 tempest-DeleteServersTestJSON-1957240839-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:11:04.276165 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-db9d1e23-37b7-468b-9c19-b7ab9e43e255 tempest-DeleteServersTestJSON-1957240839 tempest-DeleteServersTestJSON-1957240839-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:11:04.301097 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-db9d1e23-37b7-468b-9c19-b7ab9e43e255 tempest-DeleteServersTestJSON-1957240839 tempest-DeleteServersTestJSON-1957240839-project] [instance: dcd9bb33-bad5-4d93-ba0f-558c63746e29] Going to try to terminate instance {{(pid=118815) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 13 13:11:04.397114 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-db9d1e23-37b7-468b-9c19-b7ab9e43e255 tempest-DeleteServersTestJSON-1957240839 tempest-DeleteServersTestJSON-1957240839-project] 10.222.0.23 "DELETE /compute/v2.1/servers/dcd9bb33-bad5-4d93-ba0f-558c63746e29" status: 204 len: 0 microversion: 2.1 time: 0.136526 Oct 13 13:11:04.397744 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 77/169] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Oct 13 13:11:04 2022] DELETE /compute/v2.1/servers/dcd9bb33-bad5-4d93-ba0f-558c63746e29 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 13 13:11:04.406046 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-2f402131-ca47-4f68-b7ea-d7d5fa5ff648 tempest-DeleteServersTestJSON-1957240839 tempest-DeleteServersTestJSON-1957240839-project] Calling method '>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:11:04.406664 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-2f402131-ca47-4f68-b7ea-d7d5fa5ff648 tempest-DeleteServersTestJSON-1957240839 tempest-DeleteServersTestJSON-1957240839-project] [instance: dcd9bb33-bad5-4d93-ba0f-558c63746e29] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:11:04.412765 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-2f402131-ca47-4f68-b7ea-d7d5fa5ff648 tempest-DeleteServersTestJSON-1957240839 tempest-DeleteServersTestJSON-1957240839-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:11:04.413803 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-2f402131-ca47-4f68-b7ea-d7d5fa5ff648 tempest-DeleteServersTestJSON-1957240839 tempest-DeleteServersTestJSON-1957240839-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:11:04.414249 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-2f402131-ca47-4f68-b7ea-d7d5fa5ff648 tempest-DeleteServersTestJSON-1957240839 tempest-DeleteServersTestJSON-1957240839-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:11:04.414966 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-2f402131-ca47-4f68-b7ea-d7d5fa5ff648 tempest-DeleteServersTestJSON-1957240839 tempest-DeleteServersTestJSON-1957240839-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:11:04.415453 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-2f402131-ca47-4f68-b7ea-d7d5fa5ff648 tempest-DeleteServersTestJSON-1957240839 tempest-DeleteServersTestJSON-1957240839-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:11:04.415877 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-2f402131-ca47-4f68-b7ea-d7d5fa5ff648 tempest-DeleteServersTestJSON-1957240839 tempest-DeleteServersTestJSON-1957240839-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:11:04.550012 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-2f402131-ca47-4f68-b7ea-d7d5fa5ff648 tempest-DeleteServersTestJSON-1957240839 tempest-DeleteServersTestJSON-1957240839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3a049e77aba470db21e26d1bc8caa80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6027a602300d4d2bbf33ac329b2960f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:11:04.559914 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-2f402131-ca47-4f68-b7ea-d7d5fa5ff648 tempest-DeleteServersTestJSON-1957240839 tempest-DeleteServersTestJSON-1957240839-project] 10.222.0.23 "GET /compute/v2.1/servers/dcd9bb33-bad5-4d93-ba0f-558c63746e29" status: 200 len: 1555 microversion: 2.1 time: 0.157988 Oct 13 13:11:04.563177 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 93/170] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:11:04 2022] GET /compute/v2.1/servers/dcd9bb33-bad5-4d93-ba0f-558c63746e29 => generated 1555 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:11:04.776913 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-790d7726-9cdb-4a35-ac2c-1ee866ebaa95 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Calling method '>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:11:04.776913 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-790d7726-9cdb-4a35-ac2c-1ee866ebaa95 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] [instance: 96c829cb-4dde-467c-b50f-b2f666bdab0b] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:11:04.786720 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-790d7726-9cdb-4a35-ac2c-1ee866ebaa95 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:11:04.787500 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-790d7726-9cdb-4a35-ac2c-1ee866ebaa95 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:11:04.787942 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-790d7726-9cdb-4a35-ac2c-1ee866ebaa95 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:11:04.789475 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-790d7726-9cdb-4a35-ac2c-1ee866ebaa95 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:11:04.790215 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-790d7726-9cdb-4a35-ac2c-1ee866ebaa95 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:11:04.790685 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-790d7726-9cdb-4a35-ac2c-1ee866ebaa95 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:11:04.955000 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-790d7726-9cdb-4a35-ac2c-1ee866ebaa95 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '454203f47b434cca952a1cef56de559f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7312d0ac9248f2bfbece5611913ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:11:04.962883 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-790d7726-9cdb-4a35-ac2c-1ee866ebaa95 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] 10.222.0.23 "GET /compute/v2.1/servers/96c829cb-4dde-467c-b50f-b2f666bdab0b" status: 200 len: 1522 microversion: 2.1 time: 0.191658 Oct 13 13:11:04.964041 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 78/171] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:11:04 2022] GET /compute/v2.1/servers/96c829cb-4dde-467c-b50f-b2f666bdab0b => generated 1522 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:11:05.282329 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-6d9f0746-72ec-4f14-97da-bf257416c635 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Calling method '>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:11:05.283014 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-6d9f0746-72ec-4f14-97da-bf257416c635 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] [instance: 6a4a7328-d884-4015-aadc-aa5062a77724] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:11:05.291149 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-6d9f0746-72ec-4f14-97da-bf257416c635 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:11:05.291655 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-6d9f0746-72ec-4f14-97da-bf257416c635 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:11:05.292157 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-6d9f0746-72ec-4f14-97da-bf257416c635 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:11:05.293170 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-6d9f0746-72ec-4f14-97da-bf257416c635 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:11:05.293699 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-6d9f0746-72ec-4f14-97da-bf257416c635 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:11:05.294174 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-6d9f0746-72ec-4f14-97da-bf257416c635 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:11:05.420525 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [req-a0b47067-4872-4676-bffb-d62018890a74 req-a8a0b066-456f-42ac-bd5e-7339e7d0e41a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6a4a7328-d884-4015-aadc-aa5062a77724", "name": "network-vif-plugged", "status": "completed", "tag": "879af4f7-b860-4ff7-afae-5448deb00962"}]} {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 13:11:05.428547 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-6d9f0746-72ec-4f14-97da-bf257416c635 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8569afc405f24a0993a023c818a0c272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f85144e13e254365a86aa785093c8575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:11:05.432248 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [req-a0b47067-4872-4676-bffb-d62018890a74 req-a8a0b066-456f-42ac-bd5e-7339e7d0e41a service nova] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:11:05.432996 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [req-a0b47067-4872-4676-bffb-d62018890a74 req-a8a0b066-456f-42ac-bd5e-7339e7d0e41a service nova] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:11:05.433411 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [req-a0b47067-4872-4676-bffb-d62018890a74 req-a8a0b066-456f-42ac-bd5e-7339e7d0e41a service nova] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:11:05.437069 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-6d9f0746-72ec-4f14-97da-bf257416c635 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] 10.222.0.23 "GET /compute/v2.1/servers/6a4a7328-d884-4015-aadc-aa5062a77724" status: 200 len: 1319 microversion: 2.1 time: 0.158846 Oct 13 13:11:05.446069 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.compute.server_external_events [req-a0b47067-4872-4676-bffb-d62018890a74 req-a8a0b066-456f-42ac-bd5e-7339e7d0e41a service nova] Creating event network-vif-plugged:879af4f7-b860-4ff7-afae-5448deb00962 for instance 6a4a7328-d884-4015-aadc-aa5062a77724 on hv-cinder-82660 Oct 13 13:11:05.450949 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [req-a0b47067-4872-4676-bffb-d62018890a74 req-a8a0b066-456f-42ac-bd5e-7339e7d0e41a service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034105 Oct 13 13:11:05.451411 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 94/172] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:11:05 2022] GET /compute/v2.1/servers/6a4a7328-d884-4015-aadc-aa5062a77724 => generated 1319 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:11:05.451712 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 79/173] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 13:11:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 13 13:11:05.589347 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-7d10516d-ba9e-4aef-b113-0b2fd832ae80 tempest-DeleteServersTestJSON-1957240839 tempest-DeleteServersTestJSON-1957240839-project] Calling method '>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:11:05.589959 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-7d10516d-ba9e-4aef-b113-0b2fd832ae80 tempest-DeleteServersTestJSON-1957240839 tempest-DeleteServersTestJSON-1957240839-project] [instance: dcd9bb33-bad5-4d93-ba0f-558c63746e29] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:11:05.595780 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-7d10516d-ba9e-4aef-b113-0b2fd832ae80 tempest-DeleteServersTestJSON-1957240839 tempest-DeleteServersTestJSON-1957240839-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:11:05.596262 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-7d10516d-ba9e-4aef-b113-0b2fd832ae80 tempest-DeleteServersTestJSON-1957240839 tempest-DeleteServersTestJSON-1957240839-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:11:05.596693 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-7d10516d-ba9e-4aef-b113-0b2fd832ae80 tempest-DeleteServersTestJSON-1957240839 tempest-DeleteServersTestJSON-1957240839-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:11:05.597372 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-7d10516d-ba9e-4aef-b113-0b2fd832ae80 tempest-DeleteServersTestJSON-1957240839 tempest-DeleteServersTestJSON-1957240839-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:11:05.597824 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-7d10516d-ba9e-4aef-b113-0b2fd832ae80 tempest-DeleteServersTestJSON-1957240839 tempest-DeleteServersTestJSON-1957240839-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:11:05.598247 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-7d10516d-ba9e-4aef-b113-0b2fd832ae80 tempest-DeleteServersTestJSON-1957240839 tempest-DeleteServersTestJSON-1957240839-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:11:05.730055 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-7d10516d-ba9e-4aef-b113-0b2fd832ae80 tempest-DeleteServersTestJSON-1957240839 tempest-DeleteServersTestJSON-1957240839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3a049e77aba470db21e26d1bc8caa80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6027a602300d4d2bbf33ac329b2960f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:11:05.738391 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-7d10516d-ba9e-4aef-b113-0b2fd832ae80 tempest-DeleteServersTestJSON-1957240839 tempest-DeleteServersTestJSON-1957240839-project] 10.222.0.23 "GET /compute/v2.1/servers/dcd9bb33-bad5-4d93-ba0f-558c63746e29" status: 200 len: 1555 microversion: 2.1 time: 0.153691 Oct 13 13:11:05.738955 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 95/174] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:11:05 2022] GET /compute/v2.1/servers/dcd9bb33-bad5-4d93-ba0f-558c63746e29 => generated 1555 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:11:05.987240 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-3c3b4897-8ff8-4215-9723-1ea65c002ed8 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Calling method '>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:11:05.988081 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-3c3b4897-8ff8-4215-9723-1ea65c002ed8 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] [instance: 96c829cb-4dde-467c-b50f-b2f666bdab0b] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:11:05.994702 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-3c3b4897-8ff8-4215-9723-1ea65c002ed8 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:11:05.995296 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-3c3b4897-8ff8-4215-9723-1ea65c002ed8 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:11:05.995817 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-3c3b4897-8ff8-4215-9723-1ea65c002ed8 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:11:05.996581 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-3c3b4897-8ff8-4215-9723-1ea65c002ed8 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:11:05.997108 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-3c3b4897-8ff8-4215-9723-1ea65c002ed8 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:11:05.997541 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-3c3b4897-8ff8-4215-9723-1ea65c002ed8 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:11:06.131587 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-3c3b4897-8ff8-4215-9723-1ea65c002ed8 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '454203f47b434cca952a1cef56de559f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7312d0ac9248f2bfbece5611913ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:11:06.139789 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-3c3b4897-8ff8-4215-9723-1ea65c002ed8 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] 10.222.0.23 "GET /compute/v2.1/servers/96c829cb-4dde-467c-b50f-b2f666bdab0b" status: 200 len: 1522 microversion: 2.1 time: 0.157706 Oct 13 13:11:06.140359 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 80/175] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:11:05 2022] GET /compute/v2.1/servers/96c829cb-4dde-467c-b50f-b2f666bdab0b => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:11:06.461582 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-d0aed694-c142-42cb-aa40-41e8c55fc988 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Calling method '>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:11:06.462237 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-d0aed694-c142-42cb-aa40-41e8c55fc988 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] [instance: 6a4a7328-d884-4015-aadc-aa5062a77724] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:11:06.469356 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-d0aed694-c142-42cb-aa40-41e8c55fc988 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:11:06.470275 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-d0aed694-c142-42cb-aa40-41e8c55fc988 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:11:06.470795 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-d0aed694-c142-42cb-aa40-41e8c55fc988 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:11:06.472157 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-d0aed694-c142-42cb-aa40-41e8c55fc988 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:11:06.472864 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-d0aed694-c142-42cb-aa40-41e8c55fc988 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:11:06.473462 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-d0aed694-c142-42cb-aa40-41e8c55fc988 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:11:06.649886 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-d0aed694-c142-42cb-aa40-41e8c55fc988 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8569afc405f24a0993a023c818a0c272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f85144e13e254365a86aa785093c8575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:11:06.660145 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-d0aed694-c142-42cb-aa40-41e8c55fc988 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] 10.222.0.23 "GET /compute/v2.1/servers/6a4a7328-d884-4015-aadc-aa5062a77724" status: 200 len: 1319 microversion: 2.1 time: 0.202178 Oct 13 13:11:06.678484 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 96/176] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:11:06 2022] GET /compute/v2.1/servers/6a4a7328-d884-4015-aadc-aa5062a77724 => generated 1319 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:11:06.765209 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-197cf673-4c6c-4467-bee0-4ea3b22d07a0 tempest-DeleteServersTestJSON-1957240839 tempest-DeleteServersTestJSON-1957240839-project] Calling method '>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:11:06.765995 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-197cf673-4c6c-4467-bee0-4ea3b22d07a0 tempest-DeleteServersTestJSON-1957240839 tempest-DeleteServersTestJSON-1957240839-project] [instance: dcd9bb33-bad5-4d93-ba0f-558c63746e29] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:11:06.772529 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-197cf673-4c6c-4467-bee0-4ea3b22d07a0 tempest-DeleteServersTestJSON-1957240839 tempest-DeleteServersTestJSON-1957240839-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:11:06.773639 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-197cf673-4c6c-4467-bee0-4ea3b22d07a0 tempest-DeleteServersTestJSON-1957240839 tempest-DeleteServersTestJSON-1957240839-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:11:06.774302 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-197cf673-4c6c-4467-bee0-4ea3b22d07a0 tempest-DeleteServersTestJSON-1957240839 tempest-DeleteServersTestJSON-1957240839-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:11:06.775214 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-197cf673-4c6c-4467-bee0-4ea3b22d07a0 tempest-DeleteServersTestJSON-1957240839 tempest-DeleteServersTestJSON-1957240839-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:11:06.775871 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-197cf673-4c6c-4467-bee0-4ea3b22d07a0 tempest-DeleteServersTestJSON-1957240839 tempest-DeleteServersTestJSON-1957240839-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:11:06.776386 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-197cf673-4c6c-4467-bee0-4ea3b22d07a0 tempest-DeleteServersTestJSON-1957240839 tempest-DeleteServersTestJSON-1957240839-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:11:06.920689 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-197cf673-4c6c-4467-bee0-4ea3b22d07a0 tempest-DeleteServersTestJSON-1957240839 tempest-DeleteServersTestJSON-1957240839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3a049e77aba470db21e26d1bc8caa80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6027a602300d4d2bbf33ac329b2960f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:11:06.930035 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-197cf673-4c6c-4467-bee0-4ea3b22d07a0 tempest-DeleteServersTestJSON-1957240839 tempest-DeleteServersTestJSON-1957240839-project] 10.222.0.23 "GET /compute/v2.1/servers/dcd9bb33-bad5-4d93-ba0f-558c63746e29" status: 200 len: 1555 microversion: 2.1 time: 0.169072 Oct 13 13:11:06.930752 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 81/177] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:11:06 2022] GET /compute/v2.1/servers/dcd9bb33-bad5-4d93-ba0f-558c63746e29 => generated 1555 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:11:07.162580 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-9b39f5b6-098e-4112-a5fe-9591d46c6ec1 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Calling method '>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:11:07.163355 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-9b39f5b6-098e-4112-a5fe-9591d46c6ec1 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] [instance: 96c829cb-4dde-467c-b50f-b2f666bdab0b] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:11:07.169642 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-9b39f5b6-098e-4112-a5fe-9591d46c6ec1 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:11:07.170343 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-9b39f5b6-098e-4112-a5fe-9591d46c6ec1 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:11:07.170968 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-9b39f5b6-098e-4112-a5fe-9591d46c6ec1 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:11:07.171871 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-9b39f5b6-098e-4112-a5fe-9591d46c6ec1 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:11:07.172733 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-9b39f5b6-098e-4112-a5fe-9591d46c6ec1 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:11:07.173294 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-9b39f5b6-098e-4112-a5fe-9591d46c6ec1 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:11:07.325315 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-9b39f5b6-098e-4112-a5fe-9591d46c6ec1 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '454203f47b434cca952a1cef56de559f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7312d0ac9248f2bfbece5611913ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:11:07.335084 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-9b39f5b6-098e-4112-a5fe-9591d46c6ec1 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] 10.222.0.23 "GET /compute/v2.1/servers/96c829cb-4dde-467c-b50f-b2f666bdab0b" status: 200 len: 1522 microversion: 2.1 time: 0.176491 Oct 13 13:11:07.346905 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 97/178] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:11:07 2022] GET /compute/v2.1/servers/96c829cb-4dde-467c-b50f-b2f666bdab0b => generated 1522 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:11:07.692855 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-e2201bd1-7a0d-43df-9192-1a78160530a5 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Calling method '>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:11:07.693522 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-e2201bd1-7a0d-43df-9192-1a78160530a5 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] [instance: 6a4a7328-d884-4015-aadc-aa5062a77724] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:11:07.701976 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-e2201bd1-7a0d-43df-9192-1a78160530a5 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:11:07.702465 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-e2201bd1-7a0d-43df-9192-1a78160530a5 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:11:07.703172 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-e2201bd1-7a0d-43df-9192-1a78160530a5 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:11:07.703759 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-e2201bd1-7a0d-43df-9192-1a78160530a5 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:11:07.704222 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-e2201bd1-7a0d-43df-9192-1a78160530a5 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:11:07.704645 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-e2201bd1-7a0d-43df-9192-1a78160530a5 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:11:07.865351 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-e2201bd1-7a0d-43df-9192-1a78160530a5 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8569afc405f24a0993a023c818a0c272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f85144e13e254365a86aa785093c8575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:11:07.876186 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-e2201bd1-7a0d-43df-9192-1a78160530a5 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] 10.222.0.23 "GET /compute/v2.1/servers/6a4a7328-d884-4015-aadc-aa5062a77724" status: 200 len: 1319 microversion: 2.1 time: 0.191322 Oct 13 13:11:07.884271 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 82/179] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:11:07 2022] GET /compute/v2.1/servers/6a4a7328-d884-4015-aadc-aa5062a77724 => generated 1319 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:11:07.953821 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-4664f3ed-075d-498f-8e9e-a61d7526fc68 tempest-DeleteServersTestJSON-1957240839 tempest-DeleteServersTestJSON-1957240839-project] Calling method '>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:11:07.954985 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-4664f3ed-075d-498f-8e9e-a61d7526fc68 tempest-DeleteServersTestJSON-1957240839 tempest-DeleteServersTestJSON-1957240839-project] [instance: dcd9bb33-bad5-4d93-ba0f-558c63746e29] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:11:07.962281 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-4664f3ed-075d-498f-8e9e-a61d7526fc68 tempest-DeleteServersTestJSON-1957240839 tempest-DeleteServersTestJSON-1957240839-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:11:07.962770 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-4664f3ed-075d-498f-8e9e-a61d7526fc68 tempest-DeleteServersTestJSON-1957240839 tempest-DeleteServersTestJSON-1957240839-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:11:07.963247 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-4664f3ed-075d-498f-8e9e-a61d7526fc68 tempest-DeleteServersTestJSON-1957240839 tempest-DeleteServersTestJSON-1957240839-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:11:07.963952 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-4664f3ed-075d-498f-8e9e-a61d7526fc68 tempest-DeleteServersTestJSON-1957240839 tempest-DeleteServersTestJSON-1957240839-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:11:07.964417 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-4664f3ed-075d-498f-8e9e-a61d7526fc68 tempest-DeleteServersTestJSON-1957240839 tempest-DeleteServersTestJSON-1957240839-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:11:07.965311 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-4664f3ed-075d-498f-8e9e-a61d7526fc68 tempest-DeleteServersTestJSON-1957240839 tempest-DeleteServersTestJSON-1957240839-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:11:08.110913 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-4664f3ed-075d-498f-8e9e-a61d7526fc68 tempest-DeleteServersTestJSON-1957240839 tempest-DeleteServersTestJSON-1957240839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3a049e77aba470db21e26d1bc8caa80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6027a602300d4d2bbf33ac329b2960f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:11:08.120625 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-4664f3ed-075d-498f-8e9e-a61d7526fc68 tempest-DeleteServersTestJSON-1957240839 tempest-DeleteServersTestJSON-1957240839-project] 10.222.0.23 "GET /compute/v2.1/servers/dcd9bb33-bad5-4d93-ba0f-558c63746e29" status: 200 len: 1555 microversion: 2.1 time: 0.171309 Oct 13 13:11:08.136074 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 98/180] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:11:07 2022] GET /compute/v2.1/servers/dcd9bb33-bad5-4d93-ba0f-558c63746e29 => generated 1555 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:11:08.357636 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-f3c56ca7-f62b-41e1-8db2-8a42131c3e68 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Calling method '>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:11:08.359166 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-f3c56ca7-f62b-41e1-8db2-8a42131c3e68 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] [instance: 96c829cb-4dde-467c-b50f-b2f666bdab0b] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:11:08.365531 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-f3c56ca7-f62b-41e1-8db2-8a42131c3e68 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:11:08.366996 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-f3c56ca7-f62b-41e1-8db2-8a42131c3e68 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:11:08.367530 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-f3c56ca7-f62b-41e1-8db2-8a42131c3e68 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:11:08.368463 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-f3c56ca7-f62b-41e1-8db2-8a42131c3e68 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:11:08.369114 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-f3c56ca7-f62b-41e1-8db2-8a42131c3e68 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:11:08.369728 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-f3c56ca7-f62b-41e1-8db2-8a42131c3e68 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:11:08.564188 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [req-20f40964-9f70-40cb-9949-32bc5a3670f5 req-d509804b-4d79-4562-8c76-21cc548562df service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dcd9bb33-bad5-4d93-ba0f-558c63746e29", "name": "network-vif-deleted", "tag": "56f9f92a-e0d4-4a2d-b2f3-734fabaf36a0"}]} {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 13:11:08.572900 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-f3c56ca7-f62b-41e1-8db2-8a42131c3e68 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '454203f47b434cca952a1cef56de559f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7312d0ac9248f2bfbece5611913ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:11:08.580147 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [req-20f40964-9f70-40cb-9949-32bc5a3670f5 req-d509804b-4d79-4562-8c76-21cc548562df service nova] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:11:08.580823 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [req-20f40964-9f70-40cb-9949-32bc5a3670f5 req-d509804b-4d79-4562-8c76-21cc548562df service nova] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:11:08.581691 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [req-20f40964-9f70-40cb-9949-32bc5a3670f5 req-d509804b-4d79-4562-8c76-21cc548562df service nova] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:11:08.586010 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-f3c56ca7-f62b-41e1-8db2-8a42131c3e68 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] 10.222.0.23 "GET /compute/v2.1/servers/96c829cb-4dde-467c-b50f-b2f666bdab0b" status: 200 len: 1522 microversion: 2.1 time: 0.230773 Oct 13 13:11:08.599084 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 83/181] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:11:08 2022] GET /compute/v2.1/servers/96c829cb-4dde-467c-b50f-b2f666bdab0b => generated 1522 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:11:08.610933 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.compute.server_external_events [req-20f40964-9f70-40cb-9949-32bc5a3670f5 req-d509804b-4d79-4562-8c76-21cc548562df service nova] Creating event network-vif-deleted:56f9f92a-e0d4-4a2d-b2f3-734fabaf36a0 for instance dcd9bb33-bad5-4d93-ba0f-558c63746e29 on hv-cinder-82660 Oct 13 13:11:08.629974 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [req-20f40964-9f70-40cb-9949-32bc5a3670f5 req-d509804b-4d79-4562-8c76-21cc548562df service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069501 Oct 13 13:11:08.639597 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 99/182] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 13:11:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 13 13:11:08.901481 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-8b411312-2330-4ed5-a1a5-0a1b3990bf1c tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Calling method '>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:11:08.902086 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-8b411312-2330-4ed5-a1a5-0a1b3990bf1c tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] [instance: 6a4a7328-d884-4015-aadc-aa5062a77724] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:11:08.909144 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-8b411312-2330-4ed5-a1a5-0a1b3990bf1c tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:11:08.909639 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-8b411312-2330-4ed5-a1a5-0a1b3990bf1c tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:11:08.910333 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-8b411312-2330-4ed5-a1a5-0a1b3990bf1c tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:11:08.910938 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-8b411312-2330-4ed5-a1a5-0a1b3990bf1c tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:11:08.911414 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-8b411312-2330-4ed5-a1a5-0a1b3990bf1c tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:11:08.912094 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-8b411312-2330-4ed5-a1a5-0a1b3990bf1c tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:11:09.059398 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-8b411312-2330-4ed5-a1a5-0a1b3990bf1c tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8569afc405f24a0993a023c818a0c272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f85144e13e254365a86aa785093c8575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:11:09.063387 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG dbcounter [-] [118815] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:11:09.068845 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-8b411312-2330-4ed5-a1a5-0a1b3990bf1c tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] 10.222.0.23 "GET /compute/v2.1/servers/6a4a7328-d884-4015-aadc-aa5062a77724" status: 200 len: 1507 microversion: 2.1 time: 0.172388 Oct 13 13:11:09.073146 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 84/183] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:11:08 2022] GET /compute/v2.1/servers/6a4a7328-d884-4015-aadc-aa5062a77724 => generated 1507 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:11:09.151297 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-9cc23d63-464a-45a8-84b0-bdc2f3a51a44 tempest-DeleteServersTestJSON-1957240839 tempest-DeleteServersTestJSON-1957240839-project] Calling method '>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:11:09.152981 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-9cc23d63-464a-45a8-84b0-bdc2f3a51a44 tempest-DeleteServersTestJSON-1957240839 tempest-DeleteServersTestJSON-1957240839-project] [instance: dcd9bb33-bad5-4d93-ba0f-558c63746e29] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:11:09.201205 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-9cc23d63-464a-45a8-84b0-bdc2f3a51a44 tempest-DeleteServersTestJSON-1957240839 tempest-DeleteServersTestJSON-1957240839-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:11:09.201836 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-9cc23d63-464a-45a8-84b0-bdc2f3a51a44 tempest-DeleteServersTestJSON-1957240839 tempest-DeleteServersTestJSON-1957240839-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:11:09.202358 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-9cc23d63-464a-45a8-84b0-bdc2f3a51a44 tempest-DeleteServersTestJSON-1957240839 tempest-DeleteServersTestJSON-1957240839-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:11:09.205143 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-9cc23d63-464a-45a8-84b0-bdc2f3a51a44 tempest-DeleteServersTestJSON-1957240839 tempest-DeleteServersTestJSON-1957240839-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:11:09.205748 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-9cc23d63-464a-45a8-84b0-bdc2f3a51a44 tempest-DeleteServersTestJSON-1957240839 tempest-DeleteServersTestJSON-1957240839-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:11:09.206204 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-9cc23d63-464a-45a8-84b0-bdc2f3a51a44 tempest-DeleteServersTestJSON-1957240839 tempest-DeleteServersTestJSON-1957240839-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:11:09.247874 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-9cc23d63-464a-45a8-84b0-bdc2f3a51a44 tempest-DeleteServersTestJSON-1957240839 tempest-DeleteServersTestJSON-1957240839-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:11:09.248445 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-9cc23d63-464a-45a8-84b0-bdc2f3a51a44 tempest-DeleteServersTestJSON-1957240839 tempest-DeleteServersTestJSON-1957240839-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:11:09.249108 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-9cc23d63-464a-45a8-84b0-bdc2f3a51a44 tempest-DeleteServersTestJSON-1957240839 tempest-DeleteServersTestJSON-1957240839-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:11:09.249718 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.objects.instance [None req-9cc23d63-464a-45a8-84b0-bdc2f3a51a44 tempest-DeleteServersTestJSON-1957240839 tempest-DeleteServersTestJSON-1957240839-project] Lazy-loading 'fault' on Instance uuid dcd9bb33-bad5-4d93-ba0f-558c63746e29 {{(pid=118814) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 13 13:11:09.300436 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-9cc23d63-464a-45a8-84b0-bdc2f3a51a44 tempest-DeleteServersTestJSON-1957240839 tempest-DeleteServersTestJSON-1957240839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3a049e77aba470db21e26d1bc8caa80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6027a602300d4d2bbf33ac329b2960f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:11:09.313863 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-9cc23d63-464a-45a8-84b0-bdc2f3a51a44 tempest-DeleteServersTestJSON-1957240839 tempest-DeleteServersTestJSON-1957240839-project] 10.222.0.23 "GET /compute/v2.1/servers/dcd9bb33-bad5-4d93-ba0f-558c63746e29" status: 200 len: 1351 microversion: 2.1 time: 0.171159 Oct 13 13:11:09.314876 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 100/184] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:11:09 2022] GET /compute/v2.1/servers/dcd9bb33-bad5-4d93-ba0f-558c63746e29 => generated 1351 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:11:09.617196 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-771eb2b6-bbe0-4d9d-be30-cbb057a87c5c tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Calling method '>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:11:09.617804 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-771eb2b6-bbe0-4d9d-be30-cbb057a87c5c tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] [instance: 96c829cb-4dde-467c-b50f-b2f666bdab0b] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:11:09.625546 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-771eb2b6-bbe0-4d9d-be30-cbb057a87c5c tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:11:09.626037 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-771eb2b6-bbe0-4d9d-be30-cbb057a87c5c tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:11:09.626482 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-771eb2b6-bbe0-4d9d-be30-cbb057a87c5c tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:11:09.627353 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-771eb2b6-bbe0-4d9d-be30-cbb057a87c5c tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:11:09.627873 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-771eb2b6-bbe0-4d9d-be30-cbb057a87c5c tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:11:09.628243 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-771eb2b6-bbe0-4d9d-be30-cbb057a87c5c tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:11:09.798216 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-771eb2b6-bbe0-4d9d-be30-cbb057a87c5c tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '454203f47b434cca952a1cef56de559f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7312d0ac9248f2bfbece5611913ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:11:09.809963 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-771eb2b6-bbe0-4d9d-be30-cbb057a87c5c tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] 10.222.0.23 "GET /compute/v2.1/servers/96c829cb-4dde-467c-b50f-b2f666bdab0b" status: 200 len: 1522 microversion: 2.1 time: 0.197884 Oct 13 13:11:09.810876 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 85/185] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:11:09 2022] GET /compute/v2.1/servers/96c829cb-4dde-467c-b50f-b2f666bdab0b => generated 1522 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:11:10.343224 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-de143908-2518-45b2-9f3c-4d6049a45065 tempest-DeleteServersTestJSON-1957240839 tempest-DeleteServersTestJSON-1957240839-project] Calling method '>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:11:10.343880 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-de143908-2518-45b2-9f3c-4d6049a45065 tempest-DeleteServersTestJSON-1957240839 tempest-DeleteServersTestJSON-1957240839-project] [instance: dcd9bb33-bad5-4d93-ba0f-558c63746e29] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:11:10.349694 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-de143908-2518-45b2-9f3c-4d6049a45065 tempest-DeleteServersTestJSON-1957240839 tempest-DeleteServersTestJSON-1957240839-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:11:10.350178 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-de143908-2518-45b2-9f3c-4d6049a45065 tempest-DeleteServersTestJSON-1957240839 tempest-DeleteServersTestJSON-1957240839-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:11:10.351183 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-de143908-2518-45b2-9f3c-4d6049a45065 tempest-DeleteServersTestJSON-1957240839 tempest-DeleteServersTestJSON-1957240839-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:11:10.351876 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-de143908-2518-45b2-9f3c-4d6049a45065 tempest-DeleteServersTestJSON-1957240839 tempest-DeleteServersTestJSON-1957240839-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:11:10.352326 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-de143908-2518-45b2-9f3c-4d6049a45065 tempest-DeleteServersTestJSON-1957240839 tempest-DeleteServersTestJSON-1957240839-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:11:10.352763 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-de143908-2518-45b2-9f3c-4d6049a45065 tempest-DeleteServersTestJSON-1957240839 tempest-DeleteServersTestJSON-1957240839-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:11:10.368962 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.wsgi [None req-de143908-2518-45b2-9f3c-4d6049a45065 tempest-DeleteServersTestJSON-1957240839 tempest-DeleteServersTestJSON-1957240839-project] HTTP exception thrown: Instance dcd9bb33-bad5-4d93-ba0f-558c63746e29 could not be found. Oct 13 13:11:10.373611 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-de143908-2518-45b2-9f3c-4d6049a45065 tempest-DeleteServersTestJSON-1957240839 tempest-DeleteServersTestJSON-1957240839-project] Request method failure captured: Oct 13 13:11:10.373611 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: request: GET /compute/v2.1/servers/dcd9bb33-bad5-4d93-ba0f-558c63746e29 HTTP/1.1 Oct 13 13:11:10.373611 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: Accept: application/json Oct 13 13:11:10.373611 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: Accept-Encoding: identity Oct 13 13:11:10.373611 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: Connection: close Oct 13 13:11:10.373611 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: Content-Length: 0 Oct 13 13:11:10.373611 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: Content-Type: application/json Oct 13 13:11:10.373611 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: Host: 10.222.0.23 Oct 13 13:11:10.373611 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: Openstack-System-Scope: None Oct 13 13:11:10.373611 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: User-Agent: python-urllib3/1.26.12 Oct 13 13:11:10.373611 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Auth-Token: gAAAAABjSA4n820Hg3jjUXMdb7t1Zlme7Ar0sTf4f2FknFCxHLFzjktynArB3Ly-8wVBBsOJCAbSHVfWTimPnEf6lR1_aZAqpybZmxju5GgExrZJCnpzPy1tNdUJC_eA5oz-yVMxx3CkCs6T6tLPMEgb6brz6jmK50dh0A77rZZh-b8WnEOpwwA Oct 13 13:11:10.373611 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Domain-Id: None Oct 13 13:11:10.373611 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Domain-Name: None Oct 13 13:11:10.373611 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Identity-Status: Confirmed Oct 13 13:11:10.373611 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Is-Admin-Project: True Oct 13 13:11:10.373611 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Project-Domain-Id: default Oct 13 13:11:10.373611 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Project-Domain-Name: Default Oct 13 13:11:10.373611 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Project-Id: 6027a602300d4d2bbf33ac329b2960f6 Oct 13 13:11:10.373611 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Project-Name: tempest-DeleteServersTestJSON-1957240839 Oct 13 13:11:10.373611 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Role: reader,member Oct 13 13:11:10.373611 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Roles: reader,member Oct 13 13:11:10.375139 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_6027a602300d4d2bbf33ac329b2960f6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/6027a602300d4d2bbf33ac329b2960f6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/6027a602300d4d2bbf33ac329b2960f6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/6027a602300d4d2bbf33ac329b2960f6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}] Oct 13 13:11:10.375139 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Tenant: tempest-DeleteServersTestJSON-1957240839 Oct 13 13:11:10.375139 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Tenant-Id: 6027a602300d4d2bbf33ac329b2960f6 Oct 13 13:11:10.375139 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Tenant-Name: tempest-DeleteServersTestJSON-1957240839 Oct 13 13:11:10.375139 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-User: tempest-DeleteServersTestJSON-1957240839-project Oct 13 13:11:10.375139 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-User-Domain-Id: default Oct 13 13:11:10.375139 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-User-Domain-Name: Default Oct 13 13:11:10.375139 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-User-Id: e3a049e77aba470db21e26d1bc8caa80 Oct 13 13:11:10.375139 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-User-Name: tempest-DeleteServersTestJSON-1957240839-project Oct 13 13:11:10.375139 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: method: > Oct 13 13:11:10.375139 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: exception: Instance dcd9bb33-bad5-4d93-ba0f-558c63746e29 could not be found. Oct 13 13:11:10.375139 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: action_args: {'id': 'dcd9bb33-bad5-4d93-ba0f-558c63746e29'} Oct 13 13:11:10.376128 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 13:11:10.376128 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 13:11:10.376128 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 13 13:11:10.376128 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 13 13:11:10.376128 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 13 13:11:10.376128 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 13 13:11:10.376128 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 13 13:11:10.376128 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 13 13:11:10.376128 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 13 13:11:10.376128 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 13 13:11:10.376128 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dcd9bb33-bad5-4d93-ba0f-558c63746e29 could not be found. Oct 13 13:11:10.376128 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi Oct 13 13:11:10.376128 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 13:11:10.376128 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi Oct 13 13:11:10.376128 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 13:11:10.376128 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 13:11:10.376128 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 13:11:10.376128 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 13:11:10.376128 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 13:11:10.376128 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 13:11:10.377547 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 13:11:10.377547 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 13 13:11:10.377547 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 13 13:11:10.377547 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 13 13:11:10.377547 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 13 13:11:10.377547 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 13 13:11:10.377547 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 13 13:11:10.377547 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dcd9bb33-bad5-4d93-ba0f-558c63746e29 could not be found. Oct 13 13:11:10.377547 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi Oct 13 13:11:10.377547 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 13:11:10.377547 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi Oct 13 13:11:10.377547 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 13:11:10.377547 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 13:11:10.377547 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 13:11:10.377547 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 13:11:10.377547 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 13:11:10.377547 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dcd9bb33-bad5-4d93-ba0f-558c63746e29 could not be found. Oct 13 13:11:10.377547 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi Oct 13 13:11:10.378806 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-de143908-2518-45b2-9f3c-4d6049a45065 tempest-DeleteServersTestJSON-1957240839 tempest-DeleteServersTestJSON-1957240839-project] Returning 404 to user: Instance dcd9bb33-bad5-4d93-ba0f-558c63746e29 could not be found. {{(pid=118814) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 13:11:10.378806 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-de143908-2518-45b2-9f3c-4d6049a45065 tempest-DeleteServersTestJSON-1957240839 tempest-DeleteServersTestJSON-1957240839-project] 10.222.0.23 "GET /compute/v2.1/servers/dcd9bb33-bad5-4d93-ba0f-558c63746e29" status: 404 len: 111 microversion: 2.1 time: 0.036791 Oct 13 13:11:10.378806 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 101/186] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:11:10 2022] GET /compute/v2.1/servers/dcd9bb33-bad5-4d93-ba0f-558c63746e29 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 13 13:11:10.502633 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-5e7fb2e0-73b6-4365-92a2-7e29c25caba4 tempest-DeleteServersTestJSON-1957240839 tempest-DeleteServersTestJSON-1957240839-project] Calling method '>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:11:10.505133 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-5e7fb2e0-73b6-4365-92a2-7e29c25caba4 tempest-DeleteServersTestJSON-1957240839 tempest-DeleteServersTestJSON-1957240839-project] [instance: dcd9bb33-bad5-4d93-ba0f-558c63746e29] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:11:10.512362 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-5e7fb2e0-73b6-4365-92a2-7e29c25caba4 tempest-DeleteServersTestJSON-1957240839 tempest-DeleteServersTestJSON-1957240839-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:11:10.512851 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-5e7fb2e0-73b6-4365-92a2-7e29c25caba4 tempest-DeleteServersTestJSON-1957240839 tempest-DeleteServersTestJSON-1957240839-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:11:10.513289 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-5e7fb2e0-73b6-4365-92a2-7e29c25caba4 tempest-DeleteServersTestJSON-1957240839 tempest-DeleteServersTestJSON-1957240839-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:11:10.514116 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-5e7fb2e0-73b6-4365-92a2-7e29c25caba4 tempest-DeleteServersTestJSON-1957240839 tempest-DeleteServersTestJSON-1957240839-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:11:10.514954 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-5e7fb2e0-73b6-4365-92a2-7e29c25caba4 tempest-DeleteServersTestJSON-1957240839 tempest-DeleteServersTestJSON-1957240839-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:11:10.515548 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-5e7fb2e0-73b6-4365-92a2-7e29c25caba4 tempest-DeleteServersTestJSON-1957240839 tempest-DeleteServersTestJSON-1957240839-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:11:10.528942 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.wsgi [None req-5e7fb2e0-73b6-4365-92a2-7e29c25caba4 tempest-DeleteServersTestJSON-1957240839 tempest-DeleteServersTestJSON-1957240839-project] HTTP exception thrown: Instance dcd9bb33-bad5-4d93-ba0f-558c63746e29 could not be found. Oct 13 13:11:10.532955 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-5e7fb2e0-73b6-4365-92a2-7e29c25caba4 tempest-DeleteServersTestJSON-1957240839 tempest-DeleteServersTestJSON-1957240839-project] Request method failure captured: Oct 13 13:11:10.532955 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: request: GET /compute/v2.1/servers/dcd9bb33-bad5-4d93-ba0f-558c63746e29/os-volume_attachments HTTP/1.1 Oct 13 13:11:10.532955 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: Accept: application/json Oct 13 13:11:10.532955 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: Accept-Encoding: identity Oct 13 13:11:10.532955 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: Connection: close Oct 13 13:11:10.532955 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: Content-Length: 0 Oct 13 13:11:10.532955 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: Content-Type: application/json Oct 13 13:11:10.532955 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: Host: 10.222.0.23 Oct 13 13:11:10.532955 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: Openstack-System-Scope: None Oct 13 13:11:10.532955 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: User-Agent: python-urllib3/1.26.12 Oct 13 13:11:10.532955 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Auth-Token: gAAAAABjSA4n820Hg3jjUXMdb7t1Zlme7Ar0sTf4f2FknFCxHLFzjktynArB3Ly-8wVBBsOJCAbSHVfWTimPnEf6lR1_aZAqpybZmxju5GgExrZJCnpzPy1tNdUJC_eA5oz-yVMxx3CkCs6T6tLPMEgb6brz6jmK50dh0A77rZZh-b8WnEOpwwA Oct 13 13:11:10.532955 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Domain-Id: None Oct 13 13:11:10.532955 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Domain-Name: None Oct 13 13:11:10.532955 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Identity-Status: Confirmed Oct 13 13:11:10.532955 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Is-Admin-Project: True Oct 13 13:11:10.532955 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Project-Domain-Id: default Oct 13 13:11:10.532955 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Project-Domain-Name: Default Oct 13 13:11:10.532955 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Project-Id: 6027a602300d4d2bbf33ac329b2960f6 Oct 13 13:11:10.532955 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Project-Name: tempest-DeleteServersTestJSON-1957240839 Oct 13 13:11:10.532955 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Role: reader,member Oct 13 13:11:10.532955 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Roles: reader,member Oct 13 13:11:10.534247 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_6027a602300d4d2bbf33ac329b2960f6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/6027a602300d4d2bbf33ac329b2960f6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/6027a602300d4d2bbf33ac329b2960f6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/6027a602300d4d2bbf33ac329b2960f6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}] Oct 13 13:11:10.534247 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Tenant: tempest-DeleteServersTestJSON-1957240839 Oct 13 13:11:10.534247 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Tenant-Id: 6027a602300d4d2bbf33ac329b2960f6 Oct 13 13:11:10.534247 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Tenant-Name: tempest-DeleteServersTestJSON-1957240839 Oct 13 13:11:10.534247 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-User: tempest-DeleteServersTestJSON-1957240839-project Oct 13 13:11:10.534247 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-User-Domain-Id: default Oct 13 13:11:10.534247 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-User-Domain-Name: Default Oct 13 13:11:10.534247 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-User-Id: e3a049e77aba470db21e26d1bc8caa80 Oct 13 13:11:10.534247 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-User-Name: tempest-DeleteServersTestJSON-1957240839-project Oct 13 13:11:10.534247 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: method: > Oct 13 13:11:10.534247 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: exception: Instance dcd9bb33-bad5-4d93-ba0f-558c63746e29 could not be found. Oct 13 13:11:10.534247 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: action_args: {'server_id': 'dcd9bb33-bad5-4d93-ba0f-558c63746e29'} Oct 13 13:11:10.535072 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 13:11:10.535072 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 13:11:10.535072 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 13 13:11:10.535072 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 13 13:11:10.535072 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 13 13:11:10.535072 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 13 13:11:10.535072 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 13 13:11:10.535072 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 13 13:11:10.535072 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 13 13:11:10.535072 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 13 13:11:10.535072 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dcd9bb33-bad5-4d93-ba0f-558c63746e29 could not be found. Oct 13 13:11:10.535072 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi Oct 13 13:11:10.535072 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 13:11:10.535072 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi Oct 13 13:11:10.535072 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 13:11:10.535072 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 13:11:10.535072 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 13:11:10.535072 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 13:11:10.535072 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 13:11:10.535072 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 13:11:10.536341 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 13:11:10.536341 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 13 13:11:10.536341 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 13 13:11:10.536341 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 13 13:11:10.536341 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 13 13:11:10.536341 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Oct 13 13:11:10.536341 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Oct 13 13:11:10.536341 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 13 13:11:10.536341 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 13 13:11:10.536341 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dcd9bb33-bad5-4d93-ba0f-558c63746e29 could not be found. Oct 13 13:11:10.536341 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi Oct 13 13:11:10.536341 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 13:11:10.536341 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi Oct 13 13:11:10.536341 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 13:11:10.536341 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 13:11:10.536341 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 13:11:10.536341 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 13:11:10.536341 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 13:11:10.536341 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dcd9bb33-bad5-4d93-ba0f-558c63746e29 could not be found. Oct 13 13:11:10.536341 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi Oct 13 13:11:10.537366 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-5e7fb2e0-73b6-4365-92a2-7e29c25caba4 tempest-DeleteServersTestJSON-1957240839 tempest-DeleteServersTestJSON-1957240839-project] Returning 404 to user: Instance dcd9bb33-bad5-4d93-ba0f-558c63746e29 could not be found. {{(pid=118815) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 13:11:10.537366 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-5e7fb2e0-73b6-4365-92a2-7e29c25caba4 tempest-DeleteServersTestJSON-1957240839 tempest-DeleteServersTestJSON-1957240839-project] 10.222.0.23 "GET /compute/v2.1/servers/dcd9bb33-bad5-4d93-ba0f-558c63746e29/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.036073 Oct 13 13:11:10.537366 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 86/187] 10.222.0.23 () {58 vars in 1302 bytes} [Thu Oct 13 13:11:10 2022] GET /compute/v2.1/servers/dcd9bb33-bad5-4d93-ba0f-558c63746e29/os-volume_attachments => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 13 13:11:10.834619 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-1e5ce908-ce34-46e6-b6ba-7be1cb27b921 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Calling method '>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:11:10.835804 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-1e5ce908-ce34-46e6-b6ba-7be1cb27b921 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] [instance: 96c829cb-4dde-467c-b50f-b2f666bdab0b] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:11:10.841874 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-1e5ce908-ce34-46e6-b6ba-7be1cb27b921 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:11:10.842637 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-1e5ce908-ce34-46e6-b6ba-7be1cb27b921 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:11:10.843328 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-1e5ce908-ce34-46e6-b6ba-7be1cb27b921 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:11:10.844190 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-1e5ce908-ce34-46e6-b6ba-7be1cb27b921 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:11:10.844819 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-1e5ce908-ce34-46e6-b6ba-7be1cb27b921 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:11:10.845258 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-1e5ce908-ce34-46e6-b6ba-7be1cb27b921 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:11:10.991308 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-1e5ce908-ce34-46e6-b6ba-7be1cb27b921 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '454203f47b434cca952a1cef56de559f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7312d0ac9248f2bfbece5611913ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:11:10.998996 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-1e5ce908-ce34-46e6-b6ba-7be1cb27b921 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] 10.222.0.23 "GET /compute/v2.1/servers/96c829cb-4dde-467c-b50f-b2f666bdab0b" status: 200 len: 1522 microversion: 2.1 time: 0.168478 Oct 13 13:11:10.999579 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 102/188] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:11:10 2022] GET /compute/v2.1/servers/96c829cb-4dde-467c-b50f-b2f666bdab0b => generated 1522 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:11:11.753327 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-20ae1be2-31ea-420a-add6-14137bac218b tempest-DeleteServersTestJSON-1957240839 tempest-DeleteServersTestJSON-1957240839-project] Calling method '>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:11:11.753944 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-20ae1be2-31ea-420a-add6-14137bac218b tempest-DeleteServersTestJSON-1957240839 tempest-DeleteServersTestJSON-1957240839-project] [instance: dcd9bb33-bad5-4d93-ba0f-558c63746e29] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:11:11.761354 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-20ae1be2-31ea-420a-add6-14137bac218b tempest-DeleteServersTestJSON-1957240839 tempest-DeleteServersTestJSON-1957240839-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:11:11.761839 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-20ae1be2-31ea-420a-add6-14137bac218b tempest-DeleteServersTestJSON-1957240839 tempest-DeleteServersTestJSON-1957240839-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:11:11.762272 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-20ae1be2-31ea-420a-add6-14137bac218b tempest-DeleteServersTestJSON-1957240839 tempest-DeleteServersTestJSON-1957240839-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:11:11.762967 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-20ae1be2-31ea-420a-add6-14137bac218b tempest-DeleteServersTestJSON-1957240839 tempest-DeleteServersTestJSON-1957240839-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:11:11.763464 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-20ae1be2-31ea-420a-add6-14137bac218b tempest-DeleteServersTestJSON-1957240839 tempest-DeleteServersTestJSON-1957240839-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:11:11.763889 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-20ae1be2-31ea-420a-add6-14137bac218b tempest-DeleteServersTestJSON-1957240839 tempest-DeleteServersTestJSON-1957240839-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:11:11.778363 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.wsgi [None req-20ae1be2-31ea-420a-add6-14137bac218b tempest-DeleteServersTestJSON-1957240839 tempest-DeleteServersTestJSON-1957240839-project] HTTP exception thrown: Instance dcd9bb33-bad5-4d93-ba0f-558c63746e29 could not be found. Oct 13 13:11:11.780478 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-20ae1be2-31ea-420a-add6-14137bac218b tempest-DeleteServersTestJSON-1957240839 tempest-DeleteServersTestJSON-1957240839-project] Request method failure captured: Oct 13 13:11:11.780478 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: request: DELETE /compute/v2.1/servers/dcd9bb33-bad5-4d93-ba0f-558c63746e29 HTTP/1.1 Oct 13 13:11:11.780478 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: Accept: application/json Oct 13 13:11:11.780478 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: Accept-Encoding: identity Oct 13 13:11:11.780478 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: Connection: close Oct 13 13:11:11.780478 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: Content-Length: 0 Oct 13 13:11:11.780478 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: Content-Type: application/json Oct 13 13:11:11.780478 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: Host: 10.222.0.23 Oct 13 13:11:11.780478 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: Openstack-System-Scope: None Oct 13 13:11:11.780478 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: User-Agent: python-urllib3/1.26.12 Oct 13 13:11:11.780478 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Auth-Token: gAAAAABjSA4n820Hg3jjUXMdb7t1Zlme7Ar0sTf4f2FknFCxHLFzjktynArB3Ly-8wVBBsOJCAbSHVfWTimPnEf6lR1_aZAqpybZmxju5GgExrZJCnpzPy1tNdUJC_eA5oz-yVMxx3CkCs6T6tLPMEgb6brz6jmK50dh0A77rZZh-b8WnEOpwwA Oct 13 13:11:11.780478 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Domain-Id: None Oct 13 13:11:11.780478 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Domain-Name: None Oct 13 13:11:11.780478 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Identity-Status: Confirmed Oct 13 13:11:11.780478 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Is-Admin-Project: True Oct 13 13:11:11.780478 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Project-Domain-Id: default Oct 13 13:11:11.780478 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Project-Domain-Name: Default Oct 13 13:11:11.780478 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Project-Id: 6027a602300d4d2bbf33ac329b2960f6 Oct 13 13:11:11.780478 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Project-Name: tempest-DeleteServersTestJSON-1957240839 Oct 13 13:11:11.780478 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Role: reader,member Oct 13 13:11:11.780478 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Roles: reader,member Oct 13 13:11:11.781649 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_6027a602300d4d2bbf33ac329b2960f6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/6027a602300d4d2bbf33ac329b2960f6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/6027a602300d4d2bbf33ac329b2960f6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/6027a602300d4d2bbf33ac329b2960f6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}] Oct 13 13:11:11.781649 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Tenant: tempest-DeleteServersTestJSON-1957240839 Oct 13 13:11:11.781649 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Tenant-Id: 6027a602300d4d2bbf33ac329b2960f6 Oct 13 13:11:11.781649 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Tenant-Name: tempest-DeleteServersTestJSON-1957240839 Oct 13 13:11:11.781649 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-User: tempest-DeleteServersTestJSON-1957240839-project Oct 13 13:11:11.781649 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-User-Domain-Id: default Oct 13 13:11:11.781649 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-User-Domain-Name: Default Oct 13 13:11:11.781649 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-User-Id: e3a049e77aba470db21e26d1bc8caa80 Oct 13 13:11:11.781649 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-User-Name: tempest-DeleteServersTestJSON-1957240839-project Oct 13 13:11:11.781649 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: method: > Oct 13 13:11:11.781649 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: exception: Instance dcd9bb33-bad5-4d93-ba0f-558c63746e29 could not be found. Oct 13 13:11:11.781649 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: action_args: {'id': 'dcd9bb33-bad5-4d93-ba0f-558c63746e29'} Oct 13 13:11:11.782278 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 13:11:11.782278 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 13:11:11.782278 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 13 13:11:11.782278 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 13 13:11:11.782278 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 13 13:11:11.782278 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 13 13:11:11.782278 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 13 13:11:11.782278 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 13 13:11:11.782278 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 13 13:11:11.782278 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 13 13:11:11.782278 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dcd9bb33-bad5-4d93-ba0f-558c63746e29 could not be found. Oct 13 13:11:11.782278 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi Oct 13 13:11:11.782278 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 13:11:11.782278 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi Oct 13 13:11:11.782278 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 13:11:11.782278 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 13:11:11.782278 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 13:11:11.782278 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 13:11:11.782278 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 13:11:11.782278 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 13:11:11.783364 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 13:11:11.783364 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 13 13:11:11.783364 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 13 13:11:11.783364 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 13 13:11:11.783364 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 13 13:11:11.783364 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 13 13:11:11.783364 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 13 13:11:11.783364 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 13 13:11:11.783364 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 13 13:11:11.783364 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dcd9bb33-bad5-4d93-ba0f-558c63746e29 could not be found. Oct 13 13:11:11.783364 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi Oct 13 13:11:11.783364 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 13:11:11.783364 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi Oct 13 13:11:11.783364 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 13:11:11.783364 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 13:11:11.783364 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 13:11:11.783364 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 13:11:11.783364 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 13:11:11.783364 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dcd9bb33-bad5-4d93-ba0f-558c63746e29 could not be found. Oct 13 13:11:11.783364 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi Oct 13 13:11:11.784428 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-20ae1be2-31ea-420a-add6-14137bac218b tempest-DeleteServersTestJSON-1957240839 tempest-DeleteServersTestJSON-1957240839-project] Returning 404 to user: Instance dcd9bb33-bad5-4d93-ba0f-558c63746e29 could not be found. {{(pid=118815) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 13:11:11.784428 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-20ae1be2-31ea-420a-add6-14137bac218b tempest-DeleteServersTestJSON-1957240839 tempest-DeleteServersTestJSON-1957240839-project] 10.222.0.23 "DELETE /compute/v2.1/servers/dcd9bb33-bad5-4d93-ba0f-558c63746e29" status: 404 len: 111 microversion: 2.1 time: 0.032674 Oct 13 13:11:11.784428 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 87/189] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Oct 13 13:11:11 2022] DELETE /compute/v2.1/servers/dcd9bb33-bad5-4d93-ba0f-558c63746e29 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 13 13:11:11.791574 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-830f3b47-b2e2-4667-b98d-397cc642aa12 tempest-DeleteServersTestJSON-1957240839 tempest-DeleteServersTestJSON-1957240839-project] Calling method '>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:11:11.792255 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-830f3b47-b2e2-4667-b98d-397cc642aa12 tempest-DeleteServersTestJSON-1957240839 tempest-DeleteServersTestJSON-1957240839-project] [instance: dcd9bb33-bad5-4d93-ba0f-558c63746e29] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:11:11.798980 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-830f3b47-b2e2-4667-b98d-397cc642aa12 tempest-DeleteServersTestJSON-1957240839 tempest-DeleteServersTestJSON-1957240839-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:11:11.799508 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-830f3b47-b2e2-4667-b98d-397cc642aa12 tempest-DeleteServersTestJSON-1957240839 tempest-DeleteServersTestJSON-1957240839-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:11:11.800116 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-830f3b47-b2e2-4667-b98d-397cc642aa12 tempest-DeleteServersTestJSON-1957240839 tempest-DeleteServersTestJSON-1957240839-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:11:11.800808 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-830f3b47-b2e2-4667-b98d-397cc642aa12 tempest-DeleteServersTestJSON-1957240839 tempest-DeleteServersTestJSON-1957240839-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:11:11.801420 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-830f3b47-b2e2-4667-b98d-397cc642aa12 tempest-DeleteServersTestJSON-1957240839 tempest-DeleteServersTestJSON-1957240839-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:11:11.802111 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-830f3b47-b2e2-4667-b98d-397cc642aa12 tempest-DeleteServersTestJSON-1957240839 tempest-DeleteServersTestJSON-1957240839-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:11:11.818267 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.wsgi [None req-830f3b47-b2e2-4667-b98d-397cc642aa12 tempest-DeleteServersTestJSON-1957240839 tempest-DeleteServersTestJSON-1957240839-project] HTTP exception thrown: Instance dcd9bb33-bad5-4d93-ba0f-558c63746e29 could not be found. Oct 13 13:11:11.819952 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-830f3b47-b2e2-4667-b98d-397cc642aa12 tempest-DeleteServersTestJSON-1957240839 tempest-DeleteServersTestJSON-1957240839-project] Request method failure captured: Oct 13 13:11:11.819952 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: request: GET /compute/v2.1/servers/dcd9bb33-bad5-4d93-ba0f-558c63746e29 HTTP/1.1 Oct 13 13:11:11.819952 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: Accept: application/json Oct 13 13:11:11.819952 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: Accept-Encoding: identity Oct 13 13:11:11.819952 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: Connection: close Oct 13 13:11:11.819952 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: Content-Length: 0 Oct 13 13:11:11.819952 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: Content-Type: application/json Oct 13 13:11:11.819952 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: Host: 10.222.0.23 Oct 13 13:11:11.819952 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: Openstack-System-Scope: None Oct 13 13:11:11.819952 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: User-Agent: python-urllib3/1.26.12 Oct 13 13:11:11.819952 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Auth-Token: gAAAAABjSA4n820Hg3jjUXMdb7t1Zlme7Ar0sTf4f2FknFCxHLFzjktynArB3Ly-8wVBBsOJCAbSHVfWTimPnEf6lR1_aZAqpybZmxju5GgExrZJCnpzPy1tNdUJC_eA5oz-yVMxx3CkCs6T6tLPMEgb6brz6jmK50dh0A77rZZh-b8WnEOpwwA Oct 13 13:11:11.819952 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Domain-Id: None Oct 13 13:11:11.819952 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Domain-Name: None Oct 13 13:11:11.819952 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Identity-Status: Confirmed Oct 13 13:11:11.819952 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Is-Admin-Project: True Oct 13 13:11:11.819952 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Project-Domain-Id: default Oct 13 13:11:11.819952 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Project-Domain-Name: Default Oct 13 13:11:11.819952 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Project-Id: 6027a602300d4d2bbf33ac329b2960f6 Oct 13 13:11:11.819952 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Project-Name: tempest-DeleteServersTestJSON-1957240839 Oct 13 13:11:11.819952 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Role: reader,member Oct 13 13:11:11.819952 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Roles: reader,member Oct 13 13:11:11.821173 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_6027a602300d4d2bbf33ac329b2960f6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/6027a602300d4d2bbf33ac329b2960f6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/6027a602300d4d2bbf33ac329b2960f6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/6027a602300d4d2bbf33ac329b2960f6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}] Oct 13 13:11:11.821173 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Tenant: tempest-DeleteServersTestJSON-1957240839 Oct 13 13:11:11.821173 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Tenant-Id: 6027a602300d4d2bbf33ac329b2960f6 Oct 13 13:11:11.821173 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Tenant-Name: tempest-DeleteServersTestJSON-1957240839 Oct 13 13:11:11.821173 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-User: tempest-DeleteServersTestJSON-1957240839-project Oct 13 13:11:11.821173 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-User-Domain-Id: default Oct 13 13:11:11.821173 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-User-Domain-Name: Default Oct 13 13:11:11.821173 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-User-Id: e3a049e77aba470db21e26d1bc8caa80 Oct 13 13:11:11.821173 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-User-Name: tempest-DeleteServersTestJSON-1957240839-project Oct 13 13:11:11.821173 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: method: > Oct 13 13:11:11.821173 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: exception: Instance dcd9bb33-bad5-4d93-ba0f-558c63746e29 could not be found. Oct 13 13:11:11.821173 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: action_args: {'id': 'dcd9bb33-bad5-4d93-ba0f-558c63746e29'} Oct 13 13:11:11.821799 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 13:11:11.821799 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 13:11:11.821799 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 13 13:11:11.821799 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 13 13:11:11.821799 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 13 13:11:11.821799 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 13 13:11:11.821799 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 13 13:11:11.821799 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 13 13:11:11.821799 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 13 13:11:11.821799 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 13 13:11:11.821799 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dcd9bb33-bad5-4d93-ba0f-558c63746e29 could not be found. Oct 13 13:11:11.821799 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi Oct 13 13:11:11.821799 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 13:11:11.821799 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi Oct 13 13:11:11.821799 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 13:11:11.821799 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 13:11:11.821799 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 13:11:11.821799 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 13:11:11.821799 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 13:11:11.821799 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 13:11:11.824021 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 13:11:11.824021 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 13 13:11:11.824021 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 13 13:11:11.824021 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 13 13:11:11.824021 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 13 13:11:11.824021 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 13 13:11:11.824021 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 13 13:11:11.824021 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dcd9bb33-bad5-4d93-ba0f-558c63746e29 could not be found. Oct 13 13:11:11.824021 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi Oct 13 13:11:11.824021 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 13:11:11.824021 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi Oct 13 13:11:11.824021 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 13:11:11.824021 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 13:11:11.824021 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 13:11:11.824021 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 13:11:11.824021 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 13:11:11.824021 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dcd9bb33-bad5-4d93-ba0f-558c63746e29 could not be found. Oct 13 13:11:11.824021 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi Oct 13 13:11:11.825336 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-830f3b47-b2e2-4667-b98d-397cc642aa12 tempest-DeleteServersTestJSON-1957240839 tempest-DeleteServersTestJSON-1957240839-project] Returning 404 to user: Instance dcd9bb33-bad5-4d93-ba0f-558c63746e29 could not be found. {{(pid=118814) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 13:11:11.825336 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-830f3b47-b2e2-4667-b98d-397cc642aa12 tempest-DeleteServersTestJSON-1957240839 tempest-DeleteServersTestJSON-1957240839-project] 10.222.0.23 "GET /compute/v2.1/servers/dcd9bb33-bad5-4d93-ba0f-558c63746e29" status: 404 len: 111 microversion: 2.1 time: 0.034397 Oct 13 13:11:11.825336 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 103/190] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:11:11 2022] GET /compute/v2.1/servers/dcd9bb33-bad5-4d93-ba0f-558c63746e29 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 13 13:11:12.022289 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-cd7870fc-86a4-4f0d-8037-3b3da8a55994 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Calling method '>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:11:12.022910 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-cd7870fc-86a4-4f0d-8037-3b3da8a55994 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] [instance: 96c829cb-4dde-467c-b50f-b2f666bdab0b] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:11:12.029160 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-cd7870fc-86a4-4f0d-8037-3b3da8a55994 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:11:12.029880 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-cd7870fc-86a4-4f0d-8037-3b3da8a55994 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:11:12.030498 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-cd7870fc-86a4-4f0d-8037-3b3da8a55994 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:11:12.031518 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-cd7870fc-86a4-4f0d-8037-3b3da8a55994 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:11:12.032148 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-cd7870fc-86a4-4f0d-8037-3b3da8a55994 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:11:12.032750 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-cd7870fc-86a4-4f0d-8037-3b3da8a55994 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:11:12.404208 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-cd7870fc-86a4-4f0d-8037-3b3da8a55994 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '454203f47b434cca952a1cef56de559f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7312d0ac9248f2bfbece5611913ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:11:12.427239 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-cd7870fc-86a4-4f0d-8037-3b3da8a55994 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] 10.222.0.23 "GET /compute/v2.1/servers/96c829cb-4dde-467c-b50f-b2f666bdab0b" status: 200 len: 1522 microversion: 2.1 time: 0.408562 Oct 13 13:11:12.429372 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 88/191] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:11:12 2022] GET /compute/v2.1/servers/96c829cb-4dde-467c-b50f-b2f666bdab0b => generated 1522 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:11:13.471152 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-5fe12fae-9fb3-4a7a-8ffd-805ceb9c2c31 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Calling method '>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:11:13.471901 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-5fe12fae-9fb3-4a7a-8ffd-805ceb9c2c31 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] [instance: 96c829cb-4dde-467c-b50f-b2f666bdab0b] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:11:13.481723 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-5fe12fae-9fb3-4a7a-8ffd-805ceb9c2c31 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:11:13.483136 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-5fe12fae-9fb3-4a7a-8ffd-805ceb9c2c31 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:11:13.483814 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-5fe12fae-9fb3-4a7a-8ffd-805ceb9c2c31 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:11:13.484784 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-5fe12fae-9fb3-4a7a-8ffd-805ceb9c2c31 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:11:13.486086 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-5fe12fae-9fb3-4a7a-8ffd-805ceb9c2c31 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:11:13.487715 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-5fe12fae-9fb3-4a7a-8ffd-805ceb9c2c31 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:11:13.797719 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-5fe12fae-9fb3-4a7a-8ffd-805ceb9c2c31 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '454203f47b434cca952a1cef56de559f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7312d0ac9248f2bfbece5611913ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:11:13.806577 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-5fe12fae-9fb3-4a7a-8ffd-805ceb9c2c31 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] 10.222.0.23 "GET /compute/v2.1/servers/96c829cb-4dde-467c-b50f-b2f666bdab0b" status: 200 len: 1522 microversion: 2.1 time: 0.339971 Oct 13 13:11:13.823033 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 104/192] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:11:13 2022] GET /compute/v2.1/servers/96c829cb-4dde-467c-b50f-b2f666bdab0b => generated 1522 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:11:14.829228 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-3ed2247d-0a07-4c0f-b4d0-98cbe53fc151 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Calling method '>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:11:14.829842 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-3ed2247d-0a07-4c0f-b4d0-98cbe53fc151 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] [instance: 96c829cb-4dde-467c-b50f-b2f666bdab0b] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:11:14.843422 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-3ed2247d-0a07-4c0f-b4d0-98cbe53fc151 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:11:14.845012 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-3ed2247d-0a07-4c0f-b4d0-98cbe53fc151 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:11:14.845757 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-3ed2247d-0a07-4c0f-b4d0-98cbe53fc151 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:11:14.846726 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-3ed2247d-0a07-4c0f-b4d0-98cbe53fc151 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:11:14.852555 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-3ed2247d-0a07-4c0f-b4d0-98cbe53fc151 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:11:14.853010 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-3ed2247d-0a07-4c0f-b4d0-98cbe53fc151 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:11:15.166080 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-3ed2247d-0a07-4c0f-b4d0-98cbe53fc151 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '454203f47b434cca952a1cef56de559f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7312d0ac9248f2bfbece5611913ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:11:15.175280 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-3ed2247d-0a07-4c0f-b4d0-98cbe53fc151 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] 10.222.0.23 "GET /compute/v2.1/servers/96c829cb-4dde-467c-b50f-b2f666bdab0b" status: 200 len: 1522 microversion: 2.1 time: 0.350058 Oct 13 13:11:15.182389 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 89/193] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:11:14 2022] GET /compute/v2.1/servers/96c829cb-4dde-467c-b50f-b2f666bdab0b => generated 1522 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:11:16.205062 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-3de0a2d0-98c1-47ff-9253-99e6cdd61a79 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Calling method '>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:11:16.205797 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-3de0a2d0-98c1-47ff-9253-99e6cdd61a79 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] [instance: 96c829cb-4dde-467c-b50f-b2f666bdab0b] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:11:16.212365 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-3de0a2d0-98c1-47ff-9253-99e6cdd61a79 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:11:16.212925 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-3de0a2d0-98c1-47ff-9253-99e6cdd61a79 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:11:16.213456 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-3de0a2d0-98c1-47ff-9253-99e6cdd61a79 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:11:16.214228 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-3de0a2d0-98c1-47ff-9253-99e6cdd61a79 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:11:16.214688 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-3de0a2d0-98c1-47ff-9253-99e6cdd61a79 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:11:16.215140 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-3de0a2d0-98c1-47ff-9253-99e6cdd61a79 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:11:16.589379 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-3de0a2d0-98c1-47ff-9253-99e6cdd61a79 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '454203f47b434cca952a1cef56de559f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7312d0ac9248f2bfbece5611913ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:11:16.602867 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-3de0a2d0-98c1-47ff-9253-99e6cdd61a79 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] 10.222.0.23 "GET /compute/v2.1/servers/96c829cb-4dde-467c-b50f-b2f666bdab0b" status: 200 len: 1522 microversion: 2.1 time: 0.401136 Oct 13 13:11:16.603654 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 105/194] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:11:16 2022] GET /compute/v2.1/servers/96c829cb-4dde-467c-b50f-b2f666bdab0b => generated 1522 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:11:17.626301 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-99315b65-cbe9-4531-9af2-c58a463c3018 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Calling method '>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:11:17.627887 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-99315b65-cbe9-4531-9af2-c58a463c3018 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] [instance: 96c829cb-4dde-467c-b50f-b2f666bdab0b] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:11:17.637570 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-99315b65-cbe9-4531-9af2-c58a463c3018 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:11:17.638908 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-99315b65-cbe9-4531-9af2-c58a463c3018 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:11:17.639925 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-99315b65-cbe9-4531-9af2-c58a463c3018 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:11:17.641044 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-99315b65-cbe9-4531-9af2-c58a463c3018 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:11:17.641533 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-99315b65-cbe9-4531-9af2-c58a463c3018 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:11:17.642250 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-99315b65-cbe9-4531-9af2-c58a463c3018 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:11:17.853428 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-99315b65-cbe9-4531-9af2-c58a463c3018 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '454203f47b434cca952a1cef56de559f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7312d0ac9248f2bfbece5611913ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:11:17.867227 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-99315b65-cbe9-4531-9af2-c58a463c3018 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] 10.222.0.23 "GET /compute/v2.1/servers/96c829cb-4dde-467c-b50f-b2f666bdab0b" status: 200 len: 1522 microversion: 2.1 time: 0.245255 Oct 13 13:11:17.884428 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 90/195] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:11:17 2022] GET /compute/v2.1/servers/96c829cb-4dde-467c-b50f-b2f666bdab0b => generated 1522 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:11:18.894843 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-c81cde4f-3648-401f-b90d-33abe82e08bd tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Calling method '>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:11:18.895564 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-c81cde4f-3648-401f-b90d-33abe82e08bd tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] [instance: 96c829cb-4dde-467c-b50f-b2f666bdab0b] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:11:18.903716 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-c81cde4f-3648-401f-b90d-33abe82e08bd tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:11:18.904968 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-c81cde4f-3648-401f-b90d-33abe82e08bd tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:11:18.905511 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-c81cde4f-3648-401f-b90d-33abe82e08bd tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:11:18.906334 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-c81cde4f-3648-401f-b90d-33abe82e08bd tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:11:18.906884 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-c81cde4f-3648-401f-b90d-33abe82e08bd tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:11:18.907530 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-c81cde4f-3648-401f-b90d-33abe82e08bd tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:11:19.276783 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-c81cde4f-3648-401f-b90d-33abe82e08bd tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '454203f47b434cca952a1cef56de559f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7312d0ac9248f2bfbece5611913ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:11:19.288441 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-c81cde4f-3648-401f-b90d-33abe82e08bd tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] 10.222.0.23 "GET /compute/v2.1/servers/96c829cb-4dde-467c-b50f-b2f666bdab0b" status: 200 len: 1522 microversion: 2.1 time: 0.398439 Oct 13 13:11:19.289329 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 106/196] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:11:18 2022] GET /compute/v2.1/servers/96c829cb-4dde-467c-b50f-b2f666bdab0b => generated 1522 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:11:20.311913 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-aea0f6ff-13db-4454-9e93-0c9edd0d50c7 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Calling method '>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:11:20.312527 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-aea0f6ff-13db-4454-9e93-0c9edd0d50c7 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] [instance: 96c829cb-4dde-467c-b50f-b2f666bdab0b] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:11:20.319287 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-aea0f6ff-13db-4454-9e93-0c9edd0d50c7 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:11:20.319780 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-aea0f6ff-13db-4454-9e93-0c9edd0d50c7 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:11:20.320217 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-aea0f6ff-13db-4454-9e93-0c9edd0d50c7 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:11:20.320910 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-aea0f6ff-13db-4454-9e93-0c9edd0d50c7 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:11:20.321363 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-aea0f6ff-13db-4454-9e93-0c9edd0d50c7 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:11:20.321785 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-aea0f6ff-13db-4454-9e93-0c9edd0d50c7 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:11:20.501515 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-aea0f6ff-13db-4454-9e93-0c9edd0d50c7 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '454203f47b434cca952a1cef56de559f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7312d0ac9248f2bfbece5611913ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:11:20.509868 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-aea0f6ff-13db-4454-9e93-0c9edd0d50c7 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] 10.222.0.23 "GET /compute/v2.1/servers/96c829cb-4dde-467c-b50f-b2f666bdab0b" status: 200 len: 1522 microversion: 2.1 time: 0.201733 Oct 13 13:11:20.510428 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 91/197] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:11:20 2022] GET /compute/v2.1/servers/96c829cb-4dde-467c-b50f-b2f666bdab0b => generated 1522 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:11:21.534631 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-8b7e7876-b312-429f-b67d-38ed2be30b03 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Calling method '>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:11:21.535803 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-8b7e7876-b312-429f-b67d-38ed2be30b03 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] [instance: 96c829cb-4dde-467c-b50f-b2f666bdab0b] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:11:21.536844 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG dbcounter [-] [118814] Writing DB stats nova_api:SELECT=61,nova_api:INSERT=3 {{(pid=118814) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:11:21.541785 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-8b7e7876-b312-429f-b67d-38ed2be30b03 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:11:21.542273 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-8b7e7876-b312-429f-b67d-38ed2be30b03 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:11:21.542711 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-8b7e7876-b312-429f-b67d-38ed2be30b03 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:11:21.543433 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-8b7e7876-b312-429f-b67d-38ed2be30b03 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:11:21.543896 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-8b7e7876-b312-429f-b67d-38ed2be30b03 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:11:21.544322 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-8b7e7876-b312-429f-b67d-38ed2be30b03 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:11:21.695534 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-8b7e7876-b312-429f-b67d-38ed2be30b03 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '454203f47b434cca952a1cef56de559f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7312d0ac9248f2bfbece5611913ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:11:21.703969 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-8b7e7876-b312-429f-b67d-38ed2be30b03 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] 10.222.0.23 "GET /compute/v2.1/servers/96c829cb-4dde-467c-b50f-b2f666bdab0b" status: 200 len: 1522 microversion: 2.1 time: 0.173857 Oct 13 13:11:21.704541 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 107/198] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:11:21 2022] GET /compute/v2.1/servers/96c829cb-4dde-467c-b50f-b2f666bdab0b => generated 1522 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:11:22.731540 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-3bb21f54-5c7b-4952-ba6b-c074334ca6e7 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Calling method '>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:11:22.733072 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-3bb21f54-5c7b-4952-ba6b-c074334ca6e7 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] [instance: 96c829cb-4dde-467c-b50f-b2f666bdab0b] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:11:22.740225 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-3bb21f54-5c7b-4952-ba6b-c074334ca6e7 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:11:22.740948 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-3bb21f54-5c7b-4952-ba6b-c074334ca6e7 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:11:22.741498 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-3bb21f54-5c7b-4952-ba6b-c074334ca6e7 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:11:22.742243 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-3bb21f54-5c7b-4952-ba6b-c074334ca6e7 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:11:22.742694 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-3bb21f54-5c7b-4952-ba6b-c074334ca6e7 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:11:22.743313 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-3bb21f54-5c7b-4952-ba6b-c074334ca6e7 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:11:22.876462 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-3bb21f54-5c7b-4952-ba6b-c074334ca6e7 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '454203f47b434cca952a1cef56de559f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7312d0ac9248f2bfbece5611913ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:11:22.884230 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-3bb21f54-5c7b-4952-ba6b-c074334ca6e7 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] 10.222.0.23 "GET /compute/v2.1/servers/96c829cb-4dde-467c-b50f-b2f666bdab0b" status: 200 len: 1522 microversion: 2.1 time: 0.156686 Oct 13 13:11:22.884794 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 92/199] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:11:22 2022] GET /compute/v2.1/servers/96c829cb-4dde-467c-b50f-b2f666bdab0b => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:11:23.907269 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-783f7cc7-59ba-4061-a4c6-b8a6fd1bbca4 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Calling method '>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:11:23.907804 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-783f7cc7-59ba-4061-a4c6-b8a6fd1bbca4 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] [instance: 96c829cb-4dde-467c-b50f-b2f666bdab0b] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:11:23.913935 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-783f7cc7-59ba-4061-a4c6-b8a6fd1bbca4 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:11:23.914417 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-783f7cc7-59ba-4061-a4c6-b8a6fd1bbca4 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:11:23.914857 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-783f7cc7-59ba-4061-a4c6-b8a6fd1bbca4 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:11:23.915639 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-783f7cc7-59ba-4061-a4c6-b8a6fd1bbca4 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:11:23.916118 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-783f7cc7-59ba-4061-a4c6-b8a6fd1bbca4 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:11:23.916539 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-783f7cc7-59ba-4061-a4c6-b8a6fd1bbca4 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:11:24.042881 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-783f7cc7-59ba-4061-a4c6-b8a6fd1bbca4 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '454203f47b434cca952a1cef56de559f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7312d0ac9248f2bfbece5611913ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:11:24.050749 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-783f7cc7-59ba-4061-a4c6-b8a6fd1bbca4 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] 10.222.0.23 "GET /compute/v2.1/servers/96c829cb-4dde-467c-b50f-b2f666bdab0b" status: 200 len: 1522 microversion: 2.1 time: 0.147380 Oct 13 13:11:24.051344 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 108/200] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:11:23 2022] GET /compute/v2.1/servers/96c829cb-4dde-467c-b50f-b2f666bdab0b => generated 1522 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:11:25.075846 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-51c25f26-646b-4b30-960f-1b3516626125 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Calling method '>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:11:25.076977 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-51c25f26-646b-4b30-960f-1b3516626125 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] [instance: 96c829cb-4dde-467c-b50f-b2f666bdab0b] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:11:25.083875 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-51c25f26-646b-4b30-960f-1b3516626125 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:11:25.084480 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-51c25f26-646b-4b30-960f-1b3516626125 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:11:25.084818 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-51c25f26-646b-4b30-960f-1b3516626125 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:11:25.085511 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-51c25f26-646b-4b30-960f-1b3516626125 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:11:25.085966 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-51c25f26-646b-4b30-960f-1b3516626125 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:11:25.086566 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-51c25f26-646b-4b30-960f-1b3516626125 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:11:25.220413 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-51c25f26-646b-4b30-960f-1b3516626125 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '454203f47b434cca952a1cef56de559f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7312d0ac9248f2bfbece5611913ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:11:25.228893 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-51c25f26-646b-4b30-960f-1b3516626125 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] 10.222.0.23 "GET /compute/v2.1/servers/96c829cb-4dde-467c-b50f-b2f666bdab0b" status: 200 len: 1522 microversion: 2.1 time: 0.156888 Oct 13 13:11:25.229507 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 93/201] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:11:25 2022] GET /compute/v2.1/servers/96c829cb-4dde-467c-b50f-b2f666bdab0b => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 13:11:26.253250 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-4578937a-8a57-45bd-bf2f-d4630a88da72 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Calling method '>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:11:26.253895 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-4578937a-8a57-45bd-bf2f-d4630a88da72 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] [instance: 96c829cb-4dde-467c-b50f-b2f666bdab0b] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:11:26.259764 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-4578937a-8a57-45bd-bf2f-d4630a88da72 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:11:26.260254 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-4578937a-8a57-45bd-bf2f-d4630a88da72 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:11:26.260691 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-4578937a-8a57-45bd-bf2f-d4630a88da72 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:11:26.261386 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-4578937a-8a57-45bd-bf2f-d4630a88da72 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:11:26.261836 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-4578937a-8a57-45bd-bf2f-d4630a88da72 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:11:26.262258 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-4578937a-8a57-45bd-bf2f-d4630a88da72 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:11:26.421382 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-4578937a-8a57-45bd-bf2f-d4630a88da72 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '454203f47b434cca952a1cef56de559f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7312d0ac9248f2bfbece5611913ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:11:26.430982 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-4578937a-8a57-45bd-bf2f-d4630a88da72 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] 10.222.0.23 "GET /compute/v2.1/servers/96c829cb-4dde-467c-b50f-b2f666bdab0b" status: 200 len: 1522 microversion: 2.1 time: 0.181831 Oct 13 13:11:26.431582 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 109/202] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:11:26 2022] GET /compute/v2.1/servers/96c829cb-4dde-467c-b50f-b2f666bdab0b => generated 1522 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:11:27.453793 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-9a0c5a1f-e5aa-4293-8524-0c16274bd15b tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Calling method '>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:11:27.454952 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-9a0c5a1f-e5aa-4293-8524-0c16274bd15b tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] [instance: 96c829cb-4dde-467c-b50f-b2f666bdab0b] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:11:27.457429 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG dbcounter [-] [118815] Writing DB stats nova_api:SELECT=53,nova_api:UPDATE=1 {{(pid=118815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:11:27.462527 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-9a0c5a1f-e5aa-4293-8524-0c16274bd15b tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:11:27.463208 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-9a0c5a1f-e5aa-4293-8524-0c16274bd15b tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:11:27.463800 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-9a0c5a1f-e5aa-4293-8524-0c16274bd15b tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:11:27.464641 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-9a0c5a1f-e5aa-4293-8524-0c16274bd15b tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:11:27.465708 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-9a0c5a1f-e5aa-4293-8524-0c16274bd15b tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:11:27.466296 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-9a0c5a1f-e5aa-4293-8524-0c16274bd15b tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:11:27.657764 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-9a0c5a1f-e5aa-4293-8524-0c16274bd15b tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '454203f47b434cca952a1cef56de559f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7312d0ac9248f2bfbece5611913ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:11:27.666040 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-9a0c5a1f-e5aa-4293-8524-0c16274bd15b tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] 10.222.0.23 "GET /compute/v2.1/servers/96c829cb-4dde-467c-b50f-b2f666bdab0b" status: 200 len: 1522 microversion: 2.1 time: 0.216275 Oct 13 13:11:27.666610 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 94/203] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:11:27 2022] GET /compute/v2.1/servers/96c829cb-4dde-467c-b50f-b2f666bdab0b => generated 1522 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:11:28.690204 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-2b33f0ac-6109-4bb4-a398-72ae2099240b tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Calling method '>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:11:28.690857 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-2b33f0ac-6109-4bb4-a398-72ae2099240b tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] [instance: 96c829cb-4dde-467c-b50f-b2f666bdab0b] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:11:28.698010 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-2b33f0ac-6109-4bb4-a398-72ae2099240b tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:11:28.698709 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-2b33f0ac-6109-4bb4-a398-72ae2099240b tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:11:28.699562 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-2b33f0ac-6109-4bb4-a398-72ae2099240b tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:11:28.700345 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-2b33f0ac-6109-4bb4-a398-72ae2099240b tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:11:28.700872 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-2b33f0ac-6109-4bb4-a398-72ae2099240b tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:11:28.701542 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-2b33f0ac-6109-4bb4-a398-72ae2099240b tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:11:28.878771 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-2b33f0ac-6109-4bb4-a398-72ae2099240b tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '454203f47b434cca952a1cef56de559f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7312d0ac9248f2bfbece5611913ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:11:28.882845 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG dbcounter [-] [118814] Writing DB stats nova_cell1:SELECT=100 {{(pid=118814) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:11:28.888455 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-2b33f0ac-6109-4bb4-a398-72ae2099240b tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] 10.222.0.23 "GET /compute/v2.1/servers/96c829cb-4dde-467c-b50f-b2f666bdab0b" status: 200 len: 1522 microversion: 2.1 time: 0.202557 Oct 13 13:11:28.889523 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 110/204] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:11:28 2022] GET /compute/v2.1/servers/96c829cb-4dde-467c-b50f-b2f666bdab0b => generated 1522 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:11:29.920201 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-25d75f76-da2d-4527-a566-ba19d38d2b13 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Calling method '>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:11:29.921397 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-25d75f76-da2d-4527-a566-ba19d38d2b13 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] [instance: 96c829cb-4dde-467c-b50f-b2f666bdab0b] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:11:29.930822 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-25d75f76-da2d-4527-a566-ba19d38d2b13 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:11:29.932252 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-25d75f76-da2d-4527-a566-ba19d38d2b13 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:11:29.934288 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-25d75f76-da2d-4527-a566-ba19d38d2b13 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:11:29.935155 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-25d75f76-da2d-4527-a566-ba19d38d2b13 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:11:29.935773 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-25d75f76-da2d-4527-a566-ba19d38d2b13 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:11:29.936561 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-25d75f76-da2d-4527-a566-ba19d38d2b13 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:11:30.099354 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-25d75f76-da2d-4527-a566-ba19d38d2b13 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '454203f47b434cca952a1cef56de559f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7312d0ac9248f2bfbece5611913ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:11:30.108473 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-25d75f76-da2d-4527-a566-ba19d38d2b13 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] 10.222.0.23 "GET /compute/v2.1/servers/96c829cb-4dde-467c-b50f-b2f666bdab0b" status: 200 len: 1522 microversion: 2.1 time: 0.192121 Oct 13 13:11:30.109297 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 95/205] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:11:29 2022] GET /compute/v2.1/servers/96c829cb-4dde-467c-b50f-b2f666bdab0b => generated 1522 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 13:11:31.140417 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-bad129c9-823c-48c9-a8b9-29d2bc7b9414 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Calling method '>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:11:31.142210 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-bad129c9-823c-48c9-a8b9-29d2bc7b9414 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] [instance: 96c829cb-4dde-467c-b50f-b2f666bdab0b] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:11:31.149795 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-bad129c9-823c-48c9-a8b9-29d2bc7b9414 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:11:31.150893 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-bad129c9-823c-48c9-a8b9-29d2bc7b9414 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:11:31.151434 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-bad129c9-823c-48c9-a8b9-29d2bc7b9414 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:11:31.152417 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-bad129c9-823c-48c9-a8b9-29d2bc7b9414 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:11:31.153007 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-bad129c9-823c-48c9-a8b9-29d2bc7b9414 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:11:31.153501 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-bad129c9-823c-48c9-a8b9-29d2bc7b9414 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:11:31.312135 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-bad129c9-823c-48c9-a8b9-29d2bc7b9414 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '454203f47b434cca952a1cef56de559f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7312d0ac9248f2bfbece5611913ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:11:31.320570 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-bad129c9-823c-48c9-a8b9-29d2bc7b9414 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] 10.222.0.23 "GET /compute/v2.1/servers/96c829cb-4dde-467c-b50f-b2f666bdab0b" status: 200 len: 1522 microversion: 2.1 time: 0.185330 Oct 13 13:11:31.321151 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 111/206] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:11:31 2022] GET /compute/v2.1/servers/96c829cb-4dde-467c-b50f-b2f666bdab0b => generated 1522 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:11:32.343102 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-f9f7e216-789a-4f94-8ab4-c6af9a09cd4b tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Calling method '>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:11:32.344481 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-f9f7e216-789a-4f94-8ab4-c6af9a09cd4b tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] [instance: 96c829cb-4dde-467c-b50f-b2f666bdab0b] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:11:32.352696 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-f9f7e216-789a-4f94-8ab4-c6af9a09cd4b tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:11:32.353529 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-f9f7e216-789a-4f94-8ab4-c6af9a09cd4b tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:11:32.354457 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-f9f7e216-789a-4f94-8ab4-c6af9a09cd4b tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:11:32.355482 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-f9f7e216-789a-4f94-8ab4-c6af9a09cd4b tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:11:32.356123 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-f9f7e216-789a-4f94-8ab4-c6af9a09cd4b tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:11:32.356795 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-f9f7e216-789a-4f94-8ab4-c6af9a09cd4b tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:11:32.518451 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-f9f7e216-789a-4f94-8ab4-c6af9a09cd4b tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '454203f47b434cca952a1cef56de559f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7312d0ac9248f2bfbece5611913ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:11:32.527749 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-f9f7e216-789a-4f94-8ab4-c6af9a09cd4b tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] 10.222.0.23 "GET /compute/v2.1/servers/96c829cb-4dde-467c-b50f-b2f666bdab0b" status: 200 len: 1522 microversion: 2.1 time: 0.188424 Oct 13 13:11:32.528348 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 96/207] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:11:32 2022] GET /compute/v2.1/servers/96c829cb-4dde-467c-b50f-b2f666bdab0b => generated 1522 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:11:33.552337 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-8bcc9fc5-84f1-45bc-9ea9-bd3b87c9c88b tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Calling method '>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:11:33.553655 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-8bcc9fc5-84f1-45bc-9ea9-bd3b87c9c88b tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] [instance: 96c829cb-4dde-467c-b50f-b2f666bdab0b] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:11:33.559706 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-8bcc9fc5-84f1-45bc-9ea9-bd3b87c9c88b tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:11:33.560417 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-8bcc9fc5-84f1-45bc-9ea9-bd3b87c9c88b tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:11:33.561414 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-8bcc9fc5-84f1-45bc-9ea9-bd3b87c9c88b tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:11:33.562219 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-8bcc9fc5-84f1-45bc-9ea9-bd3b87c9c88b tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:11:33.562774 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-8bcc9fc5-84f1-45bc-9ea9-bd3b87c9c88b tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:11:33.563358 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-8bcc9fc5-84f1-45bc-9ea9-bd3b87c9c88b tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:11:33.707834 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-8bcc9fc5-84f1-45bc-9ea9-bd3b87c9c88b tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '454203f47b434cca952a1cef56de559f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7312d0ac9248f2bfbece5611913ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:11:33.716148 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-8bcc9fc5-84f1-45bc-9ea9-bd3b87c9c88b tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] 10.222.0.23 "GET /compute/v2.1/servers/96c829cb-4dde-467c-b50f-b2f666bdab0b" status: 200 len: 1502 microversion: 2.1 time: 0.167882 Oct 13 13:11:33.727934 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 112/208] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:11:33 2022] GET /compute/v2.1/servers/96c829cb-4dde-467c-b50f-b2f666bdab0b => generated 1502 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:11:33.739958 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-a968c815-55e0-448f-aa7b-a735c283a06e tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Calling method '>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:11:33.741811 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-a968c815-55e0-448f-aa7b-a735c283a06e tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] [instance: 0548a3eb-e119-482c-ac70-04fbc6f83bf7] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:11:33.748970 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-a968c815-55e0-448f-aa7b-a735c283a06e tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:11:33.749876 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-a968c815-55e0-448f-aa7b-a735c283a06e tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:11:33.750309 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-a968c815-55e0-448f-aa7b-a735c283a06e tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:11:33.750995 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-a968c815-55e0-448f-aa7b-a735c283a06e tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:11:33.751467 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-a968c815-55e0-448f-aa7b-a735c283a06e tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:11:33.751887 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-a968c815-55e0-448f-aa7b-a735c283a06e tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:11:33.917128 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-a968c815-55e0-448f-aa7b-a735c283a06e tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '454203f47b434cca952a1cef56de559f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7312d0ac9248f2bfbece5611913ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:11:33.934868 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-a968c815-55e0-448f-aa7b-a735c283a06e tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] 10.222.0.23 "GET /compute/v2.1/servers/0548a3eb-e119-482c-ac70-04fbc6f83bf7" status: 200 len: 1516 microversion: 2.1 time: 0.198805 Oct 13 13:11:33.935918 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 97/209] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:11:33 2022] GET /compute/v2.1/servers/0548a3eb-e119-482c-ac70-04fbc6f83bf7 => generated 1516 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:11:35.378972 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-2ee3eaf1-3e9e-4644-bcdb-d339ed348062 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 13:11:35.381303 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-2ee3eaf1-3e9e-4644-bcdb-d339ed348062 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] [instance: 0548a3eb-e119-482c-ac70-04fbc6f83bf7] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:11:35.390759 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-2ee3eaf1-3e9e-4644-bcdb-d339ed348062 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:11:35.391536 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-2ee3eaf1-3e9e-4644-bcdb-d339ed348062 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:11:35.392170 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-2ee3eaf1-3e9e-4644-bcdb-d339ed348062 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:11:35.393007 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-2ee3eaf1-3e9e-4644-bcdb-d339ed348062 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:11:35.393619 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-2ee3eaf1-3e9e-4644-bcdb-d339ed348062 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:11:35.394121 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-2ee3eaf1-3e9e-4644-bcdb-d339ed348062 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:11:35.434801 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.objects.instance [None req-2ee3eaf1-3e9e-4644-bcdb-d339ed348062 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lazy-loading 'flavor' on Instance uuid 0548a3eb-e119-482c-ac70-04fbc6f83bf7 {{(pid=118814) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 13 13:11:35.564441 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-2ee3eaf1-3e9e-4644-bcdb-d339ed348062 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] 10.222.0.23 "POST /compute/v2.1/servers/0548a3eb-e119-482c-ac70-04fbc6f83bf7/action" status: 200 len: 32 microversion: 2.1 time: 0.189148 Oct 13 13:11:35.565210 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 113/210] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Oct 13 13:11:35 2022] POST /compute/v2.1/servers/0548a3eb-e119-482c-ac70-04fbc6f83bf7/action => generated 32 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 13 13:11:35.577484 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-2dd3b2bd-c589-4999-ac2a-0eec8987b73b tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Calling method '>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:11:35.583305 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-2dd3b2bd-c589-4999-ac2a-0eec8987b73b tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] [instance: 0548a3eb-e119-482c-ac70-04fbc6f83bf7] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:11:35.602116 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-2dd3b2bd-c589-4999-ac2a-0eec8987b73b tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:11:35.602989 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-2dd3b2bd-c589-4999-ac2a-0eec8987b73b tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:11:35.603670 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-2dd3b2bd-c589-4999-ac2a-0eec8987b73b tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:11:35.604640 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-2dd3b2bd-c589-4999-ac2a-0eec8987b73b tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:11:35.605241 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-2dd3b2bd-c589-4999-ac2a-0eec8987b73b tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:11:35.605985 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-2dd3b2bd-c589-4999-ac2a-0eec8987b73b tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:11:35.770630 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-2dd3b2bd-c589-4999-ac2a-0eec8987b73b tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '454203f47b434cca952a1cef56de559f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7312d0ac9248f2bfbece5611913ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:11:35.780612 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-2dd3b2bd-c589-4999-ac2a-0eec8987b73b tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] 10.222.0.23 "GET /compute/v2.1/servers/0548a3eb-e119-482c-ac70-04fbc6f83bf7" status: 200 len: 1522 microversion: 2.1 time: 0.206959 Oct 13 13:11:35.781800 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 98/211] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:11:35 2022] GET /compute/v2.1/servers/0548a3eb-e119-482c-ac70-04fbc6f83bf7 => generated 1522 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:11:36.531508 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-2804aebc-5c48-4fb7-93b9-83599b53acf0 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1398e7bd-8e79-4473-9e37-9fe50c2f6c6b", "device": "/dev/sdb"}} {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 13:11:36.541113 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-2804aebc-5c48-4fb7-93b9-83599b53acf0 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] [instance: 6a4a7328-d884-4015-aadc-aa5062a77724] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:11:36.550276 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-2804aebc-5c48-4fb7-93b9-83599b53acf0 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:11:36.551083 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-2804aebc-5c48-4fb7-93b9-83599b53acf0 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:11:36.551797 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-2804aebc-5c48-4fb7-93b9-83599b53acf0 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:11:36.552585 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-2804aebc-5c48-4fb7-93b9-83599b53acf0 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:11:36.553031 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-2804aebc-5c48-4fb7-93b9-83599b53acf0 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:11:36.553456 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-2804aebc-5c48-4fb7-93b9-83599b53acf0 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:11:36.824455 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-4b548b98-39a4-42ec-b66f-377d6128303e tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Calling method '>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:11:36.833427 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-4b548b98-39a4-42ec-b66f-377d6128303e tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] [instance: 0548a3eb-e119-482c-ac70-04fbc6f83bf7] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:11:36.846711 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-4b548b98-39a4-42ec-b66f-377d6128303e tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:11:36.850359 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-4b548b98-39a4-42ec-b66f-377d6128303e tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:11:36.856364 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-4b548b98-39a4-42ec-b66f-377d6128303e tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:11:36.857294 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-4b548b98-39a4-42ec-b66f-377d6128303e tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:11:36.862439 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-4b548b98-39a4-42ec-b66f-377d6128303e tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:11:36.862974 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-4b548b98-39a4-42ec-b66f-377d6128303e tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:11:36.992768 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-2804aebc-5c48-4fb7-93b9-83599b53acf0 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] 10.222.0.23 "POST /compute/v2.1/servers/6a4a7328-d884-4015-aadc-aa5062a77724/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.466606 Oct 13 13:11:36.996715 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 114/212] 10.222.0.23 () {60 vars in 1323 bytes} [Thu Oct 13 13:11:36 2022] POST /compute/v2.1/servers/6a4a7328-d884-4015-aadc-aa5062a77724/os-volume_attachments => generated 194 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 13:11:37.103742 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-4b548b98-39a4-42ec-b66f-377d6128303e tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '454203f47b434cca952a1cef56de559f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7312d0ac9248f2bfbece5611913ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:11:37.112254 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-4b548b98-39a4-42ec-b66f-377d6128303e tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] 10.222.0.23 "GET /compute/v2.1/servers/0548a3eb-e119-482c-ac70-04fbc6f83bf7" status: 200 len: 1522 microversion: 2.1 time: 0.310315 Oct 13 13:11:37.112828 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 99/213] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:11:36 2022] GET /compute/v2.1/servers/0548a3eb-e119-482c-ac70-04fbc6f83bf7 => generated 1522 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:11:38.136565 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-b709cff0-eb27-4399-a6a1-29cb607ed1f7 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Calling method '>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:11:38.137260 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-b709cff0-eb27-4399-a6a1-29cb607ed1f7 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] [instance: 0548a3eb-e119-482c-ac70-04fbc6f83bf7] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:11:38.143615 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-b709cff0-eb27-4399-a6a1-29cb607ed1f7 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:11:38.144100 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-b709cff0-eb27-4399-a6a1-29cb607ed1f7 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:11:38.144545 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-b709cff0-eb27-4399-a6a1-29cb607ed1f7 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:11:38.145237 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-b709cff0-eb27-4399-a6a1-29cb607ed1f7 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:11:38.145689 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-b709cff0-eb27-4399-a6a1-29cb607ed1f7 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:11:38.146113 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-b709cff0-eb27-4399-a6a1-29cb607ed1f7 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:11:38.279160 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-b709cff0-eb27-4399-a6a1-29cb607ed1f7 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '454203f47b434cca952a1cef56de559f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7312d0ac9248f2bfbece5611913ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:11:38.289029 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-b709cff0-eb27-4399-a6a1-29cb607ed1f7 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] 10.222.0.23 "GET /compute/v2.1/servers/0548a3eb-e119-482c-ac70-04fbc6f83bf7" status: 200 len: 1522 microversion: 2.1 time: 0.156867 Oct 13 13:11:38.289594 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 115/214] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:11:38 2022] GET /compute/v2.1/servers/0548a3eb-e119-482c-ac70-04fbc6f83bf7 => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:11:39.312910 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-045dd9d1-2662-41a5-8e04-a58e1cc8c1ec tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Calling method '>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:11:39.313647 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-045dd9d1-2662-41a5-8e04-a58e1cc8c1ec tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] [instance: 0548a3eb-e119-482c-ac70-04fbc6f83bf7] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:11:39.319739 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-045dd9d1-2662-41a5-8e04-a58e1cc8c1ec tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:11:39.320235 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-045dd9d1-2662-41a5-8e04-a58e1cc8c1ec tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:11:39.320832 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-045dd9d1-2662-41a5-8e04-a58e1cc8c1ec tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:11:39.321636 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-045dd9d1-2662-41a5-8e04-a58e1cc8c1ec tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:11:39.322059 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-045dd9d1-2662-41a5-8e04-a58e1cc8c1ec tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:11:39.322516 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-045dd9d1-2662-41a5-8e04-a58e1cc8c1ec tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:11:39.459760 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-045dd9d1-2662-41a5-8e04-a58e1cc8c1ec tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '454203f47b434cca952a1cef56de559f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7312d0ac9248f2bfbece5611913ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:11:39.467403 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-045dd9d1-2662-41a5-8e04-a58e1cc8c1ec tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] 10.222.0.23 "GET /compute/v2.1/servers/0548a3eb-e119-482c-ac70-04fbc6f83bf7" status: 200 len: 1522 microversion: 2.1 time: 0.158236 Oct 13 13:11:39.467964 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 100/215] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:11:39 2022] GET /compute/v2.1/servers/0548a3eb-e119-482c-ac70-04fbc6f83bf7 => generated 1522 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:11:40.492669 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-ed0a9a09-dd45-4c8d-9e7d-def6bcf99409 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Calling method '>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:11:40.493246 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-ed0a9a09-dd45-4c8d-9e7d-def6bcf99409 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] [instance: 0548a3eb-e119-482c-ac70-04fbc6f83bf7] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:11:40.499574 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-ed0a9a09-dd45-4c8d-9e7d-def6bcf99409 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:11:40.500057 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-ed0a9a09-dd45-4c8d-9e7d-def6bcf99409 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:11:40.500491 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-ed0a9a09-dd45-4c8d-9e7d-def6bcf99409 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:11:40.501191 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-ed0a9a09-dd45-4c8d-9e7d-def6bcf99409 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:11:40.501627 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-ed0a9a09-dd45-4c8d-9e7d-def6bcf99409 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:11:40.502049 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-ed0a9a09-dd45-4c8d-9e7d-def6bcf99409 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:11:40.635991 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-ed0a9a09-dd45-4c8d-9e7d-def6bcf99409 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '454203f47b434cca952a1cef56de559f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7312d0ac9248f2bfbece5611913ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:11:40.644173 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-ed0a9a09-dd45-4c8d-9e7d-def6bcf99409 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] 10.222.0.23 "GET /compute/v2.1/servers/0548a3eb-e119-482c-ac70-04fbc6f83bf7" status: 200 len: 1522 microversion: 2.1 time: 0.156131 Oct 13 13:11:40.644750 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 116/216] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:11:40 2022] GET /compute/v2.1/servers/0548a3eb-e119-482c-ac70-04fbc6f83bf7 => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 13:11:41.666568 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-9fce3d45-a370-4aa1-9bc2-aa6f46f49fd3 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Calling method '>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:11:41.667201 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-9fce3d45-a370-4aa1-9bc2-aa6f46f49fd3 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] [instance: 0548a3eb-e119-482c-ac70-04fbc6f83bf7] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:11:41.673572 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-9fce3d45-a370-4aa1-9bc2-aa6f46f49fd3 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:11:41.674239 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-9fce3d45-a370-4aa1-9bc2-aa6f46f49fd3 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:11:41.674671 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-9fce3d45-a370-4aa1-9bc2-aa6f46f49fd3 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:11:41.675382 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-9fce3d45-a370-4aa1-9bc2-aa6f46f49fd3 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:11:41.676054 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-9fce3d45-a370-4aa1-9bc2-aa6f46f49fd3 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:11:41.676739 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-9fce3d45-a370-4aa1-9bc2-aa6f46f49fd3 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:11:41.681467 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG dbcounter [-] [118815] Writing DB stats nova_cell1:SELECT=89 {{(pid=118815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:11:41.876938 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-9fce3d45-a370-4aa1-9bc2-aa6f46f49fd3 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '454203f47b434cca952a1cef56de559f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7312d0ac9248f2bfbece5611913ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:11:41.879421 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-9871b95d-dbee-4a2f-9197-345f80a9f395 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Calling method '>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:11:41.879915 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-9871b95d-dbee-4a2f-9197-345f80a9f395 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] [instance: e125ab44-9111-4260-909d-95d57b7861a7] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:11:41.887226 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-9871b95d-dbee-4a2f-9197-345f80a9f395 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:11:41.888261 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-9871b95d-dbee-4a2f-9197-345f80a9f395 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:11:41.888261 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-9871b95d-dbee-4a2f-9197-345f80a9f395 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:11:41.888970 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-9871b95d-dbee-4a2f-9197-345f80a9f395 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:11:41.889426 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-9871b95d-dbee-4a2f-9197-345f80a9f395 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:11:41.889850 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-9871b95d-dbee-4a2f-9197-345f80a9f395 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:11:41.900330 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-9fce3d45-a370-4aa1-9bc2-aa6f46f49fd3 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] 10.222.0.23 "GET /compute/v2.1/servers/0548a3eb-e119-482c-ac70-04fbc6f83bf7" status: 200 len: 1522 microversion: 2.1 time: 0.237475 Oct 13 13:11:41.909381 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 101/217] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:11:41 2022] GET /compute/v2.1/servers/0548a3eb-e119-482c-ac70-04fbc6f83bf7 => generated 1522 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:11:41.919651 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-9871b95d-dbee-4a2f-9197-345f80a9f395 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] 10.222.0.23 "GET /compute/v2.1/servers/e125ab44-9111-4260-909d-95d57b7861a7/ips" status: 200 len: 146 microversion: 2.1 time: 0.044749 Oct 13 13:11:41.920224 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 117/218] 10.222.0.23 () {58 vars in 1248 bytes} [Thu Oct 13 13:11:41 2022] GET /compute/v2.1/servers/e125ab44-9111-4260-909d-95d57b7861a7/ips => generated 146 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 13 13:11:42.928847 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-d7afadee-c613-48a9-af8f-10c03dee0840 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Calling method '>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:11:42.929458 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-d7afadee-c613-48a9-af8f-10c03dee0840 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] [instance: 0548a3eb-e119-482c-ac70-04fbc6f83bf7] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:11:42.936244 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-d7afadee-c613-48a9-af8f-10c03dee0840 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:11:42.936566 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-d7afadee-c613-48a9-af8f-10c03dee0840 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:11:42.937034 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-d7afadee-c613-48a9-af8f-10c03dee0840 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:11:42.937687 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-d7afadee-c613-48a9-af8f-10c03dee0840 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:11:42.938133 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-d7afadee-c613-48a9-af8f-10c03dee0840 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:11:42.938562 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-d7afadee-c613-48a9-af8f-10c03dee0840 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:11:43.078954 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-d7afadee-c613-48a9-af8f-10c03dee0840 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '454203f47b434cca952a1cef56de559f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7312d0ac9248f2bfbece5611913ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:11:43.087735 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-d7afadee-c613-48a9-af8f-10c03dee0840 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] 10.222.0.23 "GET /compute/v2.1/servers/0548a3eb-e119-482c-ac70-04fbc6f83bf7" status: 200 len: 1522 microversion: 2.1 time: 0.163645 Oct 13 13:11:43.088608 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 102/219] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:11:42 2022] GET /compute/v2.1/servers/0548a3eb-e119-482c-ac70-04fbc6f83bf7 => generated 1522 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:11:44.110761 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-6522dada-9e06-4fef-aceb-f550567f357e tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Calling method '>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:11:44.111899 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-6522dada-9e06-4fef-aceb-f550567f357e tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] [instance: 0548a3eb-e119-482c-ac70-04fbc6f83bf7] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:11:44.118692 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-6522dada-9e06-4fef-aceb-f550567f357e tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:11:44.119199 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-6522dada-9e06-4fef-aceb-f550567f357e tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:11:44.119645 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-6522dada-9e06-4fef-aceb-f550567f357e tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:11:44.120479 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-6522dada-9e06-4fef-aceb-f550567f357e tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:11:44.121100 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-6522dada-9e06-4fef-aceb-f550567f357e tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:11:44.121531 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-6522dada-9e06-4fef-aceb-f550567f357e tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:11:44.290767 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-6522dada-9e06-4fef-aceb-f550567f357e tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '454203f47b434cca952a1cef56de559f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7312d0ac9248f2bfbece5611913ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:11:44.298653 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-6522dada-9e06-4fef-aceb-f550567f357e tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] 10.222.0.23 "GET /compute/v2.1/servers/0548a3eb-e119-482c-ac70-04fbc6f83bf7" status: 200 len: 1522 microversion: 2.1 time: 0.192216 Oct 13 13:11:44.299253 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 118/220] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:11:44 2022] GET /compute/v2.1/servers/0548a3eb-e119-482c-ac70-04fbc6f83bf7 => generated 1522 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:11:44.332579 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-7e10fa34-2420-4c10-824b-d0ed75b8a6b9 tempest-VolumesNegativeTest-1101616844 tempest-VolumesNegativeTest-1101616844-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1389531371", "imageRef": "e2cdd20b-2540-48bc-a05c-d6a2e7e9a66e", "flavorRef": "452"}} {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 13:11:44.389852 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.network.neutron [None req-7e10fa34-2420-4c10-824b-d0ed75b8a6b9 tempest-VolumesNegativeTest-1101616844 tempest-VolumesNegativeTest-1101616844-project] validate_networks() for None {{(pid=118815) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 13 13:11:44.714458 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-6ed094ef-a6b4-4b36-9b6a-3aeefbafd7ad tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Calling method '>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:11:44.715184 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-6ed094ef-a6b4-4b36-9b6a-3aeefbafd7ad tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] [instance: 26bd475b-3495-4669-9985-d4a7dedb4bbf] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:11:44.723962 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-6ed094ef-a6b4-4b36-9b6a-3aeefbafd7ad tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:11:44.724456 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-6ed094ef-a6b4-4b36-9b6a-3aeefbafd7ad tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:11:44.724902 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-6ed094ef-a6b4-4b36-9b6a-3aeefbafd7ad tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:11:44.725604 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-6ed094ef-a6b4-4b36-9b6a-3aeefbafd7ad tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:11:44.726258 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-6ed094ef-a6b4-4b36-9b6a-3aeefbafd7ad tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:11:44.726688 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-6ed094ef-a6b4-4b36-9b6a-3aeefbafd7ad tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:11:44.768955 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-6ed094ef-a6b4-4b36-9b6a-3aeefbafd7ad tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] 10.222.0.23 "GET /compute/v2.1/servers/26bd475b-3495-4669-9985-d4a7dedb4bbf/ips" status: 200 len: 152 microversion: 2.20 time: 0.060559 Oct 13 13:11:44.776276 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 119/221] 10.222.0.23 () {60 vars in 1289 bytes} [Thu Oct 13 13:11:44 2022] GET /compute/v2.1/servers/26bd475b-3495-4669-9985-d4a7dedb4bbf/ips => generated 152 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 13 13:11:44.790646 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.virt.hardware [None req-7e10fa34-2420-4c10-824b-d0ed75b8a6b9 tempest-VolumesNegativeTest-1101616844 tempest-VolumesNegativeTest-1101616844-project] Flavor limits 0:0:0 {{(pid=118815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 13 13:11:44.791438 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.virt.hardware [None req-7e10fa34-2420-4c10-824b-d0ed75b8a6b9 tempest-VolumesNegativeTest-1101616844 tempest-VolumesNegativeTest-1101616844-project] Image limits 0:0:0 {{(pid=118815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 13 13:11:44.792040 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.virt.hardware [None req-7e10fa34-2420-4c10-824b-d0ed75b8a6b9 tempest-VolumesNegativeTest-1101616844 tempest-VolumesNegativeTest-1101616844-project] Flavor pref 0:0:0 {{(pid=118815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 13 13:11:44.792537 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.virt.hardware [None req-7e10fa34-2420-4c10-824b-d0ed75b8a6b9 tempest-VolumesNegativeTest-1101616844 tempest-VolumesNegativeTest-1101616844-project] Image pref 0:0:0 {{(pid=118815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 13 13:11:44.793053 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.virt.hardware [None req-7e10fa34-2420-4c10-824b-d0ed75b8a6b9 tempest-VolumesNegativeTest-1101616844 tempest-VolumesNegativeTest-1101616844-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 13 13:11:44.805626 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-7e10fa34-2420-4c10-824b-d0ed75b8a6b9 tempest-VolumesNegativeTest-1101616844 tempest-VolumesNegativeTest-1101616844-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:11:44.806215 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-7e10fa34-2420-4c10-824b-d0ed75b8a6b9 tempest-VolumesNegativeTest-1101616844 tempest-VolumesNegativeTest-1101616844-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:11:44.806748 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-7e10fa34-2420-4c10-824b-d0ed75b8a6b9 tempest-VolumesNegativeTest-1101616844 tempest-VolumesNegativeTest-1101616844-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:11:44.807644 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-7e10fa34-2420-4c10-824b-d0ed75b8a6b9 tempest-VolumesNegativeTest-1101616844 tempest-VolumesNegativeTest-1101616844-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:11:44.808198 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-7e10fa34-2420-4c10-824b-d0ed75b8a6b9 tempest-VolumesNegativeTest-1101616844 tempest-VolumesNegativeTest-1101616844-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:11:44.808725 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-7e10fa34-2420-4c10-824b-d0ed75b8a6b9 tempest-VolumesNegativeTest-1101616844 tempest-VolumesNegativeTest-1101616844-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:11:44.829362 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.quota [None req-7e10fa34-2420-4c10-824b-d0ed75b8a6b9 tempest-VolumesNegativeTest-1101616844 tempest-VolumesNegativeTest-1101616844-project] Getting quotas for project e74136856dcf42c48689e6976f16caad. Resources: {'instances', 'cores', 'ram'} {{(pid=118815) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 13 13:11:44.833875 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.quota [None req-7e10fa34-2420-4c10-824b-d0ed75b8a6b9 tempest-VolumesNegativeTest-1101616844 tempest-VolumesNegativeTest-1101616844-project] Getting quotas for user fd5dc5471e5246f4878f1d91d59b68f2 and project e74136856dcf42c48689e6976f16caad. Resources: {'instances', 'cores', 'ram'} {{(pid=118815) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 13 13:11:44.846507 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-7e10fa34-2420-4c10-824b-d0ed75b8a6b9 tempest-VolumesNegativeTest-1101616844 tempest-VolumesNegativeTest-1101616844-project] Going to run 1 instances... {{(pid=118815) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 13 13:11:44.850102 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-7e10fa34-2420-4c10-824b-d0ed75b8a6b9 tempest-VolumesNegativeTest-1101616844 tempest-VolumesNegativeTest-1101616844-project] [instance: 452465c5-d313-4698-a666-9e814920b8fd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e2cdd20b-2540-48bc-a05c-d6a2e7e9a66e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118815) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 13 13:11:44.900880 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-7e10fa34-2420-4c10-824b-d0ed75b8a6b9 tempest-VolumesNegativeTest-1101616844 tempest-VolumesNegativeTest-1101616844-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.572121 Oct 13 13:11:44.901748 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 103/222] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Oct 13 13:11:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 574 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 13 13:11:44.913844 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-c0a93277-e123-403e-a2ce-2d19cefa443e tempest-VolumesNegativeTest-1101616844 tempest-VolumesNegativeTest-1101616844-project] Calling method '>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:11:44.914857 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-c0a93277-e123-403e-a2ce-2d19cefa443e tempest-VolumesNegativeTest-1101616844 tempest-VolumesNegativeTest-1101616844-project] [instance: 452465c5-d313-4698-a666-9e814920b8fd] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:11:45.022058 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-c0a93277-e123-403e-a2ce-2d19cefa443e tempest-VolumesNegativeTest-1101616844 tempest-VolumesNegativeTest-1101616844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd5dc5471e5246f4878f1d91d59b68f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e74136856dcf42c48689e6976f16caad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:11:45.030905 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-c0a93277-e123-403e-a2ce-2d19cefa443e tempest-VolumesNegativeTest-1101616844 tempest-VolumesNegativeTest-1101616844-project] 10.222.0.23 "GET /compute/v2.1/servers/452465c5-d313-4698-a666-9e814920b8fd" status: 200 len: 1215 microversion: 2.1 time: 0.121620 Oct 13 13:11:45.032194 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 120/223] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:11:44 2022] GET /compute/v2.1/servers/452465c5-d313-4698-a666-9e814920b8fd => generated 1215 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:11:45.050052 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-2b5b6863-f65f-4625-bba8-e70a81a217fc tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "56964fc7-faa8-4a52-bb6c-a0c3a8f69965"}} {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 13:11:45.055229 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-2b5b6863-f65f-4625-bba8-e70a81a217fc tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] [instance: e125ab44-9111-4260-909d-95d57b7861a7] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:11:45.063291 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-2b5b6863-f65f-4625-bba8-e70a81a217fc tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:11:45.063978 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-2b5b6863-f65f-4625-bba8-e70a81a217fc tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:11:45.064707 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-2b5b6863-f65f-4625-bba8-e70a81a217fc tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:11:45.065773 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-2b5b6863-f65f-4625-bba8-e70a81a217fc tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:11:45.066529 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-2b5b6863-f65f-4625-bba8-e70a81a217fc tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:11:45.067262 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-2b5b6863-f65f-4625-bba8-e70a81a217fc tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:11:45.323776 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-b2c6afe6-f174-4635-9482-739ef5bb2fa9 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Calling method '>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:11:45.325257 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-b2c6afe6-f174-4635-9482-739ef5bb2fa9 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] [instance: 0548a3eb-e119-482c-ac70-04fbc6f83bf7] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:11:45.333266 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-b2c6afe6-f174-4635-9482-739ef5bb2fa9 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:11:45.334103 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-b2c6afe6-f174-4635-9482-739ef5bb2fa9 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:11:45.334731 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-b2c6afe6-f174-4635-9482-739ef5bb2fa9 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:11:45.336766 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-b2c6afe6-f174-4635-9482-739ef5bb2fa9 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:11:45.337468 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-b2c6afe6-f174-4635-9482-739ef5bb2fa9 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:11:45.338083 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-b2c6afe6-f174-4635-9482-739ef5bb2fa9 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:11:45.534941 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-b2c6afe6-f174-4635-9482-739ef5bb2fa9 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '454203f47b434cca952a1cef56de559f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7312d0ac9248f2bfbece5611913ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:11:45.551688 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-b2c6afe6-f174-4635-9482-739ef5bb2fa9 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] 10.222.0.23 "GET /compute/v2.1/servers/0548a3eb-e119-482c-ac70-04fbc6f83bf7" status: 200 len: 1522 microversion: 2.1 time: 0.231065 Oct 13 13:11:45.553699 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 121/224] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:11:45 2022] GET /compute/v2.1/servers/0548a3eb-e119-482c-ac70-04fbc6f83bf7 => generated 1522 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:11:46.053884 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-a348b309-de42-42d0-b179-c0d8c22ed1c1 tempest-VolumesNegativeTest-1101616844 tempest-VolumesNegativeTest-1101616844-project] Calling method '>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:11:46.054493 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-a348b309-de42-42d0-b179-c0d8c22ed1c1 tempest-VolumesNegativeTest-1101616844 tempest-VolumesNegativeTest-1101616844-project] [instance: 452465c5-d313-4698-a666-9e814920b8fd] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:11:46.060514 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-a348b309-de42-42d0-b179-c0d8c22ed1c1 tempest-VolumesNegativeTest-1101616844 tempest-VolumesNegativeTest-1101616844-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:11:46.061001 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-a348b309-de42-42d0-b179-c0d8c22ed1c1 tempest-VolumesNegativeTest-1101616844 tempest-VolumesNegativeTest-1101616844-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:11:46.061445 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-a348b309-de42-42d0-b179-c0d8c22ed1c1 tempest-VolumesNegativeTest-1101616844 tempest-VolumesNegativeTest-1101616844-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:11:46.062133 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-a348b309-de42-42d0-b179-c0d8c22ed1c1 tempest-VolumesNegativeTest-1101616844 tempest-VolumesNegativeTest-1101616844-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:11:46.062583 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-a348b309-de42-42d0-b179-c0d8c22ed1c1 tempest-VolumesNegativeTest-1101616844 tempest-VolumesNegativeTest-1101616844-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:11:46.063004 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-a348b309-de42-42d0-b179-c0d8c22ed1c1 tempest-VolumesNegativeTest-1101616844 tempest-VolumesNegativeTest-1101616844-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:11:46.133695 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-a348b309-de42-42d0-b179-c0d8c22ed1c1 tempest-VolumesNegativeTest-1101616844 tempest-VolumesNegativeTest-1101616844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd5dc5471e5246f4878f1d91d59b68f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e74136856dcf42c48689e6976f16caad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:11:46.141643 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-a348b309-de42-42d0-b179-c0d8c22ed1c1 tempest-VolumesNegativeTest-1101616844 tempest-VolumesNegativeTest-1101616844-project] 10.222.0.23 "GET /compute/v2.1/servers/452465c5-d313-4698-a666-9e814920b8fd" status: 200 len: 1219 microversion: 2.1 time: 0.091820 Oct 13 13:11:46.142206 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 122/225] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:11:46 2022] GET /compute/v2.1/servers/452465c5-d313-4698-a666-9e814920b8fd => generated 1219 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 13:11:46.578804 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-d85de62b-794d-4011-973c-73533d759067 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Calling method '>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:11:46.579545 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-d85de62b-794d-4011-973c-73533d759067 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] [instance: 0548a3eb-e119-482c-ac70-04fbc6f83bf7] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:11:46.586393 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-d85de62b-794d-4011-973c-73533d759067 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:11:46.586880 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-d85de62b-794d-4011-973c-73533d759067 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:11:46.587341 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-d85de62b-794d-4011-973c-73533d759067 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:11:46.588026 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-d85de62b-794d-4011-973c-73533d759067 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:11:46.588479 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-d85de62b-794d-4011-973c-73533d759067 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:11:46.588902 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-d85de62b-794d-4011-973c-73533d759067 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:11:46.727037 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-d85de62b-794d-4011-973c-73533d759067 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '454203f47b434cca952a1cef56de559f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7312d0ac9248f2bfbece5611913ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:11:46.735783 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-d85de62b-794d-4011-973c-73533d759067 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] 10.222.0.23 "GET /compute/v2.1/servers/0548a3eb-e119-482c-ac70-04fbc6f83bf7" status: 200 len: 1522 microversion: 2.1 time: 0.160381 Oct 13 13:11:46.736489 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 123/226] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:11:46 2022] GET /compute/v2.1/servers/0548a3eb-e119-482c-ac70-04fbc6f83bf7 => generated 1522 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 13:11:47.165554 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-a4b93aa7-d606-44b7-a84e-1d01471fdc3f tempest-VolumesNegativeTest-1101616844 tempest-VolumesNegativeTest-1101616844-project] Calling method '>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:11:47.166143 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-a4b93aa7-d606-44b7-a84e-1d01471fdc3f tempest-VolumesNegativeTest-1101616844 tempest-VolumesNegativeTest-1101616844-project] [instance: 452465c5-d313-4698-a666-9e814920b8fd] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:11:47.172259 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-a4b93aa7-d606-44b7-a84e-1d01471fdc3f tempest-VolumesNegativeTest-1101616844 tempest-VolumesNegativeTest-1101616844-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:11:47.172767 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-a4b93aa7-d606-44b7-a84e-1d01471fdc3f tempest-VolumesNegativeTest-1101616844 tempest-VolumesNegativeTest-1101616844-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:11:47.173204 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-a4b93aa7-d606-44b7-a84e-1d01471fdc3f tempest-VolumesNegativeTest-1101616844 tempest-VolumesNegativeTest-1101616844-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:11:47.173891 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-a4b93aa7-d606-44b7-a84e-1d01471fdc3f tempest-VolumesNegativeTest-1101616844 tempest-VolumesNegativeTest-1101616844-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:11:47.174530 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-a4b93aa7-d606-44b7-a84e-1d01471fdc3f tempest-VolumesNegativeTest-1101616844 tempest-VolumesNegativeTest-1101616844-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:11:47.174973 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-a4b93aa7-d606-44b7-a84e-1d01471fdc3f tempest-VolumesNegativeTest-1101616844 tempest-VolumesNegativeTest-1101616844-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:11:47.238239 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-a4b93aa7-d606-44b7-a84e-1d01471fdc3f tempest-VolumesNegativeTest-1101616844 tempest-VolumesNegativeTest-1101616844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd5dc5471e5246f4878f1d91d59b68f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e74136856dcf42c48689e6976f16caad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:11:47.246672 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-a4b93aa7-d606-44b7-a84e-1d01471fdc3f tempest-VolumesNegativeTest-1101616844 tempest-VolumesNegativeTest-1101616844-project] 10.222.0.23 "GET /compute/v2.1/servers/452465c5-d313-4698-a666-9e814920b8fd" status: 200 len: 1219 microversion: 2.1 time: 0.085778 Oct 13 13:11:47.247281 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 124/227] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:11:47 2022] GET /compute/v2.1/servers/452465c5-d313-4698-a666-9e814920b8fd => generated 1219 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 13:11:47.761363 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-c83b7568-2c4a-49af-81b1-9e2ba3c8723a tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Calling method '>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:11:47.762020 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-c83b7568-2c4a-49af-81b1-9e2ba3c8723a tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] [instance: 0548a3eb-e119-482c-ac70-04fbc6f83bf7] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:11:47.773712 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-c83b7568-2c4a-49af-81b1-9e2ba3c8723a tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:11:47.774194 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-c83b7568-2c4a-49af-81b1-9e2ba3c8723a tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:11:47.774627 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-c83b7568-2c4a-49af-81b1-9e2ba3c8723a tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:11:47.775347 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-c83b7568-2c4a-49af-81b1-9e2ba3c8723a tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:11:47.776090 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-c83b7568-2c4a-49af-81b1-9e2ba3c8723a tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:11:47.776656 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-c83b7568-2c4a-49af-81b1-9e2ba3c8723a tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:11:47.950657 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-2b5b6863-f65f-4625-bba8-e70a81a217fc tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] 10.222.0.23 "POST /compute/v2.1/servers/e125ab44-9111-4260-909d-95d57b7861a7/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.905607 Oct 13 13:11:47.952445 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 104/228] 10.222.0.23 () {60 vars in 1323 bytes} [Thu Oct 13 13:11:45 2022] POST /compute/v2.1/servers/e125ab44-9111-4260-909d-95d57b7861a7/os-volume_attachments => generated 194 bytes in 2908 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 13:11:48.050698 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-c83b7568-2c4a-49af-81b1-9e2ba3c8723a tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '454203f47b434cca952a1cef56de559f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7312d0ac9248f2bfbece5611913ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:11:48.055810 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG dbcounter [-] [118814] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=118814) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:11:48.062829 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-c83b7568-2c4a-49af-81b1-9e2ba3c8723a tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] 10.222.0.23 "GET /compute/v2.1/servers/0548a3eb-e119-482c-ac70-04fbc6f83bf7" status: 200 len: 1522 microversion: 2.1 time: 0.305434 Oct 13 13:11:48.063448 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 125/229] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:11:47 2022] GET /compute/v2.1/servers/0548a3eb-e119-482c-ac70-04fbc6f83bf7 => generated 1522 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 13:11:48.270919 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-02a91ffb-6820-48c0-9f2a-d559b7ebac40 tempest-VolumesNegativeTest-1101616844 tempest-VolumesNegativeTest-1101616844-project] Calling method '>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:11:48.272024 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-02a91ffb-6820-48c0-9f2a-d559b7ebac40 tempest-VolumesNegativeTest-1101616844 tempest-VolumesNegativeTest-1101616844-project] [instance: 452465c5-d313-4698-a666-9e814920b8fd] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:11:48.289402 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-02a91ffb-6820-48c0-9f2a-d559b7ebac40 tempest-VolumesNegativeTest-1101616844 tempest-VolumesNegativeTest-1101616844-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:11:48.290210 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-02a91ffb-6820-48c0-9f2a-d559b7ebac40 tempest-VolumesNegativeTest-1101616844 tempest-VolumesNegativeTest-1101616844-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:11:48.290818 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-02a91ffb-6820-48c0-9f2a-d559b7ebac40 tempest-VolumesNegativeTest-1101616844 tempest-VolumesNegativeTest-1101616844-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:11:48.291731 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-02a91ffb-6820-48c0-9f2a-d559b7ebac40 tempest-VolumesNegativeTest-1101616844 tempest-VolumesNegativeTest-1101616844-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:11:48.292349 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-02a91ffb-6820-48c0-9f2a-d559b7ebac40 tempest-VolumesNegativeTest-1101616844 tempest-VolumesNegativeTest-1101616844-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:11:48.292927 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-02a91ffb-6820-48c0-9f2a-d559b7ebac40 tempest-VolumesNegativeTest-1101616844 tempest-VolumesNegativeTest-1101616844-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:11:48.371708 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-02a91ffb-6820-48c0-9f2a-d559b7ebac40 tempest-VolumesNegativeTest-1101616844 tempest-VolumesNegativeTest-1101616844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd5dc5471e5246f4878f1d91d59b68f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e74136856dcf42c48689e6976f16caad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:11:48.386029 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-02a91ffb-6820-48c0-9f2a-d559b7ebac40 tempest-VolumesNegativeTest-1101616844 tempest-VolumesNegativeTest-1101616844-project] 10.222.0.23 "GET /compute/v2.1/servers/452465c5-d313-4698-a666-9e814920b8fd" status: 200 len: 1267 microversion: 2.1 time: 0.120458 Oct 13 13:11:48.387084 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 105/230] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:11:48 2022] GET /compute/v2.1/servers/452465c5-d313-4698-a666-9e814920b8fd => generated 1267 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:11:49.089178 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-c50c9f90-f4a2-4033-a165-e024a7a05ee2 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Calling method '>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:11:49.090337 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-c50c9f90-f4a2-4033-a165-e024a7a05ee2 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] [instance: 0548a3eb-e119-482c-ac70-04fbc6f83bf7] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:11:49.112866 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-c50c9f90-f4a2-4033-a165-e024a7a05ee2 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:11:49.113365 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-c50c9f90-f4a2-4033-a165-e024a7a05ee2 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:11:49.113804 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-c50c9f90-f4a2-4033-a165-e024a7a05ee2 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:11:49.114543 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-c50c9f90-f4a2-4033-a165-e024a7a05ee2 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:11:49.115002 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-c50c9f90-f4a2-4033-a165-e024a7a05ee2 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:11:49.115455 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-c50c9f90-f4a2-4033-a165-e024a7a05ee2 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:11:49.384045 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-c50c9f90-f4a2-4033-a165-e024a7a05ee2 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '454203f47b434cca952a1cef56de559f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7312d0ac9248f2bfbece5611913ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:11:49.393208 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-c50c9f90-f4a2-4033-a165-e024a7a05ee2 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] 10.222.0.23 "GET /compute/v2.1/servers/0548a3eb-e119-482c-ac70-04fbc6f83bf7" status: 200 len: 1522 microversion: 2.1 time: 0.308524 Oct 13 13:11:49.394056 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 126/231] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:11:49 2022] GET /compute/v2.1/servers/0548a3eb-e119-482c-ac70-04fbc6f83bf7 => generated 1522 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:11:49.412523 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-6f2a2414-2bfe-4d73-9f3d-24cc86d799fa tempest-VolumesNegativeTest-1101616844 tempest-VolumesNegativeTest-1101616844-project] Calling method '>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:11:49.413299 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-6f2a2414-2bfe-4d73-9f3d-24cc86d799fa tempest-VolumesNegativeTest-1101616844 tempest-VolumesNegativeTest-1101616844-project] [instance: 452465c5-d313-4698-a666-9e814920b8fd] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:11:49.420577 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-6f2a2414-2bfe-4d73-9f3d-24cc86d799fa tempest-VolumesNegativeTest-1101616844 tempest-VolumesNegativeTest-1101616844-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:11:49.421264 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-6f2a2414-2bfe-4d73-9f3d-24cc86d799fa tempest-VolumesNegativeTest-1101616844 tempest-VolumesNegativeTest-1101616844-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:11:49.421883 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-6f2a2414-2bfe-4d73-9f3d-24cc86d799fa tempest-VolumesNegativeTest-1101616844 tempest-VolumesNegativeTest-1101616844-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:11:49.422594 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-6f2a2414-2bfe-4d73-9f3d-24cc86d799fa tempest-VolumesNegativeTest-1101616844 tempest-VolumesNegativeTest-1101616844-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:11:49.423123 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-6f2a2414-2bfe-4d73-9f3d-24cc86d799fa tempest-VolumesNegativeTest-1101616844 tempest-VolumesNegativeTest-1101616844-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:11:49.423551 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-6f2a2414-2bfe-4d73-9f3d-24cc86d799fa tempest-VolumesNegativeTest-1101616844 tempest-VolumesNegativeTest-1101616844-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:11:49.490158 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-6f2a2414-2bfe-4d73-9f3d-24cc86d799fa tempest-VolumesNegativeTest-1101616844 tempest-VolumesNegativeTest-1101616844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd5dc5471e5246f4878f1d91d59b68f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e74136856dcf42c48689e6976f16caad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:11:49.498658 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-6f2a2414-2bfe-4d73-9f3d-24cc86d799fa tempest-VolumesNegativeTest-1101616844 tempest-VolumesNegativeTest-1101616844-project] 10.222.0.23 "GET /compute/v2.1/servers/452465c5-d313-4698-a666-9e814920b8fd" status: 200 len: 1273 microversion: 2.1 time: 0.090964 Oct 13 13:11:49.499284 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 106/232] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:11:49 2022] GET /compute/v2.1/servers/452465c5-d313-4698-a666-9e814920b8fd => generated 1273 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:11:49.625146 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-eb805930-ec9a-4fba-9243-43078d972547 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 13:11:49.626015 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-eb805930-ec9a-4fba-9243-43078d972547 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] [instance: 26bd475b-3495-4669-9985-d4a7dedb4bbf] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:11:49.633455 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-eb805930-ec9a-4fba-9243-43078d972547 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:11:49.634032 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-eb805930-ec9a-4fba-9243-43078d972547 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:11:49.634549 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-eb805930-ec9a-4fba-9243-43078d972547 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:11:49.635476 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-eb805930-ec9a-4fba-9243-43078d972547 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:11:49.637069 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-eb805930-ec9a-4fba-9243-43078d972547 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:11:49.638283 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-eb805930-ec9a-4fba-9243-43078d972547 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:11:49.667822 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.objects.instance [None req-eb805930-ec9a-4fba-9243-43078d972547 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lazy-loading 'flavor' on Instance uuid 26bd475b-3495-4669-9985-d4a7dedb4bbf {{(pid=118814) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 13 13:11:49.884459 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-eb805930-ec9a-4fba-9243-43078d972547 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] 10.222.0.23 "POST /compute/v2.1/servers/26bd475b-3495-4669-9985-d4a7dedb4bbf/action" status: 202 len: 0 microversion: 2.20 time: 0.263225 Oct 13 13:11:49.885399 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 127/233] 10.222.0.23 () {62 vars in 1319 bytes} [Thu Oct 13 13:11:49 2022] POST /compute/v2.1/servers/26bd475b-3495-4669-9985-d4a7dedb4bbf/action => generated 0 bytes in 265 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 13 13:11:49.894640 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-0ea34259-3601-44a6-9f40-3ce367c6dba7 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Calling method '>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:11:49.895683 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-0ea34259-3601-44a6-9f40-3ce367c6dba7 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] [instance: 26bd475b-3495-4669-9985-d4a7dedb4bbf] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:11:49.904324 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-0ea34259-3601-44a6-9f40-3ce367c6dba7 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:11:49.905836 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-0ea34259-3601-44a6-9f40-3ce367c6dba7 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:11:49.906619 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-0ea34259-3601-44a6-9f40-3ce367c6dba7 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:11:49.908056 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-0ea34259-3601-44a6-9f40-3ce367c6dba7 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:11:49.909187 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-0ea34259-3601-44a6-9f40-3ce367c6dba7 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:11:49.910082 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-0ea34259-3601-44a6-9f40-3ce367c6dba7 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:11:50.063574 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-0ea34259-3601-44a6-9f40-3ce367c6dba7 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:11:50.072961 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-0ea34259-3601-44a6-9f40-3ce367c6dba7 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:11:50.074904 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-0ea34259-3601-44a6-9f40-3ce367c6dba7 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:11:50.076331 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-0ea34259-3601-44a6-9f40-3ce367c6dba7 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] 10.222.0.23 "GET /compute/v2.1/servers/26bd475b-3495-4669-9985-d4a7dedb4bbf" status: 200 len: 1724 microversion: 2.20 time: 0.185731 Oct 13 13:11:50.077200 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 107/234] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 13:11:49 2022] GET /compute/v2.1/servers/26bd475b-3495-4669-9985-d4a7dedb4bbf => generated 1724 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 13 13:11:50.422923 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-7a7a67f0-0da7-4fe1-8892-9bd9adfcca8f tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Calling method '>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:11:50.423657 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-7a7a67f0-0da7-4fe1-8892-9bd9adfcca8f tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] [instance: 0548a3eb-e119-482c-ac70-04fbc6f83bf7] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:11:50.431694 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-7a7a67f0-0da7-4fe1-8892-9bd9adfcca8f tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:11:50.432537 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-7a7a67f0-0da7-4fe1-8892-9bd9adfcca8f tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:11:50.433162 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-7a7a67f0-0da7-4fe1-8892-9bd9adfcca8f tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:11:50.435830 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-7a7a67f0-0da7-4fe1-8892-9bd9adfcca8f tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:11:50.436441 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-7a7a67f0-0da7-4fe1-8892-9bd9adfcca8f tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:11:50.437018 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-7a7a67f0-0da7-4fe1-8892-9bd9adfcca8f tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:11:50.522669 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-d8f9108e-314f-42f8-bb95-ae478086eb16 tempest-VolumesNegativeTest-1101616844 tempest-VolumesNegativeTest-1101616844-project] Calling method '>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:11:50.523346 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-d8f9108e-314f-42f8-bb95-ae478086eb16 tempest-VolumesNegativeTest-1101616844 tempest-VolumesNegativeTest-1101616844-project] [instance: 452465c5-d313-4698-a666-9e814920b8fd] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:11:50.535142 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-d8f9108e-314f-42f8-bb95-ae478086eb16 tempest-VolumesNegativeTest-1101616844 tempest-VolumesNegativeTest-1101616844-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:11:50.535670 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-d8f9108e-314f-42f8-bb95-ae478086eb16 tempest-VolumesNegativeTest-1101616844 tempest-VolumesNegativeTest-1101616844-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:11:50.536168 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-d8f9108e-314f-42f8-bb95-ae478086eb16 tempest-VolumesNegativeTest-1101616844 tempest-VolumesNegativeTest-1101616844-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:11:50.536908 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-d8f9108e-314f-42f8-bb95-ae478086eb16 tempest-VolumesNegativeTest-1101616844 tempest-VolumesNegativeTest-1101616844-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:11:50.537370 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-d8f9108e-314f-42f8-bb95-ae478086eb16 tempest-VolumesNegativeTest-1101616844 tempest-VolumesNegativeTest-1101616844-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:11:50.537795 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-d8f9108e-314f-42f8-bb95-ae478086eb16 tempest-VolumesNegativeTest-1101616844 tempest-VolumesNegativeTest-1101616844-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:11:51.056687 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-d8f9108e-314f-42f8-bb95-ae478086eb16 tempest-VolumesNegativeTest-1101616844 tempest-VolumesNegativeTest-1101616844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd5dc5471e5246f4878f1d91d59b68f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e74136856dcf42c48689e6976f16caad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:11:51.065128 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-d8f9108e-314f-42f8-bb95-ae478086eb16 tempest-VolumesNegativeTest-1101616844 tempest-VolumesNegativeTest-1101616844-project] 10.222.0.23 "GET /compute/v2.1/servers/452465c5-d313-4698-a666-9e814920b8fd" status: 200 len: 1315 microversion: 2.1 time: 0.547019 Oct 13 13:11:51.065706 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 108/235] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:11:50 2022] GET /compute/v2.1/servers/452465c5-d313-4698-a666-9e814920b8fd => generated 1315 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:11:51.081854 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-7a7a67f0-0da7-4fe1-8892-9bd9adfcca8f tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '454203f47b434cca952a1cef56de559f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7312d0ac9248f2bfbece5611913ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:11:51.090863 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-7a7a67f0-0da7-4fe1-8892-9bd9adfcca8f tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] 10.222.0.23 "GET /compute/v2.1/servers/0548a3eb-e119-482c-ac70-04fbc6f83bf7" status: 200 len: 1522 microversion: 2.1 time: 0.672731 Oct 13 13:11:51.091720 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 128/236] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:11:50 2022] GET /compute/v2.1/servers/0548a3eb-e119-482c-ac70-04fbc6f83bf7 => generated 1522 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:11:51.111030 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-19ba02c3-d5e1-4b85-9dee-5dd249015f75 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Calling method '>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:11:51.111984 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-19ba02c3-d5e1-4b85-9dee-5dd249015f75 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] [instance: 26bd475b-3495-4669-9985-d4a7dedb4bbf] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:11:51.119700 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-19ba02c3-d5e1-4b85-9dee-5dd249015f75 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:11:51.120325 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-19ba02c3-d5e1-4b85-9dee-5dd249015f75 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:11:51.120867 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-19ba02c3-d5e1-4b85-9dee-5dd249015f75 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:11:51.121707 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-19ba02c3-d5e1-4b85-9dee-5dd249015f75 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:11:51.122293 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-19ba02c3-d5e1-4b85-9dee-5dd249015f75 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:11:51.122820 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-19ba02c3-d5e1-4b85-9dee-5dd249015f75 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:11:51.327785 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-19ba02c3-d5e1-4b85-9dee-5dd249015f75 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:11:51.338642 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-19ba02c3-d5e1-4b85-9dee-5dd249015f75 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:11:51.340144 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-19ba02c3-d5e1-4b85-9dee-5dd249015f75 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:11:51.341501 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-19ba02c3-d5e1-4b85-9dee-5dd249015f75 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] 10.222.0.23 "GET /compute/v2.1/servers/26bd475b-3495-4669-9985-d4a7dedb4bbf" status: 200 len: 1724 microversion: 2.20 time: 0.243464 Oct 13 13:11:51.342060 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 109/237] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 13:11:51 2022] GET /compute/v2.1/servers/26bd475b-3495-4669-9985-d4a7dedb4bbf => generated 1724 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 13 13:11:52.091211 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-c5674b0d-d884-4ddf-b592-2f60e28c3845 tempest-VolumesNegativeTest-1101616844 tempest-VolumesNegativeTest-1101616844-project] Calling method '>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:11:52.091911 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-c5674b0d-d884-4ddf-b592-2f60e28c3845 tempest-VolumesNegativeTest-1101616844 tempest-VolumesNegativeTest-1101616844-project] [instance: 452465c5-d313-4698-a666-9e814920b8fd] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:11:52.094440 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG dbcounter [-] [118814] Writing DB stats nova_api:SELECT=46 {{(pid=118814) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:11:52.100981 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-c5674b0d-d884-4ddf-b592-2f60e28c3845 tempest-VolumesNegativeTest-1101616844 tempest-VolumesNegativeTest-1101616844-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:11:52.101577 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-c5674b0d-d884-4ddf-b592-2f60e28c3845 tempest-VolumesNegativeTest-1101616844 tempest-VolumesNegativeTest-1101616844-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:11:52.102113 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-c5674b0d-d884-4ddf-b592-2f60e28c3845 tempest-VolumesNegativeTest-1101616844 tempest-VolumesNegativeTest-1101616844-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:11:52.102893 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-c5674b0d-d884-4ddf-b592-2f60e28c3845 tempest-VolumesNegativeTest-1101616844 tempest-VolumesNegativeTest-1101616844-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:11:52.103446 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-c5674b0d-d884-4ddf-b592-2f60e28c3845 tempest-VolumesNegativeTest-1101616844 tempest-VolumesNegativeTest-1101616844-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:11:52.103933 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-c5674b0d-d884-4ddf-b592-2f60e28c3845 tempest-VolumesNegativeTest-1101616844 tempest-VolumesNegativeTest-1101616844-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:11:52.119511 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-8396f4e5-3f2a-4e19-ac3e-2c1806e9cf97 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Calling method '>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:11:52.123133 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-8396f4e5-3f2a-4e19-ac3e-2c1806e9cf97 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] [instance: 0548a3eb-e119-482c-ac70-04fbc6f83bf7] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:11:52.136863 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-8396f4e5-3f2a-4e19-ac3e-2c1806e9cf97 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:11:52.137578 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-8396f4e5-3f2a-4e19-ac3e-2c1806e9cf97 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:11:52.138529 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-8396f4e5-3f2a-4e19-ac3e-2c1806e9cf97 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:11:52.139422 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-8396f4e5-3f2a-4e19-ac3e-2c1806e9cf97 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:11:52.140027 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-8396f4e5-3f2a-4e19-ac3e-2c1806e9cf97 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:11:52.140603 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-8396f4e5-3f2a-4e19-ac3e-2c1806e9cf97 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:11:52.352394 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-c5674b0d-d884-4ddf-b592-2f60e28c3845 tempest-VolumesNegativeTest-1101616844 tempest-VolumesNegativeTest-1101616844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd5dc5471e5246f4878f1d91d59b68f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e74136856dcf42c48689e6976f16caad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:11:52.368141 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-c5674b0d-d884-4ddf-b592-2f60e28c3845 tempest-VolumesNegativeTest-1101616844 tempest-VolumesNegativeTest-1101616844-project] 10.222.0.23 "GET /compute/v2.1/servers/452465c5-d313-4698-a666-9e814920b8fd" status: 200 len: 1315 microversion: 2.1 time: 0.280815 Oct 13 13:11:52.369104 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 129/238] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:11:52 2022] GET /compute/v2.1/servers/452465c5-d313-4698-a666-9e814920b8fd => generated 1315 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:11:52.373903 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-f5a7275c-0199-4309-a888-4a324ad5cd67 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Calling method '>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:11:52.374867 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-f5a7275c-0199-4309-a888-4a324ad5cd67 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] [instance: 26bd475b-3495-4669-9985-d4a7dedb4bbf] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:11:52.382924 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-f5a7275c-0199-4309-a888-4a324ad5cd67 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:11:52.383494 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-f5a7275c-0199-4309-a888-4a324ad5cd67 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:11:52.383935 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-f5a7275c-0199-4309-a888-4a324ad5cd67 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:11:52.384643 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-f5a7275c-0199-4309-a888-4a324ad5cd67 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:11:52.385124 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-f5a7275c-0199-4309-a888-4a324ad5cd67 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:11:52.386278 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-f5a7275c-0199-4309-a888-4a324ad5cd67 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:11:52.522930 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-8396f4e5-3f2a-4e19-ac3e-2c1806e9cf97 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '454203f47b434cca952a1cef56de559f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7312d0ac9248f2bfbece5611913ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:11:52.531675 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-8396f4e5-3f2a-4e19-ac3e-2c1806e9cf97 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] 10.222.0.23 "GET /compute/v2.1/servers/0548a3eb-e119-482c-ac70-04fbc6f83bf7" status: 200 len: 1522 microversion: 2.1 time: 0.421287 Oct 13 13:11:52.532530 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 110/239] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:11:52 2022] GET /compute/v2.1/servers/0548a3eb-e119-482c-ac70-04fbc6f83bf7 => generated 1522 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:11:52.657674 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-f5a7275c-0199-4309-a888-4a324ad5cd67 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:11:52.668212 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-f5a7275c-0199-4309-a888-4a324ad5cd67 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:11:52.669886 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-f5a7275c-0199-4309-a888-4a324ad5cd67 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:11:52.671161 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-f5a7275c-0199-4309-a888-4a324ad5cd67 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] 10.222.0.23 "GET /compute/v2.1/servers/26bd475b-3495-4669-9985-d4a7dedb4bbf" status: 200 len: 1724 microversion: 2.20 time: 0.300952 Oct 13 13:11:52.671976 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 130/240] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 13:11:52 2022] GET /compute/v2.1/servers/26bd475b-3495-4669-9985-d4a7dedb4bbf => generated 1724 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 13:11:53.280376 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [req-cd91d362-46cc-4c84-a708-8674ccb0caca req-1f1df315-b845-4997-953d-95d7ab1fe19f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "452465c5-d313-4698-a666-9e814920b8fd", "tag": "8ea6a73b-f96b-45c1-b3fd-3688afc99566"}]} {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 13:11:53.293383 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [req-cd91d362-46cc-4c84-a708-8674ccb0caca req-1f1df315-b845-4997-953d-95d7ab1fe19f service nova] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:11:53.294115 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [req-cd91d362-46cc-4c84-a708-8674ccb0caca req-1f1df315-b845-4997-953d-95d7ab1fe19f service nova] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:11:53.295172 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [req-cd91d362-46cc-4c84-a708-8674ccb0caca req-1f1df315-b845-4997-953d-95d7ab1fe19f service nova] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:11:53.308031 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.compute.server_external_events [req-cd91d362-46cc-4c84-a708-8674ccb0caca req-1f1df315-b845-4997-953d-95d7ab1fe19f service nova] Creating event network-changed:8ea6a73b-f96b-45c1-b3fd-3688afc99566 for instance 452465c5-d313-4698-a666-9e814920b8fd on hv-cinder-82660 Oct 13 13:11:53.316195 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [req-cd91d362-46cc-4c84-a708-8674ccb0caca req-1f1df315-b845-4997-953d-95d7ab1fe19f service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039953 Oct 13 13:11:53.316957 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 111/241] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 13:11:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 13:11:53.403267 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-f792d5c6-e40e-4123-a68d-1eae9ff5dd62 tempest-VolumesNegativeTest-1101616844 tempest-VolumesNegativeTest-1101616844-project] Calling method '>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:11:53.404078 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-f792d5c6-e40e-4123-a68d-1eae9ff5dd62 tempest-VolumesNegativeTest-1101616844 tempest-VolumesNegativeTest-1101616844-project] [instance: 452465c5-d313-4698-a666-9e814920b8fd] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:11:53.412850 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-f792d5c6-e40e-4123-a68d-1eae9ff5dd62 tempest-VolumesNegativeTest-1101616844 tempest-VolumesNegativeTest-1101616844-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:11:53.413706 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-f792d5c6-e40e-4123-a68d-1eae9ff5dd62 tempest-VolumesNegativeTest-1101616844 tempest-VolumesNegativeTest-1101616844-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:11:53.414294 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-f792d5c6-e40e-4123-a68d-1eae9ff5dd62 tempest-VolumesNegativeTest-1101616844 tempest-VolumesNegativeTest-1101616844-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:11:53.415170 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-f792d5c6-e40e-4123-a68d-1eae9ff5dd62 tempest-VolumesNegativeTest-1101616844 tempest-VolumesNegativeTest-1101616844-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:11:53.416006 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-f792d5c6-e40e-4123-a68d-1eae9ff5dd62 tempest-VolumesNegativeTest-1101616844 tempest-VolumesNegativeTest-1101616844-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:11:53.416920 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-f792d5c6-e40e-4123-a68d-1eae9ff5dd62 tempest-VolumesNegativeTest-1101616844 tempest-VolumesNegativeTest-1101616844-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:11:53.561872 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-24bf7a67-9332-4f6f-b63a-5ec6708caf85 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Calling method '>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:11:53.563142 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-24bf7a67-9332-4f6f-b63a-5ec6708caf85 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] [instance: 0548a3eb-e119-482c-ac70-04fbc6f83bf7] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:11:53.579565 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-24bf7a67-9332-4f6f-b63a-5ec6708caf85 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:11:53.581708 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-24bf7a67-9332-4f6f-b63a-5ec6708caf85 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:11:53.583299 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-24bf7a67-9332-4f6f-b63a-5ec6708caf85 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:11:53.586272 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-24bf7a67-9332-4f6f-b63a-5ec6708caf85 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:11:53.587133 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-24bf7a67-9332-4f6f-b63a-5ec6708caf85 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:11:53.588329 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-24bf7a67-9332-4f6f-b63a-5ec6708caf85 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:11:53.811473 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-f792d5c6-e40e-4123-a68d-1eae9ff5dd62 tempest-VolumesNegativeTest-1101616844 tempest-VolumesNegativeTest-1101616844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd5dc5471e5246f4878f1d91d59b68f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e74136856dcf42c48689e6976f16caad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:11:53.823748 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-f792d5c6-e40e-4123-a68d-1eae9ff5dd62 tempest-VolumesNegativeTest-1101616844 tempest-VolumesNegativeTest-1101616844-project] 10.222.0.23 "GET /compute/v2.1/servers/452465c5-d313-4698-a666-9e814920b8fd" status: 200 len: 1315 microversion: 2.1 time: 0.425921 Oct 13 13:11:53.835749 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 131/242] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:11:53 2022] GET /compute/v2.1/servers/452465c5-d313-4698-a666-9e814920b8fd => generated 1315 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:11:53.848350 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-e73314d5-c850-4950-8943-ef7bbc6a2659 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Calling method '>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:11:53.851553 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-e73314d5-c850-4950-8943-ef7bbc6a2659 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] [instance: 26bd475b-3495-4669-9985-d4a7dedb4bbf] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:11:53.876182 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-e73314d5-c850-4950-8943-ef7bbc6a2659 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:11:53.876923 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-e73314d5-c850-4950-8943-ef7bbc6a2659 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:11:53.877526 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-e73314d5-c850-4950-8943-ef7bbc6a2659 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:11:53.880565 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-e73314d5-c850-4950-8943-ef7bbc6a2659 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:11:53.881189 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-e73314d5-c850-4950-8943-ef7bbc6a2659 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:11:53.881770 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-e73314d5-c850-4950-8943-ef7bbc6a2659 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:11:53.917812 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-24bf7a67-9332-4f6f-b63a-5ec6708caf85 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '454203f47b434cca952a1cef56de559f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7312d0ac9248f2bfbece5611913ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:11:53.944521 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-24bf7a67-9332-4f6f-b63a-5ec6708caf85 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] 10.222.0.23 "GET /compute/v2.1/servers/0548a3eb-e119-482c-ac70-04fbc6f83bf7" status: 200 len: 1522 microversion: 2.1 time: 0.380871 Oct 13 13:11:53.944521 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 112/243] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:11:53 2022] GET /compute/v2.1/servers/0548a3eb-e119-482c-ac70-04fbc6f83bf7 => generated 1522 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:11:54.100628 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-e73314d5-c850-4950-8943-ef7bbc6a2659 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:11:54.109780 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-e73314d5-c850-4950-8943-ef7bbc6a2659 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:11:54.111579 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-e73314d5-c850-4950-8943-ef7bbc6a2659 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:11:54.113139 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-e73314d5-c850-4950-8943-ef7bbc6a2659 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] 10.222.0.23 "GET /compute/v2.1/servers/26bd475b-3495-4669-9985-d4a7dedb4bbf" status: 200 len: 1724 microversion: 2.20 time: 0.276226 Oct 13 13:11:54.114106 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 132/244] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 13:11:53 2022] GET /compute/v2.1/servers/26bd475b-3495-4669-9985-d4a7dedb4bbf => generated 1724 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 13:11:54.851357 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-bf2f502c-59dc-43d8-9090-4e51397ca2f9 tempest-VolumesNegativeTest-1101616844 tempest-VolumesNegativeTest-1101616844-project] Calling method '>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:11:54.852295 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-bf2f502c-59dc-43d8-9090-4e51397ca2f9 tempest-VolumesNegativeTest-1101616844 tempest-VolumesNegativeTest-1101616844-project] [instance: 452465c5-d313-4698-a666-9e814920b8fd] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:11:54.855303 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG dbcounter [-] [118815] Writing DB stats nova_cell0:SELECT=2 {{(pid=118815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:11:54.856518 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG dbcounter [-] [118815] Writing DB stats nova_cell0:SELECT=6 {{(pid=118815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:11:54.868230 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-bf2f502c-59dc-43d8-9090-4e51397ca2f9 tempest-VolumesNegativeTest-1101616844 tempest-VolumesNegativeTest-1101616844-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:11:54.878827 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-bf2f502c-59dc-43d8-9090-4e51397ca2f9 tempest-VolumesNegativeTest-1101616844 tempest-VolumesNegativeTest-1101616844-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:11:54.881850 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-bf2f502c-59dc-43d8-9090-4e51397ca2f9 tempest-VolumesNegativeTest-1101616844 tempest-VolumesNegativeTest-1101616844-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:11:54.883589 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-bf2f502c-59dc-43d8-9090-4e51397ca2f9 tempest-VolumesNegativeTest-1101616844 tempest-VolumesNegativeTest-1101616844-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:11:54.885776 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-bf2f502c-59dc-43d8-9090-4e51397ca2f9 tempest-VolumesNegativeTest-1101616844 tempest-VolumesNegativeTest-1101616844-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:11:54.887004 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-bf2f502c-59dc-43d8-9090-4e51397ca2f9 tempest-VolumesNegativeTest-1101616844 tempest-VolumesNegativeTest-1101616844-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:11:54.961864 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-e782850e-c339-47e3-9e93-6e54bb5d7cca tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Calling method '>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:11:54.962879 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-e782850e-c339-47e3-9e93-6e54bb5d7cca tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] [instance: 0548a3eb-e119-482c-ac70-04fbc6f83bf7] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:11:54.977057 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-e782850e-c339-47e3-9e93-6e54bb5d7cca tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:11:54.978120 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-e782850e-c339-47e3-9e93-6e54bb5d7cca tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:11:54.978582 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-e782850e-c339-47e3-9e93-6e54bb5d7cca tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:11:54.983588 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-e782850e-c339-47e3-9e93-6e54bb5d7cca tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:11:54.987479 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-e782850e-c339-47e3-9e93-6e54bb5d7cca tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:11:54.988024 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-e782850e-c339-47e3-9e93-6e54bb5d7cca tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:11:55.026591 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG dbcounter [-] [118814] Writing DB stats nova_cell0:SELECT=2 {{(pid=118814) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:11:55.294937 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-bf2f502c-59dc-43d8-9090-4e51397ca2f9 tempest-VolumesNegativeTest-1101616844 tempest-VolumesNegativeTest-1101616844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd5dc5471e5246f4878f1d91d59b68f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e74136856dcf42c48689e6976f16caad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:11:55.304058 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-bf2f502c-59dc-43d8-9090-4e51397ca2f9 tempest-VolumesNegativeTest-1101616844 tempest-VolumesNegativeTest-1101616844-project] 10.222.0.23 "GET /compute/v2.1/servers/452465c5-d313-4698-a666-9e814920b8fd" status: 200 len: 1315 microversion: 2.1 time: 0.457126 Oct 13 13:11:55.305299 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 113/245] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:11:54 2022] GET /compute/v2.1/servers/452465c5-d313-4698-a666-9e814920b8fd => generated 1315 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:11:55.306299 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-e782850e-c339-47e3-9e93-6e54bb5d7cca tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '454203f47b434cca952a1cef56de559f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7312d0ac9248f2bfbece5611913ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:11:55.315018 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-e782850e-c339-47e3-9e93-6e54bb5d7cca tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] 10.222.0.23 "GET /compute/v2.1/servers/0548a3eb-e119-482c-ac70-04fbc6f83bf7" status: 200 len: 1522 microversion: 2.1 time: 0.357142 Oct 13 13:11:55.318375 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-63d908c7-112c-4751-8b7d-0068b81cf341 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Calling method '>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:11:55.319598 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-63d908c7-112c-4751-8b7d-0068b81cf341 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] [instance: 26bd475b-3495-4669-9985-d4a7dedb4bbf] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:11:55.325309 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 133/246] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:11:54 2022] GET /compute/v2.1/servers/0548a3eb-e119-482c-ac70-04fbc6f83bf7 => generated 1522 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 13:11:55.329393 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-63d908c7-112c-4751-8b7d-0068b81cf341 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:11:55.329999 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-63d908c7-112c-4751-8b7d-0068b81cf341 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:11:55.330530 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-63d908c7-112c-4751-8b7d-0068b81cf341 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:11:55.331366 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-63d908c7-112c-4751-8b7d-0068b81cf341 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:11:55.331919 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-63d908c7-112c-4751-8b7d-0068b81cf341 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:11:55.332480 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-63d908c7-112c-4751-8b7d-0068b81cf341 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:11:55.712701 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-63d908c7-112c-4751-8b7d-0068b81cf341 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:11:55.725834 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-63d908c7-112c-4751-8b7d-0068b81cf341 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:11:55.729021 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-63d908c7-112c-4751-8b7d-0068b81cf341 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:11:55.730298 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-63d908c7-112c-4751-8b7d-0068b81cf341 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] 10.222.0.23 "GET /compute/v2.1/servers/26bd475b-3495-4669-9985-d4a7dedb4bbf" status: 200 len: 1724 microversion: 2.20 time: 0.423772 Oct 13 13:11:55.730930 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 114/247] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 13:11:55 2022] GET /compute/v2.1/servers/26bd475b-3495-4669-9985-d4a7dedb4bbf => generated 1724 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 13:11:56.329128 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-e30e15e1-9047-47c2-b07f-5a587733bca4 tempest-VolumesNegativeTest-1101616844 tempest-VolumesNegativeTest-1101616844-project] Calling method '>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:11:56.330360 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-e30e15e1-9047-47c2-b07f-5a587733bca4 tempest-VolumesNegativeTest-1101616844 tempest-VolumesNegativeTest-1101616844-project] [instance: 452465c5-d313-4698-a666-9e814920b8fd] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:11:56.340541 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-be1b4c0c-b0b0-46ef-88ea-a6a90257ea65 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Calling method '>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:11:56.341989 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-be1b4c0c-b0b0-46ef-88ea-a6a90257ea65 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] [instance: 0548a3eb-e119-482c-ac70-04fbc6f83bf7] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:11:56.346816 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-e30e15e1-9047-47c2-b07f-5a587733bca4 tempest-VolumesNegativeTest-1101616844 tempest-VolumesNegativeTest-1101616844-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:11:56.347832 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-e30e15e1-9047-47c2-b07f-5a587733bca4 tempest-VolumesNegativeTest-1101616844 tempest-VolumesNegativeTest-1101616844-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:11:56.348464 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-e30e15e1-9047-47c2-b07f-5a587733bca4 tempest-VolumesNegativeTest-1101616844 tempest-VolumesNegativeTest-1101616844-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:11:56.349498 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-e30e15e1-9047-47c2-b07f-5a587733bca4 tempest-VolumesNegativeTest-1101616844 tempest-VolumesNegativeTest-1101616844-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:11:56.349843 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-be1b4c0c-b0b0-46ef-88ea-a6a90257ea65 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:11:56.350293 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-e30e15e1-9047-47c2-b07f-5a587733bca4 tempest-VolumesNegativeTest-1101616844 tempest-VolumesNegativeTest-1101616844-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:11:56.350409 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-be1b4c0c-b0b0-46ef-88ea-a6a90257ea65 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:11:56.350947 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-be1b4c0c-b0b0-46ef-88ea-a6a90257ea65 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:11:56.351140 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-e30e15e1-9047-47c2-b07f-5a587733bca4 tempest-VolumesNegativeTest-1101616844 tempest-VolumesNegativeTest-1101616844-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:11:56.351819 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-be1b4c0c-b0b0-46ef-88ea-a6a90257ea65 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:11:56.352555 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-be1b4c0c-b0b0-46ef-88ea-a6a90257ea65 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:11:56.353061 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-be1b4c0c-b0b0-46ef-88ea-a6a90257ea65 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:11:56.593934 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-e30e15e1-9047-47c2-b07f-5a587733bca4 tempest-VolumesNegativeTest-1101616844 tempest-VolumesNegativeTest-1101616844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd5dc5471e5246f4878f1d91d59b68f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e74136856dcf42c48689e6976f16caad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:11:56.602601 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-e30e15e1-9047-47c2-b07f-5a587733bca4 tempest-VolumesNegativeTest-1101616844 tempest-VolumesNegativeTest-1101616844-project] 10.222.0.23 "GET /compute/v2.1/servers/452465c5-d313-4698-a666-9e814920b8fd" status: 200 len: 1315 microversion: 2.1 time: 0.278064 Oct 13 13:11:56.606094 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 134/248] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:11:56 2022] GET /compute/v2.1/servers/452465c5-d313-4698-a666-9e814920b8fd => generated 1315 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:11:56.637583 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-be1b4c0c-b0b0-46ef-88ea-a6a90257ea65 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '454203f47b434cca952a1cef56de559f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7312d0ac9248f2bfbece5611913ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:11:56.648795 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-be1b4c0c-b0b0-46ef-88ea-a6a90257ea65 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] 10.222.0.23 "GET /compute/v2.1/servers/0548a3eb-e119-482c-ac70-04fbc6f83bf7" status: 200 len: 1522 microversion: 2.1 time: 0.312319 Oct 13 13:11:56.663586 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 115/249] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:11:56 2022] GET /compute/v2.1/servers/0548a3eb-e119-482c-ac70-04fbc6f83bf7 => generated 1522 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 13:11:56.759821 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-9448f22f-c6e2-414a-8374-3924996c10c2 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Calling method '>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:11:56.760757 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-9448f22f-c6e2-414a-8374-3924996c10c2 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] [instance: 26bd475b-3495-4669-9985-d4a7dedb4bbf] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:11:56.768796 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-9448f22f-c6e2-414a-8374-3924996c10c2 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:11:56.769717 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-9448f22f-c6e2-414a-8374-3924996c10c2 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:11:56.770917 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-9448f22f-c6e2-414a-8374-3924996c10c2 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:11:56.774315 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-9448f22f-c6e2-414a-8374-3924996c10c2 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:11:56.777937 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-9448f22f-c6e2-414a-8374-3924996c10c2 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:11:56.779774 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-9448f22f-c6e2-414a-8374-3924996c10c2 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:11:57.025269 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-9448f22f-c6e2-414a-8374-3924996c10c2 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:11:57.048341 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-9448f22f-c6e2-414a-8374-3924996c10c2 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:11:57.050749 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-9448f22f-c6e2-414a-8374-3924996c10c2 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:11:57.053409 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-9448f22f-c6e2-414a-8374-3924996c10c2 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] 10.222.0.23 "GET /compute/v2.1/servers/26bd475b-3495-4669-9985-d4a7dedb4bbf" status: 200 len: 1724 microversion: 2.20 time: 0.300115 Oct 13 13:11:57.054633 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 135/250] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 13:11:56 2022] GET /compute/v2.1/servers/26bd475b-3495-4669-9985-d4a7dedb4bbf => generated 1724 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 13:11:57.629157 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-7425ac74-ab0c-4996-a6b9-6349c6c0a29d tempest-VolumesNegativeTest-1101616844 tempest-VolumesNegativeTest-1101616844-project] Calling method '>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:11:57.630346 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-7425ac74-ab0c-4996-a6b9-6349c6c0a29d tempest-VolumesNegativeTest-1101616844 tempest-VolumesNegativeTest-1101616844-project] [instance: 452465c5-d313-4698-a666-9e814920b8fd] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:11:57.633087 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG dbcounter [-] [118815] Writing DB stats nova_api:SELECT=55,nova_api:INSERT=3 {{(pid=118815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:11:57.647116 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-7425ac74-ab0c-4996-a6b9-6349c6c0a29d tempest-VolumesNegativeTest-1101616844 tempest-VolumesNegativeTest-1101616844-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:11:57.648022 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-7425ac74-ab0c-4996-a6b9-6349c6c0a29d tempest-VolumesNegativeTest-1101616844 tempest-VolumesNegativeTest-1101616844-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:11:57.650067 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-7425ac74-ab0c-4996-a6b9-6349c6c0a29d tempest-VolumesNegativeTest-1101616844 tempest-VolumesNegativeTest-1101616844-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:11:57.650981 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-7425ac74-ab0c-4996-a6b9-6349c6c0a29d tempest-VolumesNegativeTest-1101616844 tempest-VolumesNegativeTest-1101616844-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:11:57.652604 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-7425ac74-ab0c-4996-a6b9-6349c6c0a29d tempest-VolumesNegativeTest-1101616844 tempest-VolumesNegativeTest-1101616844-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:11:57.655978 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-7425ac74-ab0c-4996-a6b9-6349c6c0a29d tempest-VolumesNegativeTest-1101616844 tempest-VolumesNegativeTest-1101616844-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:11:57.679735 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-1aea60b8-0685-4d2e-82d5-9b952c41b036 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Calling method '>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:11:57.682444 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-1aea60b8-0685-4d2e-82d5-9b952c41b036 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] [instance: 0548a3eb-e119-482c-ac70-04fbc6f83bf7] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:11:57.698820 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-1aea60b8-0685-4d2e-82d5-9b952c41b036 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:11:57.703345 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-1aea60b8-0685-4d2e-82d5-9b952c41b036 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:11:57.704501 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-1aea60b8-0685-4d2e-82d5-9b952c41b036 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:11:57.706016 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-1aea60b8-0685-4d2e-82d5-9b952c41b036 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:11:57.708963 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-1aea60b8-0685-4d2e-82d5-9b952c41b036 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:11:57.710718 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-1aea60b8-0685-4d2e-82d5-9b952c41b036 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:11:57.999301 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-7425ac74-ab0c-4996-a6b9-6349c6c0a29d tempest-VolumesNegativeTest-1101616844 tempest-VolumesNegativeTest-1101616844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd5dc5471e5246f4878f1d91d59b68f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e74136856dcf42c48689e6976f16caad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:11:58.018420 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-1aea60b8-0685-4d2e-82d5-9b952c41b036 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '454203f47b434cca952a1cef56de559f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7312d0ac9248f2bfbece5611913ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:11:58.026392 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-1aea60b8-0685-4d2e-82d5-9b952c41b036 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] 10.222.0.23 "GET /compute/v2.1/servers/0548a3eb-e119-482c-ac70-04fbc6f83bf7" status: 200 len: 1522 microversion: 2.1 time: 0.356028 Oct 13 13:11:58.027449 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-7425ac74-ab0c-4996-a6b9-6349c6c0a29d tempest-VolumesNegativeTest-1101616844 tempest-VolumesNegativeTest-1101616844-project] 10.222.0.23 "GET /compute/v2.1/servers/452465c5-d313-4698-a666-9e814920b8fd" status: 200 len: 1315 microversion: 2.1 time: 0.391567 Oct 13 13:11:58.029251 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 116/251] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:11:57 2022] GET /compute/v2.1/servers/452465c5-d313-4698-a666-9e814920b8fd => generated 1315 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:11:58.029766 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 136/252] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:11:57 2022] GET /compute/v2.1/servers/0548a3eb-e119-482c-ac70-04fbc6f83bf7 => generated 1522 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 13:11:58.081364 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-6636f232-d8b5-4d8a-b320-9fb86bc2e40f tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Calling method '>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:11:58.082248 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-6636f232-d8b5-4d8a-b320-9fb86bc2e40f tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] [instance: 26bd475b-3495-4669-9985-d4a7dedb4bbf] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:11:58.103357 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-6636f232-d8b5-4d8a-b320-9fb86bc2e40f tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:11:58.105098 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-6636f232-d8b5-4d8a-b320-9fb86bc2e40f tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:11:58.108500 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-6636f232-d8b5-4d8a-b320-9fb86bc2e40f tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:11:58.109901 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-6636f232-d8b5-4d8a-b320-9fb86bc2e40f tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:11:58.110856 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-6636f232-d8b5-4d8a-b320-9fb86bc2e40f tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:11:58.113718 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-6636f232-d8b5-4d8a-b320-9fb86bc2e40f tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:11:58.351764 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-6636f232-d8b5-4d8a-b320-9fb86bc2e40f tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:11:58.354368 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG dbcounter [-] [118815] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:11:58.381833 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-6636f232-d8b5-4d8a-b320-9fb86bc2e40f tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:11:58.383396 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-6636f232-d8b5-4d8a-b320-9fb86bc2e40f tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:11:58.385627 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-6636f232-d8b5-4d8a-b320-9fb86bc2e40f tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] 10.222.0.23 "GET /compute/v2.1/servers/26bd475b-3495-4669-9985-d4a7dedb4bbf" status: 200 len: 1724 microversion: 2.20 time: 0.308289 Oct 13 13:11:58.386292 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 117/253] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 13:11:58 2022] GET /compute/v2.1/servers/26bd475b-3495-4669-9985-d4a7dedb4bbf => generated 1724 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 13:11:59.054508 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-1ed16473-3b71-4466-932d-a63f17f28046 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Calling method '>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:11:59.055325 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-1ed16473-3b71-4466-932d-a63f17f28046 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] [instance: 0548a3eb-e119-482c-ac70-04fbc6f83bf7] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:11:59.067549 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-721580dc-830b-4a38-b295-bdc115189fd8 tempest-VolumesNegativeTest-1101616844 tempest-VolumesNegativeTest-1101616844-project] Calling method '>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:11:59.068841 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-721580dc-830b-4a38-b295-bdc115189fd8 tempest-VolumesNegativeTest-1101616844 tempest-VolumesNegativeTest-1101616844-project] [instance: 452465c5-d313-4698-a666-9e814920b8fd] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:11:59.071850 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-1ed16473-3b71-4466-932d-a63f17f28046 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:11:59.072332 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-1ed16473-3b71-4466-932d-a63f17f28046 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:11:59.072944 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-1ed16473-3b71-4466-932d-a63f17f28046 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:11:59.079157 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-1ed16473-3b71-4466-932d-a63f17f28046 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:11:59.080612 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-1ed16473-3b71-4466-932d-a63f17f28046 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:11:59.081390 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-1ed16473-3b71-4466-932d-a63f17f28046 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:11:59.085158 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-721580dc-830b-4a38-b295-bdc115189fd8 tempest-VolumesNegativeTest-1101616844 tempest-VolumesNegativeTest-1101616844-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:11:59.085658 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-721580dc-830b-4a38-b295-bdc115189fd8 tempest-VolumesNegativeTest-1101616844 tempest-VolumesNegativeTest-1101616844-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:11:59.086104 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-721580dc-830b-4a38-b295-bdc115189fd8 tempest-VolumesNegativeTest-1101616844 tempest-VolumesNegativeTest-1101616844-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:11:59.086818 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-721580dc-830b-4a38-b295-bdc115189fd8 tempest-VolumesNegativeTest-1101616844 tempest-VolumesNegativeTest-1101616844-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:11:59.087309 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-721580dc-830b-4a38-b295-bdc115189fd8 tempest-VolumesNegativeTest-1101616844 tempest-VolumesNegativeTest-1101616844-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:11:59.088890 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-721580dc-830b-4a38-b295-bdc115189fd8 tempest-VolumesNegativeTest-1101616844 tempest-VolumesNegativeTest-1101616844-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:11:59.397519 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-721580dc-830b-4a38-b295-bdc115189fd8 tempest-VolumesNegativeTest-1101616844 tempest-VolumesNegativeTest-1101616844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd5dc5471e5246f4878f1d91d59b68f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e74136856dcf42c48689e6976f16caad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:11:59.406320 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-721580dc-830b-4a38-b295-bdc115189fd8 tempest-VolumesNegativeTest-1101616844 tempest-VolumesNegativeTest-1101616844-project] 10.222.0.23 "GET /compute/v2.1/servers/452465c5-d313-4698-a666-9e814920b8fd" status: 200 len: 1315 microversion: 2.1 time: 0.344029 Oct 13 13:11:59.416020 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 118/254] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:11:59 2022] GET /compute/v2.1/servers/452465c5-d313-4698-a666-9e814920b8fd => generated 1315 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:11:59.431382 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-1ed16473-3b71-4466-932d-a63f17f28046 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '454203f47b434cca952a1cef56de559f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7312d0ac9248f2bfbece5611913ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:11:59.432178 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-5c60c8ea-e8f0-4504-b54f-d1b0fc81043c tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 13:11:59.442925 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-5c60c8ea-e8f0-4504-b54f-d1b0fc81043c tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:11:59.443558 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-5c60c8ea-e8f0-4504-b54f-d1b0fc81043c tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:11:59.444896 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-5c60c8ea-e8f0-4504-b54f-d1b0fc81043c tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:11:59.445133 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-1ed16473-3b71-4466-932d-a63f17f28046 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] 10.222.0.23 "GET /compute/v2.1/servers/0548a3eb-e119-482c-ac70-04fbc6f83bf7" status: 200 len: 1522 microversion: 2.1 time: 0.395503 Oct 13 13:11:59.446165 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 137/255] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:11:59 2022] GET /compute/v2.1/servers/0548a3eb-e119-482c-ac70-04fbc6f83bf7 => generated 1522 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:11:59.455507 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-b8ef65c2-06bb-43d0-9f75-bf2ea6ea48ae tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Calling method '>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:11:59.456344 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-b8ef65c2-06bb-43d0-9f75-bf2ea6ea48ae tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] [instance: 26bd475b-3495-4669-9985-d4a7dedb4bbf] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:11:59.467143 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-b8ef65c2-06bb-43d0-9f75-bf2ea6ea48ae tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:11:59.467893 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-b8ef65c2-06bb-43d0-9f75-bf2ea6ea48ae tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:11:59.468478 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-b8ef65c2-06bb-43d0-9f75-bf2ea6ea48ae tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:11:59.470645 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-b8ef65c2-06bb-43d0-9f75-bf2ea6ea48ae tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:11:59.471388 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-b8ef65c2-06bb-43d0-9f75-bf2ea6ea48ae tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:11:59.471958 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-b8ef65c2-06bb-43d0-9f75-bf2ea6ea48ae tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:11:59.578629 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-5c60c8ea-e8f0-4504-b54f-d1b0fc81043c tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] [instance: e125ab44-9111-4260-909d-95d57b7861a7] Going to try to stop instance {{(pid=118815) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 13 13:11:59.672473 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-5c60c8ea-e8f0-4504-b54f-d1b0fc81043c tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] 10.222.0.23 "POST /compute/v2.1/servers/e125ab44-9111-4260-909d-95d57b7861a7/action" status: 202 len: 0 microversion: 2.1 time: 0.254624 Oct 13 13:11:59.674001 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 119/256] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Oct 13 13:11:59 2022] POST /compute/v2.1/servers/e125ab44-9111-4260-909d-95d57b7861a7/action => generated 0 bytes in 257 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 13 13:11:59.684642 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-fbb0322e-49a5-4bb6-8d2e-c0de83e385d0 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Calling method '>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:11:59.685485 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-fbb0322e-49a5-4bb6-8d2e-c0de83e385d0 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] [instance: e125ab44-9111-4260-909d-95d57b7861a7] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:11:59.697302 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-fbb0322e-49a5-4bb6-8d2e-c0de83e385d0 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:11:59.698738 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-fbb0322e-49a5-4bb6-8d2e-c0de83e385d0 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:11:59.699933 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-fbb0322e-49a5-4bb6-8d2e-c0de83e385d0 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:11:59.701041 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-fbb0322e-49a5-4bb6-8d2e-c0de83e385d0 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:11:59.701773 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-fbb0322e-49a5-4bb6-8d2e-c0de83e385d0 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:11:59.703178 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-fbb0322e-49a5-4bb6-8d2e-c0de83e385d0 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:11:59.806669 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-b8ef65c2-06bb-43d0-9f75-bf2ea6ea48ae tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:11:59.816400 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-b8ef65c2-06bb-43d0-9f75-bf2ea6ea48ae tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:11:59.818993 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-b8ef65c2-06bb-43d0-9f75-bf2ea6ea48ae tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:11:59.821846 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-b8ef65c2-06bb-43d0-9f75-bf2ea6ea48ae tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] 10.222.0.23 "GET /compute/v2.1/servers/26bd475b-3495-4669-9985-d4a7dedb4bbf" status: 200 len: 1724 microversion: 2.20 time: 0.373769 Oct 13 13:11:59.822815 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 138/257] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 13:11:59 2022] GET /compute/v2.1/servers/26bd475b-3495-4669-9985-d4a7dedb4bbf => generated 1724 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 13:12:00.020136 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-fbb0322e-49a5-4bb6-8d2e-c0de83e385d0 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e783caddcad473dbdd764919286e244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecd3d5d2a3a54a07ba64f1fea4846c40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:12:00.032677 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-fbb0322e-49a5-4bb6-8d2e-c0de83e385d0 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] 10.222.0.23 "GET /compute/v2.1/servers/e125ab44-9111-4260-909d-95d57b7861a7" status: 200 len: 1724 microversion: 2.1 time: 0.353262 Oct 13 13:12:00.047046 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 120/258] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:11:59 2022] GET /compute/v2.1/servers/e125ab44-9111-4260-909d-95d57b7861a7 => generated 1724 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:12:00.441543 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-a45c87d8-a5fd-4222-b809-9161ed4c335b tempest-VolumesNegativeTest-1101616844 tempest-VolumesNegativeTest-1101616844-project] Calling method '>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:12:00.443601 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-a45c87d8-a5fd-4222-b809-9161ed4c335b tempest-VolumesNegativeTest-1101616844 tempest-VolumesNegativeTest-1101616844-project] [instance: 452465c5-d313-4698-a666-9e814920b8fd] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:12:00.456157 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-a45c87d8-a5fd-4222-b809-9161ed4c335b tempest-VolumesNegativeTest-1101616844 tempest-VolumesNegativeTest-1101616844-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:12:00.456649 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-a45c87d8-a5fd-4222-b809-9161ed4c335b tempest-VolumesNegativeTest-1101616844 tempest-VolumesNegativeTest-1101616844-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:12:00.457091 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-a45c87d8-a5fd-4222-b809-9161ed4c335b tempest-VolumesNegativeTest-1101616844 tempest-VolumesNegativeTest-1101616844-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:12:00.457835 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-a45c87d8-a5fd-4222-b809-9161ed4c335b tempest-VolumesNegativeTest-1101616844 tempest-VolumesNegativeTest-1101616844-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:12:00.458377 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-a45c87d8-a5fd-4222-b809-9161ed4c335b tempest-VolumesNegativeTest-1101616844 tempest-VolumesNegativeTest-1101616844-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:12:00.458810 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-a45c87d8-a5fd-4222-b809-9161ed4c335b tempest-VolumesNegativeTest-1101616844 tempest-VolumesNegativeTest-1101616844-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:12:00.482001 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-fd6abe07-d7e1-4421-ba97-ce2866aac681 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Calling method '>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:12:00.482621 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-fd6abe07-d7e1-4421-ba97-ce2866aac681 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] [instance: 0548a3eb-e119-482c-ac70-04fbc6f83bf7] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:12:00.491791 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-fd6abe07-d7e1-4421-ba97-ce2866aac681 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:12:00.492675 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-fd6abe07-d7e1-4421-ba97-ce2866aac681 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:12:00.493324 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-fd6abe07-d7e1-4421-ba97-ce2866aac681 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:12:00.494240 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-fd6abe07-d7e1-4421-ba97-ce2866aac681 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:12:00.497903 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-fd6abe07-d7e1-4421-ba97-ce2866aac681 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:12:00.498572 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-fd6abe07-d7e1-4421-ba97-ce2866aac681 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:12:00.755382 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-fd6abe07-d7e1-4421-ba97-ce2866aac681 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '454203f47b434cca952a1cef56de559f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7312d0ac9248f2bfbece5611913ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:12:00.764779 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-fd6abe07-d7e1-4421-ba97-ce2866aac681 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] 10.222.0.23 "GET /compute/v2.1/servers/0548a3eb-e119-482c-ac70-04fbc6f83bf7" status: 200 len: 1502 microversion: 2.1 time: 0.293832 Oct 13 13:12:00.771409 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 121/259] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:12:00 2022] GET /compute/v2.1/servers/0548a3eb-e119-482c-ac70-04fbc6f83bf7 => generated 1502 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:12:00.782399 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-a45c87d8-a5fd-4222-b809-9161ed4c335b tempest-VolumesNegativeTest-1101616844 tempest-VolumesNegativeTest-1101616844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd5dc5471e5246f4878f1d91d59b68f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e74136856dcf42c48689e6976f16caad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:12:00.807374 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-04a1c0d2-02c6-4c01-b932-fdfd0181e5de tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d62c227d-954c-4db5-a851-f78d5750c3ee"}} {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 13:12:00.810611 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-04a1c0d2-02c6-4c01-b932-fdfd0181e5de tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] [instance: 0548a3eb-e119-482c-ac70-04fbc6f83bf7] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:12:00.828689 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-04a1c0d2-02c6-4c01-b932-fdfd0181e5de tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:12:00.829190 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-04a1c0d2-02c6-4c01-b932-fdfd0181e5de tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:12:00.829647 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-04a1c0d2-02c6-4c01-b932-fdfd0181e5de tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:12:00.830343 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-04a1c0d2-02c6-4c01-b932-fdfd0181e5de tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:12:00.830965 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-04a1c0d2-02c6-4c01-b932-fdfd0181e5de tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:12:00.831352 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-04a1c0d2-02c6-4c01-b932-fdfd0181e5de tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:12:00.832801 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-a45c87d8-a5fd-4222-b809-9161ed4c335b tempest-VolumesNegativeTest-1101616844 tempest-VolumesNegativeTest-1101616844-project] 10.222.0.23 "GET /compute/v2.1/servers/452465c5-d313-4698-a666-9e814920b8fd" status: 200 len: 1315 microversion: 2.1 time: 0.395351 Oct 13 13:12:00.833914 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 139/260] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:12:00 2022] GET /compute/v2.1/servers/452465c5-d313-4698-a666-9e814920b8fd => generated 1315 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:12:00.864488 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-86047b5a-bc9f-47a7-a1a8-8b3280dd1d9c tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Calling method '>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:12:00.865388 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-86047b5a-bc9f-47a7-a1a8-8b3280dd1d9c tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] [instance: 26bd475b-3495-4669-9985-d4a7dedb4bbf] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:12:00.877193 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-86047b5a-bc9f-47a7-a1a8-8b3280dd1d9c tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:12:00.881015 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-86047b5a-bc9f-47a7-a1a8-8b3280dd1d9c tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:12:00.881761 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-86047b5a-bc9f-47a7-a1a8-8b3280dd1d9c tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:12:00.884110 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-86047b5a-bc9f-47a7-a1a8-8b3280dd1d9c tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:12:00.885460 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-86047b5a-bc9f-47a7-a1a8-8b3280dd1d9c tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:12:00.886020 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-86047b5a-bc9f-47a7-a1a8-8b3280dd1d9c tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:12:00.920033 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.wsgi [None req-04a1c0d2-02c6-4c01-b932-fdfd0181e5de tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] HTTP exception thrown: Cannot 'attach_volume' instance 0548a3eb-e119-482c-ac70-04fbc6f83bf7 while it is in vm_state rescued Oct 13 13:12:00.922047 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-04a1c0d2-02c6-4c01-b932-fdfd0181e5de tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Request method failure captured: Oct 13 13:12:00.922047 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: request: POST /compute/v2.1/servers/0548a3eb-e119-482c-ac70-04fbc6f83bf7/os-volume_attachments HTTP/1.1 Oct 13 13:12:00.922047 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: Accept: application/json Oct 13 13:12:00.922047 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: Accept-Encoding: identity Oct 13 13:12:00.922047 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: Connection: close Oct 13 13:12:00.922047 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: Content-Length: 74 Oct 13 13:12:00.922047 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: Content-Type: application/json Oct 13 13:12:00.922047 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: Host: 10.222.0.23 Oct 13 13:12:00.922047 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: Openstack-System-Scope: None Oct 13 13:12:00.922047 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: User-Agent: python-urllib3/1.26.12 Oct 13 13:12:00.922047 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Auth-Token: gAAAAABjSA4svM9mETgfaOiuUXJIEReF5lLu9fPZCd8DzHzDMjsgoKCuGBBfmSl0ftubwAnibGB2dnB8E_e8xQKe1PCHs7Ng4fH6y7rFwijiKdlg3jwpLv7Ts_hAoMDCd_X3SSeHFWudl61mtpIoaIAJsH8UQKtB4J3uZqOXyPx22DWeiRT4uVg Oct 13 13:12:00.922047 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Domain-Id: None Oct 13 13:12:00.922047 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Domain-Name: None Oct 13 13:12:00.922047 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Identity-Status: Confirmed Oct 13 13:12:00.922047 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Is-Admin-Project: True Oct 13 13:12:00.922047 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Project-Domain-Id: default Oct 13 13:12:00.922047 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Project-Domain-Name: Default Oct 13 13:12:00.922047 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Project-Id: 5e7312d0ac9248f2bfbece5611913ab2 Oct 13 13:12:00.922047 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-633823286 Oct 13 13:12:00.922047 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Role: reader,member Oct 13 13:12:00.922047 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Roles: reader,member Oct 13 13:12:00.923634 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_5e7312d0ac9248f2bfbece5611913ab2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/5e7312d0ac9248f2bfbece5611913ab2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/5e7312d0ac9248f2bfbece5611913ab2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/5e7312d0ac9248f2bfbece5611913ab2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}] Oct 13 13:12:00.923634 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Tenant: tempest-ServerRescueNegativeTestJSON-633823286 Oct 13 13:12:00.923634 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Tenant-Id: 5e7312d0ac9248f2bfbece5611913ab2 Oct 13 13:12:00.923634 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-633823286 Oct 13 13:12:00.923634 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-User: tempest-ServerRescueNegativeTestJSON-633823286-project Oct 13 13:12:00.923634 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-User-Domain-Id: default Oct 13 13:12:00.923634 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-User-Domain-Name: Default Oct 13 13:12:00.923634 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-User-Id: 454203f47b434cca952a1cef56de559f Oct 13 13:12:00.923634 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-User-Name: tempest-ServerRescueNegativeTestJSON-633823286-project Oct 13 13:12:00.923634 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: Oct 13 13:12:00.923634 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: {"volumeAttachment": {"volumeId": "d62c227d-954c-4db5-a851-f78d5750c3ee"}} Oct 13 13:12:00.923634 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: method: > Oct 13 13:12:00.924529 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: exception: Cannot 'attach_volume' instance 0548a3eb-e119-482c-ac70-04fbc6f83bf7 while it is in vm_state rescued Oct 13 13:12:00.924529 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: action_args: {'server_id': '0548a3eb-e119-482c-ac70-04fbc6f83bf7', 'body': {'volumeAttachment': {'volumeId': 'd62c227d-954c-4db5-a851-f78d5750c3ee'}}} Oct 13 13:12:00.924529 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 13:12:00.924529 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 13:12:00.924529 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Oct 13 13:12:00.924529 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Oct 13 13:12:00.924529 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 13 13:12:00.924529 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 13 13:12:00.924529 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 13 13:12:00.924529 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 13 13:12:00.924529 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 0548a3eb-e119-482c-ac70-04fbc6f83bf7 in vm_state rescued. Cannot attach_volume while the instance is in this state. Oct 13 13:12:00.924529 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi Oct 13 13:12:00.924529 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 13:12:00.924529 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi Oct 13 13:12:00.924529 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 13:12:00.924529 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 13:12:00.924529 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 13:12:00.924529 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 13:12:00.924529 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 13:12:00.925644 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 13:12:00.925644 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 13:12:00.925644 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 13 13:12:00.925644 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 13 13:12:00.925644 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 13 13:12:00.925644 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 13 13:12:00.925644 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 13 13:12:00.925644 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 13 13:12:00.925644 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Oct 13 13:12:00.925644 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 13 13:12:00.925644 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 13 13:12:00.925644 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 13 13:12:00.925644 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 0548a3eb-e119-482c-ac70-04fbc6f83bf7 while it is in vm_state rescued Oct 13 13:12:00.925644 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi Oct 13 13:12:00.925644 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 13:12:00.925644 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi Oct 13 13:12:00.925644 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 13:12:00.925644 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 13:12:00.925644 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 13:12:00.927839 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 13:12:00.927839 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 13:12:00.927839 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 0548a3eb-e119-482c-ac70-04fbc6f83bf7 while it is in vm_state rescued Oct 13 13:12:00.927839 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi Oct 13 13:12:00.927839 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-04a1c0d2-02c6-4c01-b932-fdfd0181e5de tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Returning 409 to user: Cannot 'attach_volume' instance 0548a3eb-e119-482c-ac70-04fbc6f83bf7 while it is in vm_state rescued {{(pid=118815) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 13:12:00.927839 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-04a1c0d2-02c6-4c01-b932-fdfd0181e5de tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] 10.222.0.23 "POST /compute/v2.1/servers/0548a3eb-e119-482c-ac70-04fbc6f83bf7/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.129158 Oct 13 13:12:00.927839 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 122/261] 10.222.0.23 () {60 vars in 1323 bytes} [Thu Oct 13 13:12:00 2022] POST /compute/v2.1/servers/0548a3eb-e119-482c-ac70-04fbc6f83bf7/os-volume_attachments => generated 152 bytes in 131 msecs (HTTP/1.1 409) 9 headers in 378 bytes (3 switches on core 0) Oct 13 13:12:00.930697 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG dbcounter [-] [118814] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118814) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:12:00.940496 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-88e072d3-e1f7-45f6-9d9e-6789c6a4a096 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 13:12:00.943563 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-88e072d3-e1f7-45f6-9d9e-6789c6a4a096 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] [instance: 0548a3eb-e119-482c-ac70-04fbc6f83bf7] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:12:00.952772 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-88e072d3-e1f7-45f6-9d9e-6789c6a4a096 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:12:00.953797 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-88e072d3-e1f7-45f6-9d9e-6789c6a4a096 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:12:00.956649 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-88e072d3-e1f7-45f6-9d9e-6789c6a4a096 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:12:00.960538 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-88e072d3-e1f7-45f6-9d9e-6789c6a4a096 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:12:00.961229 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-88e072d3-e1f7-45f6-9d9e-6789c6a4a096 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:12:00.961879 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-88e072d3-e1f7-45f6-9d9e-6789c6a4a096 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:12:01.103847 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-86047b5a-bc9f-47a7-a1a8-8b3280dd1d9c tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:12:01.116961 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-88e072d3-e1f7-45f6-9d9e-6789c6a4a096 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] 10.222.0.23 "POST /compute/v2.1/servers/0548a3eb-e119-482c-ac70-04fbc6f83bf7/action" status: 202 len: 0 microversion: 2.1 time: 0.187240 Oct 13 13:12:01.119947 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-86047b5a-bc9f-47a7-a1a8-8b3280dd1d9c tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:12:01.121626 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 123/262] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Oct 13 13:12:00 2022] POST /compute/v2.1/servers/0548a3eb-e119-482c-ac70-04fbc6f83bf7/action => generated 0 bytes in 193 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 13 13:12:01.134974 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-86047b5a-bc9f-47a7-a1a8-8b3280dd1d9c tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:12:01.136328 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-86047b5a-bc9f-47a7-a1a8-8b3280dd1d9c tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] 10.222.0.23 "GET /compute/v2.1/servers/26bd475b-3495-4669-9985-d4a7dedb4bbf" status: 200 len: 1724 microversion: 2.20 time: 0.281411 Oct 13 13:12:01.136916 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 140/263] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 13:12:00 2022] GET /compute/v2.1/servers/26bd475b-3495-4669-9985-d4a7dedb4bbf => generated 1724 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 13:12:01.140877 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-56ecba88-f5e3-4085-a65f-4930d1dc3178 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Calling method '>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:12:01.145752 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-56ecba88-f5e3-4085-a65f-4930d1dc3178 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] [instance: e125ab44-9111-4260-909d-95d57b7861a7] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:12:01.154209 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-586f3995-218d-4454-a9c7-ffba26eaa110 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Calling method '>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:12:01.155257 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-586f3995-218d-4454-a9c7-ffba26eaa110 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] [instance: 0548a3eb-e119-482c-ac70-04fbc6f83bf7] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:12:01.164206 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-56ecba88-f5e3-4085-a65f-4930d1dc3178 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:12:01.164960 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-56ecba88-f5e3-4085-a65f-4930d1dc3178 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:12:01.165558 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-56ecba88-f5e3-4085-a65f-4930d1dc3178 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:12:01.166424 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-56ecba88-f5e3-4085-a65f-4930d1dc3178 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:12:01.167027 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-56ecba88-f5e3-4085-a65f-4930d1dc3178 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:12:01.167681 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-56ecba88-f5e3-4085-a65f-4930d1dc3178 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:12:01.172655 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-586f3995-218d-4454-a9c7-ffba26eaa110 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:12:01.173108 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-586f3995-218d-4454-a9c7-ffba26eaa110 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:12:01.173643 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-586f3995-218d-4454-a9c7-ffba26eaa110 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:12:01.174360 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-586f3995-218d-4454-a9c7-ffba26eaa110 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:12:01.174832 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-586f3995-218d-4454-a9c7-ffba26eaa110 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:12:01.175423 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-586f3995-218d-4454-a9c7-ffba26eaa110 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:12:01.570766 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-586f3995-218d-4454-a9c7-ffba26eaa110 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '454203f47b434cca952a1cef56de559f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7312d0ac9248f2bfbece5611913ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:12:01.586227 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-586f3995-218d-4454-a9c7-ffba26eaa110 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] 10.222.0.23 "GET /compute/v2.1/servers/0548a3eb-e119-482c-ac70-04fbc6f83bf7" status: 200 len: 1510 microversion: 2.1 time: 0.448216 Oct 13 13:12:01.588945 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 141/264] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:12:01 2022] GET /compute/v2.1/servers/0548a3eb-e119-482c-ac70-04fbc6f83bf7 => generated 1510 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:12:01.618863 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-85afc55a-b8c8-494b-956d-758ae6005092 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Calling method '>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:12:01.623179 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-85afc55a-b8c8-494b-956d-758ae6005092 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] [instance: 6a4a7328-d884-4015-aadc-aa5062a77724] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:12:01.636646 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-85afc55a-b8c8-494b-956d-758ae6005092 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:12:01.637547 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-85afc55a-b8c8-494b-956d-758ae6005092 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:12:01.638115 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-85afc55a-b8c8-494b-956d-758ae6005092 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:12:01.640107 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-85afc55a-b8c8-494b-956d-758ae6005092 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:12:01.641726 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-85afc55a-b8c8-494b-956d-758ae6005092 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:12:01.642617 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-85afc55a-b8c8-494b-956d-758ae6005092 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:12:01.672148 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-56ecba88-f5e3-4085-a65f-4930d1dc3178 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e783caddcad473dbdd764919286e244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecd3d5d2a3a54a07ba64f1fea4846c40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:12:01.682693 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-56ecba88-f5e3-4085-a65f-4930d1dc3178 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] 10.222.0.23 "GET /compute/v2.1/servers/e125ab44-9111-4260-909d-95d57b7861a7" status: 200 len: 1724 microversion: 2.1 time: 0.557722 Oct 13 13:12:01.686511 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 124/265] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:12:01 2022] GET /compute/v2.1/servers/e125ab44-9111-4260-909d-95d57b7861a7 => generated 1724 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:12:01.854378 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.objects.instance [None req-85afc55a-b8c8-494b-956d-758ae6005092 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Lazy-loading 'services' on Instance uuid 6a4a7328-d884-4015-aadc-aa5062a77724 {{(pid=118814) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 13 13:12:01.862353 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-755b0fa2-9f47-4bd4-bd32-aaab2df9f43c tempest-VolumesNegativeTest-1101616844 tempest-VolumesNegativeTest-1101616844-project] Calling method '>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:12:01.863408 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-755b0fa2-9f47-4bd4-bd32-aaab2df9f43c tempest-VolumesNegativeTest-1101616844 tempest-VolumesNegativeTest-1101616844-project] [instance: 452465c5-d313-4698-a666-9e814920b8fd] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:12:01.876980 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-755b0fa2-9f47-4bd4-bd32-aaab2df9f43c tempest-VolumesNegativeTest-1101616844 tempest-VolumesNegativeTest-1101616844-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:12:01.877479 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-755b0fa2-9f47-4bd4-bd32-aaab2df9f43c tempest-VolumesNegativeTest-1101616844 tempest-VolumesNegativeTest-1101616844-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:12:01.880122 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-755b0fa2-9f47-4bd4-bd32-aaab2df9f43c tempest-VolumesNegativeTest-1101616844 tempest-VolumesNegativeTest-1101616844-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:12:01.881198 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-755b0fa2-9f47-4bd4-bd32-aaab2df9f43c tempest-VolumesNegativeTest-1101616844 tempest-VolumesNegativeTest-1101616844-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:12:01.884295 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-755b0fa2-9f47-4bd4-bd32-aaab2df9f43c tempest-VolumesNegativeTest-1101616844 tempest-VolumesNegativeTest-1101616844-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:12:01.885040 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-755b0fa2-9f47-4bd4-bd32-aaab2df9f43c tempest-VolumesNegativeTest-1101616844 tempest-VolumesNegativeTest-1101616844-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:12:02.048016 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-85afc55a-b8c8-494b-956d-758ae6005092 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] 10.222.0.23 "DELETE /compute/v2.1/servers/6a4a7328-d884-4015-aadc-aa5062a77724/os-volume_attachments/1398e7bd-8e79-4473-9e37-9fe50c2f6c6b" status: 202 len: 0 microversion: 2.1 time: 0.438696 Oct 13 13:12:02.048688 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 142/266] 10.222.0.23 () {58 vars in 1416 bytes} [Thu Oct 13 13:12:01 2022] DELETE /compute/v2.1/servers/6a4a7328-d884-4015-aadc-aa5062a77724/os-volume_attachments/1398e7bd-8e79-4473-9e37-9fe50c2f6c6b => generated 0 bytes in 459 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 13 13:12:02.164321 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-08df4429-3680-45f3-8a17-15442b07713f tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Calling method '>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:12:02.164688 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-08df4429-3680-45f3-8a17-15442b07713f tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] [instance: 26bd475b-3495-4669-9985-d4a7dedb4bbf] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:12:02.173778 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-08df4429-3680-45f3-8a17-15442b07713f tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:12:02.174276 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-08df4429-3680-45f3-8a17-15442b07713f tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:12:02.201687 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-08df4429-3680-45f3-8a17-15442b07713f tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:12:02.201687 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-08df4429-3680-45f3-8a17-15442b07713f tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:12:02.201687 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-08df4429-3680-45f3-8a17-15442b07713f tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:12:02.201687 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-08df4429-3680-45f3-8a17-15442b07713f tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:12:02.498419 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-08df4429-3680-45f3-8a17-15442b07713f tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:12:02.518159 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-08df4429-3680-45f3-8a17-15442b07713f tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:12:02.520757 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-08df4429-3680-45f3-8a17-15442b07713f tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:12:02.524049 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-08df4429-3680-45f3-8a17-15442b07713f tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] 10.222.0.23 "GET /compute/v2.1/servers/26bd475b-3495-4669-9985-d4a7dedb4bbf" status: 200 len: 1724 microversion: 2.20 time: 0.363658 Oct 13 13:12:02.524627 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 143/267] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 13:12:02 2022] GET /compute/v2.1/servers/26bd475b-3495-4669-9985-d4a7dedb4bbf => generated 1724 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 13 13:12:02.541399 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-755b0fa2-9f47-4bd4-bd32-aaab2df9f43c tempest-VolumesNegativeTest-1101616844 tempest-VolumesNegativeTest-1101616844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd5dc5471e5246f4878f1d91d59b68f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e74136856dcf42c48689e6976f16caad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:12:02.557368 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-755b0fa2-9f47-4bd4-bd32-aaab2df9f43c tempest-VolumesNegativeTest-1101616844 tempest-VolumesNegativeTest-1101616844-project] 10.222.0.23 "GET /compute/v2.1/servers/452465c5-d313-4698-a666-9e814920b8fd" status: 200 len: 1315 microversion: 2.1 time: 0.700584 Oct 13 13:12:02.558317 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 125/268] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:12:01 2022] GET /compute/v2.1/servers/452465c5-d313-4698-a666-9e814920b8fd => generated 1315 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:12:02.615497 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-6a33985b-9da5-4152-b21b-7863bcdf44d3 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Calling method '>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:12:02.616713 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-6a33985b-9da5-4152-b21b-7863bcdf44d3 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] [instance: 0548a3eb-e119-482c-ac70-04fbc6f83bf7] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:12:02.622938 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-6a33985b-9da5-4152-b21b-7863bcdf44d3 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:12:02.623452 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-6a33985b-9da5-4152-b21b-7863bcdf44d3 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:12:02.623892 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-6a33985b-9da5-4152-b21b-7863bcdf44d3 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:12:02.624636 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-6a33985b-9da5-4152-b21b-7863bcdf44d3 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:12:02.625066 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-6a33985b-9da5-4152-b21b-7863bcdf44d3 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:12:02.625495 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-6a33985b-9da5-4152-b21b-7863bcdf44d3 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:12:02.714378 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-d611f636-e796-487f-8026-391d16b2b7a1 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Calling method '>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:12:02.715734 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-d611f636-e796-487f-8026-391d16b2b7a1 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] [instance: e125ab44-9111-4260-909d-95d57b7861a7] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:12:02.723984 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-d611f636-e796-487f-8026-391d16b2b7a1 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:12:02.727769 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-d611f636-e796-487f-8026-391d16b2b7a1 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:12:02.731462 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-d611f636-e796-487f-8026-391d16b2b7a1 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:12:02.732455 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-d611f636-e796-487f-8026-391d16b2b7a1 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:12:02.735578 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-d611f636-e796-487f-8026-391d16b2b7a1 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:12:02.737607 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-d611f636-e796-487f-8026-391d16b2b7a1 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:12:02.930393 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-6a33985b-9da5-4152-b21b-7863bcdf44d3 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '454203f47b434cca952a1cef56de559f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7312d0ac9248f2bfbece5611913ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:12:02.954782 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-6a33985b-9da5-4152-b21b-7863bcdf44d3 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] 10.222.0.23 "GET /compute/v2.1/servers/0548a3eb-e119-482c-ac70-04fbc6f83bf7" status: 200 len: 1510 microversion: 2.1 time: 0.343794 Oct 13 13:12:02.970495 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 144/269] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:12:02 2022] GET /compute/v2.1/servers/0548a3eb-e119-482c-ac70-04fbc6f83bf7 => generated 1510 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:12:03.090006 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-d611f636-e796-487f-8026-391d16b2b7a1 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e783caddcad473dbdd764919286e244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecd3d5d2a3a54a07ba64f1fea4846c40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:12:03.105136 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-d611f636-e796-487f-8026-391d16b2b7a1 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] 10.222.0.23 "GET /compute/v2.1/servers/e125ab44-9111-4260-909d-95d57b7861a7" status: 200 len: 1724 microversion: 2.1 time: 0.394623 Oct 13 13:12:03.106759 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 126/270] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:12:02 2022] GET /compute/v2.1/servers/e125ab44-9111-4260-909d-95d57b7861a7 => generated 1724 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 13:12:03.552592 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-10434c7a-2bf0-4713-9679-3ac7aad2591d tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Calling method '>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:12:03.553488 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-10434c7a-2bf0-4713-9679-3ac7aad2591d tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] [instance: 26bd475b-3495-4669-9985-d4a7dedb4bbf] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:12:03.578331 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-10434c7a-2bf0-4713-9679-3ac7aad2591d tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:12:03.583484 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-b23b2faf-704a-456f-8903-4363888b8e9d tempest-VolumesNegativeTest-1101616844 tempest-VolumesNegativeTest-1101616844-project] Calling method '>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:12:03.584104 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-10434c7a-2bf0-4713-9679-3ac7aad2591d tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:12:03.584228 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-b23b2faf-704a-456f-8903-4363888b8e9d tempest-VolumesNegativeTest-1101616844 tempest-VolumesNegativeTest-1101616844-project] [instance: 452465c5-d313-4698-a666-9e814920b8fd] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:12:03.585593 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-10434c7a-2bf0-4713-9679-3ac7aad2591d tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:12:03.586483 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-10434c7a-2bf0-4713-9679-3ac7aad2591d tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:12:03.587306 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-10434c7a-2bf0-4713-9679-3ac7aad2591d tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:12:03.587898 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-10434c7a-2bf0-4713-9679-3ac7aad2591d tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:12:03.601864 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-b23b2faf-704a-456f-8903-4363888b8e9d tempest-VolumesNegativeTest-1101616844 tempest-VolumesNegativeTest-1101616844-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:12:03.602383 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-b23b2faf-704a-456f-8903-4363888b8e9d tempest-VolumesNegativeTest-1101616844 tempest-VolumesNegativeTest-1101616844-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:12:03.603981 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-b23b2faf-704a-456f-8903-4363888b8e9d tempest-VolumesNegativeTest-1101616844 tempest-VolumesNegativeTest-1101616844-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:12:03.604846 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-b23b2faf-704a-456f-8903-4363888b8e9d tempest-VolumesNegativeTest-1101616844 tempest-VolumesNegativeTest-1101616844-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:12:03.605319 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-b23b2faf-704a-456f-8903-4363888b8e9d tempest-VolumesNegativeTest-1101616844 tempest-VolumesNegativeTest-1101616844-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:12:03.608555 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-b23b2faf-704a-456f-8903-4363888b8e9d tempest-VolumesNegativeTest-1101616844 tempest-VolumesNegativeTest-1101616844-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:12:03.946238 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-b23b2faf-704a-456f-8903-4363888b8e9d tempest-VolumesNegativeTest-1101616844 tempest-VolumesNegativeTest-1101616844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd5dc5471e5246f4878f1d91d59b68f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e74136856dcf42c48689e6976f16caad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:12:03.959982 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-10434c7a-2bf0-4713-9679-3ac7aad2591d tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:12:03.965994 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-b23b2faf-704a-456f-8903-4363888b8e9d tempest-VolumesNegativeTest-1101616844 tempest-VolumesNegativeTest-1101616844-project] 10.222.0.23 "GET /compute/v2.1/servers/452465c5-d313-4698-a666-9e814920b8fd" status: 200 len: 1315 microversion: 2.1 time: 0.387794 Oct 13 13:12:03.972053 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 127/271] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:12:03 2022] GET /compute/v2.1/servers/452465c5-d313-4698-a666-9e814920b8fd => generated 1315 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:12:03.983347 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-10434c7a-2bf0-4713-9679-3ac7aad2591d tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:12:03.983347 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-10434c7a-2bf0-4713-9679-3ac7aad2591d tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:12:03.983347 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-10434c7a-2bf0-4713-9679-3ac7aad2591d tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] 10.222.0.23 "GET /compute/v2.1/servers/26bd475b-3495-4669-9985-d4a7dedb4bbf" status: 200 len: 1724 microversion: 2.20 time: 0.433074 Oct 13 13:12:03.996055 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 145/272] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 13:12:03 2022] GET /compute/v2.1/servers/26bd475b-3495-4669-9985-d4a7dedb4bbf => generated 1724 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 13:12:03.999222 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-2f2c7f9b-dfd5-49ba-ada3-96267c105bfd tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Calling method '>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:12:04.001466 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-2f2c7f9b-dfd5-49ba-ada3-96267c105bfd tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] [instance: 0548a3eb-e119-482c-ac70-04fbc6f83bf7] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:12:04.017006 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-2f2c7f9b-dfd5-49ba-ada3-96267c105bfd tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:12:04.017503 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-2f2c7f9b-dfd5-49ba-ada3-96267c105bfd tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:12:04.017936 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-2f2c7f9b-dfd5-49ba-ada3-96267c105bfd tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:12:04.018647 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-2f2c7f9b-dfd5-49ba-ada3-96267c105bfd tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:12:04.019126 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-2f2c7f9b-dfd5-49ba-ada3-96267c105bfd tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:12:04.019550 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-2f2c7f9b-dfd5-49ba-ada3-96267c105bfd tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:12:04.128382 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-ac516b3e-ef82-4dbd-bb75-757a4a561687 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Calling method '>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:12:04.129203 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-ac516b3e-ef82-4dbd-bb75-757a4a561687 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] [instance: e125ab44-9111-4260-909d-95d57b7861a7] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:12:04.138441 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-ac516b3e-ef82-4dbd-bb75-757a4a561687 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:12:04.138933 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-ac516b3e-ef82-4dbd-bb75-757a4a561687 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:12:04.139410 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-ac516b3e-ef82-4dbd-bb75-757a4a561687 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:12:04.140118 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-ac516b3e-ef82-4dbd-bb75-757a4a561687 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:12:04.140576 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-ac516b3e-ef82-4dbd-bb75-757a4a561687 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:12:04.141003 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-ac516b3e-ef82-4dbd-bb75-757a4a561687 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:12:04.310735 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-2f2c7f9b-dfd5-49ba-ada3-96267c105bfd tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '454203f47b434cca952a1cef56de559f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7312d0ac9248f2bfbece5611913ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:12:04.321171 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-2f2c7f9b-dfd5-49ba-ada3-96267c105bfd tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] 10.222.0.23 "GET /compute/v2.1/servers/0548a3eb-e119-482c-ac70-04fbc6f83bf7" status: 200 len: 1510 microversion: 2.1 time: 0.329770 Oct 13 13:12:04.321781 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 128/273] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:12:03 2022] GET /compute/v2.1/servers/0548a3eb-e119-482c-ac70-04fbc6f83bf7 => generated 1510 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:12:04.414162 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-9924b4a9-58d8-42d0-bde1-76d5735383f9 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Calling method '>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:12:04.414900 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-9924b4a9-58d8-42d0-bde1-76d5735383f9 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] [instance: 6a4a7328-d884-4015-aadc-aa5062a77724] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:12:04.420990 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-9924b4a9-58d8-42d0-bde1-76d5735383f9 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:12:04.421715 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-9924b4a9-58d8-42d0-bde1-76d5735383f9 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:12:04.422323 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-9924b4a9-58d8-42d0-bde1-76d5735383f9 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:12:04.423203 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-9924b4a9-58d8-42d0-bde1-76d5735383f9 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:12:04.423805 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-9924b4a9-58d8-42d0-bde1-76d5735383f9 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:12:04.424379 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-9924b4a9-58d8-42d0-bde1-76d5735383f9 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:12:04.441082 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-ac516b3e-ef82-4dbd-bb75-757a4a561687 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e783caddcad473dbdd764919286e244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecd3d5d2a3a54a07ba64f1fea4846c40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:12:04.452355 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-ac516b3e-ef82-4dbd-bb75-757a4a561687 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] 10.222.0.23 "GET /compute/v2.1/servers/e125ab44-9111-4260-909d-95d57b7861a7" status: 200 len: 1724 microversion: 2.1 time: 0.327765 Oct 13 13:12:04.453873 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 146/274] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:12:04 2022] GET /compute/v2.1/servers/e125ab44-9111-4260-909d-95d57b7861a7 => generated 1724 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 13:12:04.480075 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-9924b4a9-58d8-42d0-bde1-76d5735383f9 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] [instance: 6a4a7328-d884-4015-aadc-aa5062a77724] Going to try to terminate instance {{(pid=118815) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 13 13:12:04.611508 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-9924b4a9-58d8-42d0-bde1-76d5735383f9 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] 10.222.0.23 "DELETE /compute/v2.1/servers/6a4a7328-d884-4015-aadc-aa5062a77724" status: 204 len: 0 microversion: 2.1 time: 0.200678 Oct 13 13:12:04.612097 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 129/275] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Oct 13 13:12:04 2022] DELETE /compute/v2.1/servers/6a4a7328-d884-4015-aadc-aa5062a77724 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 13 13:12:04.620920 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-8856e085-b2a6-4628-9fec-c4338ff28fee tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Calling method '>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:12:04.621951 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-8856e085-b2a6-4628-9fec-c4338ff28fee tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] [instance: 6a4a7328-d884-4015-aadc-aa5062a77724] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:12:04.636956 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-8856e085-b2a6-4628-9fec-c4338ff28fee tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:12:04.641210 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-8856e085-b2a6-4628-9fec-c4338ff28fee tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:12:04.642260 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-8856e085-b2a6-4628-9fec-c4338ff28fee tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:12:04.643253 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-8856e085-b2a6-4628-9fec-c4338ff28fee tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:12:04.643883 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-8856e085-b2a6-4628-9fec-c4338ff28fee tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:12:04.646238 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-8856e085-b2a6-4628-9fec-c4338ff28fee tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:12:04.891881 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-8856e085-b2a6-4628-9fec-c4338ff28fee tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8569afc405f24a0993a023c818a0c272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f85144e13e254365a86aa785093c8575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:12:04.901430 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-8856e085-b2a6-4628-9fec-c4338ff28fee tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] 10.222.0.23 "GET /compute/v2.1/servers/6a4a7328-d884-4015-aadc-aa5062a77724" status: 200 len: 1513 microversion: 2.1 time: 0.284879 Oct 13 13:12:04.906498 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 147/276] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:12:04 2022] GET /compute/v2.1/servers/6a4a7328-d884-4015-aadc-aa5062a77724 => generated 1513 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:12:05.018188 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-66518bc3-f211-4007-acb9-a2eed86d1b88 tempest-VolumesNegativeTest-1101616844 tempest-VolumesNegativeTest-1101616844-project] Calling method '>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:12:05.019799 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-5a2ac5b3-e1dd-4079-9149-e65e2b72ea27 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Calling method '>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:12:05.020973 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-66518bc3-f211-4007-acb9-a2eed86d1b88 tempest-VolumesNegativeTest-1101616844 tempest-VolumesNegativeTest-1101616844-project] [instance: 452465c5-d313-4698-a666-9e814920b8fd] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:12:05.022220 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-5a2ac5b3-e1dd-4079-9149-e65e2b72ea27 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] [instance: 26bd475b-3495-4669-9985-d4a7dedb4bbf] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:12:05.045549 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-66518bc3-f211-4007-acb9-a2eed86d1b88 tempest-VolumesNegativeTest-1101616844 tempest-VolumesNegativeTest-1101616844-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:12:05.046092 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-66518bc3-f211-4007-acb9-a2eed86d1b88 tempest-VolumesNegativeTest-1101616844 tempest-VolumesNegativeTest-1101616844-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:12:05.048233 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-5a2ac5b3-e1dd-4079-9149-e65e2b72ea27 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:12:05.049405 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-66518bc3-f211-4007-acb9-a2eed86d1b88 tempest-VolumesNegativeTest-1101616844 tempest-VolumesNegativeTest-1101616844-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:12:05.050609 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-5a2ac5b3-e1dd-4079-9149-e65e2b72ea27 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:12:05.051687 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-5a2ac5b3-e1dd-4079-9149-e65e2b72ea27 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:12:05.052981 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-5a2ac5b3-e1dd-4079-9149-e65e2b72ea27 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:12:05.053351 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-66518bc3-f211-4007-acb9-a2eed86d1b88 tempest-VolumesNegativeTest-1101616844 tempest-VolumesNegativeTest-1101616844-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:12:05.053840 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-5a2ac5b3-e1dd-4079-9149-e65e2b72ea27 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:12:05.054444 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-5a2ac5b3-e1dd-4079-9149-e65e2b72ea27 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:12:05.054636 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-66518bc3-f211-4007-acb9-a2eed86d1b88 tempest-VolumesNegativeTest-1101616844 tempest-VolumesNegativeTest-1101616844-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:12:05.057144 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-66518bc3-f211-4007-acb9-a2eed86d1b88 tempest-VolumesNegativeTest-1101616844 tempest-VolumesNegativeTest-1101616844-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:12:05.337782 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-66518bc3-f211-4007-acb9-a2eed86d1b88 tempest-VolumesNegativeTest-1101616844 tempest-VolumesNegativeTest-1101616844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd5dc5471e5246f4878f1d91d59b68f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e74136856dcf42c48689e6976f16caad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:12:05.359122 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-66518bc3-f211-4007-acb9-a2eed86d1b88 tempest-VolumesNegativeTest-1101616844 tempest-VolumesNegativeTest-1101616844-project] 10.222.0.23 "GET /compute/v2.1/servers/452465c5-d313-4698-a666-9e814920b8fd" status: 200 len: 1315 microversion: 2.1 time: 0.363092 Oct 13 13:12:05.360142 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 130/277] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:12:04 2022] GET /compute/v2.1/servers/452465c5-d313-4698-a666-9e814920b8fd => generated 1315 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:12:05.371485 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-5a2ac5b3-e1dd-4079-9149-e65e2b72ea27 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:12:05.386160 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-5a2ac5b3-e1dd-4079-9149-e65e2b72ea27 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:12:05.390646 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-3bacf7f9-e19f-4022-97f4-c84c2f78f7f3 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Calling method '>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:12:05.391299 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-3bacf7f9-e19f-4022-97f4-c84c2f78f7f3 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] [instance: 0548a3eb-e119-482c-ac70-04fbc6f83bf7] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:12:05.399817 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-5a2ac5b3-e1dd-4079-9149-e65e2b72ea27 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:12:05.401335 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-5a2ac5b3-e1dd-4079-9149-e65e2b72ea27 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] 10.222.0.23 "GET /compute/v2.1/servers/26bd475b-3495-4669-9985-d4a7dedb4bbf" status: 200 len: 1724 microversion: 2.20 time: 0.397283 Oct 13 13:12:05.415843 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-3bacf7f9-e19f-4022-97f4-c84c2f78f7f3 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:12:05.423422 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 148/278] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 13:12:05 2022] GET /compute/v2.1/servers/26bd475b-3495-4669-9985-d4a7dedb4bbf => generated 1724 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 13:12:05.424028 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-3bacf7f9-e19f-4022-97f4-c84c2f78f7f3 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:12:05.424705 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-3bacf7f9-e19f-4022-97f4-c84c2f78f7f3 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:12:05.425809 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-3bacf7f9-e19f-4022-97f4-c84c2f78f7f3 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:12:05.426754 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-3bacf7f9-e19f-4022-97f4-c84c2f78f7f3 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:12:05.427515 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-3bacf7f9-e19f-4022-97f4-c84c2f78f7f3 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:12:05.431035 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG dbcounter [-] [118815] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=118815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:12:05.477674 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-e0ae497d-8325-4fdd-9e91-bc4e9ef9cb66 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Calling method '>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:12:05.478859 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-e0ae497d-8325-4fdd-9e91-bc4e9ef9cb66 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] [instance: e125ab44-9111-4260-909d-95d57b7861a7] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:12:05.491117 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-e0ae497d-8325-4fdd-9e91-bc4e9ef9cb66 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:12:05.491615 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-e0ae497d-8325-4fdd-9e91-bc4e9ef9cb66 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:12:05.492233 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-e0ae497d-8325-4fdd-9e91-bc4e9ef9cb66 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:12:05.493111 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-e0ae497d-8325-4fdd-9e91-bc4e9ef9cb66 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:12:05.493570 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-e0ae497d-8325-4fdd-9e91-bc4e9ef9cb66 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:12:05.494003 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-e0ae497d-8325-4fdd-9e91-bc4e9ef9cb66 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:12:05.782707 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-3bacf7f9-e19f-4022-97f4-c84c2f78f7f3 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '454203f47b434cca952a1cef56de559f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7312d0ac9248f2bfbece5611913ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:12:05.792605 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-3bacf7f9-e19f-4022-97f4-c84c2f78f7f3 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] 10.222.0.23 "GET /compute/v2.1/servers/0548a3eb-e119-482c-ac70-04fbc6f83bf7" status: 200 len: 1510 microversion: 2.1 time: 0.431311 Oct 13 13:12:05.793532 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 131/279] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:12:05 2022] GET /compute/v2.1/servers/0548a3eb-e119-482c-ac70-04fbc6f83bf7 => generated 1510 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:12:05.813975 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-e0ae497d-8325-4fdd-9e91-bc4e9ef9cb66 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e783caddcad473dbdd764919286e244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecd3d5d2a3a54a07ba64f1fea4846c40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:12:05.822992 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-e0ae497d-8325-4fdd-9e91-bc4e9ef9cb66 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] 10.222.0.23 "GET /compute/v2.1/servers/e125ab44-9111-4260-909d-95d57b7861a7" status: 200 len: 1724 microversion: 2.1 time: 0.349983 Oct 13 13:12:05.824112 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 149/280] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:12:05 2022] GET /compute/v2.1/servers/e125ab44-9111-4260-909d-95d57b7861a7 => generated 1724 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:12:05.926501 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-445b1e45-fb01-4684-a80d-8087026fe06a tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Calling method '>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:12:05.927139 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-445b1e45-fb01-4684-a80d-8087026fe06a tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] [instance: 6a4a7328-d884-4015-aadc-aa5062a77724] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:12:05.934812 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-445b1e45-fb01-4684-a80d-8087026fe06a tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:12:05.944288 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-445b1e45-fb01-4684-a80d-8087026fe06a tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:12:05.944784 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-445b1e45-fb01-4684-a80d-8087026fe06a tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:12:05.945535 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-445b1e45-fb01-4684-a80d-8087026fe06a tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:12:05.946004 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-445b1e45-fb01-4684-a80d-8087026fe06a tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:12:05.946464 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-445b1e45-fb01-4684-a80d-8087026fe06a tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:12:06.150081 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-445b1e45-fb01-4684-a80d-8087026fe06a tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8569afc405f24a0993a023c818a0c272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f85144e13e254365a86aa785093c8575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:12:06.159864 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-445b1e45-fb01-4684-a80d-8087026fe06a tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] 10.222.0.23 "GET /compute/v2.1/servers/6a4a7328-d884-4015-aadc-aa5062a77724" status: 200 len: 1513 microversion: 2.1 time: 0.237453 Oct 13 13:12:06.160581 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 132/281] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:12:05 2022] GET /compute/v2.1/servers/6a4a7328-d884-4015-aadc-aa5062a77724 => generated 1513 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:12:06.402563 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-e79793e7-708f-4b4f-be1e-35d490288fa3 tempest-VolumesNegativeTest-1101616844 tempest-VolumesNegativeTest-1101616844-project] Calling method '>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:12:06.403159 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-e79793e7-708f-4b4f-be1e-35d490288fa3 tempest-VolumesNegativeTest-1101616844 tempest-VolumesNegativeTest-1101616844-project] [instance: 452465c5-d313-4698-a666-9e814920b8fd] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:12:06.409259 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-e79793e7-708f-4b4f-be1e-35d490288fa3 tempest-VolumesNegativeTest-1101616844 tempest-VolumesNegativeTest-1101616844-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:12:06.409749 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-e79793e7-708f-4b4f-be1e-35d490288fa3 tempest-VolumesNegativeTest-1101616844 tempest-VolumesNegativeTest-1101616844-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:12:06.410184 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-e79793e7-708f-4b4f-be1e-35d490288fa3 tempest-VolumesNegativeTest-1101616844 tempest-VolumesNegativeTest-1101616844-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:12:06.410918 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-e79793e7-708f-4b4f-be1e-35d490288fa3 tempest-VolumesNegativeTest-1101616844 tempest-VolumesNegativeTest-1101616844-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:12:06.411471 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-e79793e7-708f-4b4f-be1e-35d490288fa3 tempest-VolumesNegativeTest-1101616844 tempest-VolumesNegativeTest-1101616844-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:12:06.411896 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-e79793e7-708f-4b4f-be1e-35d490288fa3 tempest-VolumesNegativeTest-1101616844 tempest-VolumesNegativeTest-1101616844-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:12:06.430577 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-b5b6112a-1a75-4fe3-adfb-7cd90721ffa9 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Calling method '>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:12:06.434259 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-b5b6112a-1a75-4fe3-adfb-7cd90721ffa9 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] [instance: 26bd475b-3495-4669-9985-d4a7dedb4bbf] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:12:06.446303 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-b5b6112a-1a75-4fe3-adfb-7cd90721ffa9 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:12:06.451856 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-b5b6112a-1a75-4fe3-adfb-7cd90721ffa9 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:12:06.452636 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-b5b6112a-1a75-4fe3-adfb-7cd90721ffa9 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:12:06.453776 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-b5b6112a-1a75-4fe3-adfb-7cd90721ffa9 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:12:06.454601 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-b5b6112a-1a75-4fe3-adfb-7cd90721ffa9 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:12:06.455625 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-b5b6112a-1a75-4fe3-adfb-7cd90721ffa9 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:12:06.662787 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-b5b6112a-1a75-4fe3-adfb-7cd90721ffa9 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:12:06.671300 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-b5b6112a-1a75-4fe3-adfb-7cd90721ffa9 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:12:06.674176 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-b5b6112a-1a75-4fe3-adfb-7cd90721ffa9 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:12:06.680793 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-b5b6112a-1a75-4fe3-adfb-7cd90721ffa9 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] 10.222.0.23 "GET /compute/v2.1/servers/26bd475b-3495-4669-9985-d4a7dedb4bbf" status: 200 len: 1724 microversion: 2.20 time: 0.254872 Oct 13 13:12:06.681579 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 133/282] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 13:12:06 2022] GET /compute/v2.1/servers/26bd475b-3495-4669-9985-d4a7dedb4bbf => generated 1724 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 13 13:12:06.716854 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-e79793e7-708f-4b4f-be1e-35d490288fa3 tempest-VolumesNegativeTest-1101616844 tempest-VolumesNegativeTest-1101616844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd5dc5471e5246f4878f1d91d59b68f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e74136856dcf42c48689e6976f16caad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:12:06.726027 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-e79793e7-708f-4b4f-be1e-35d490288fa3 tempest-VolumesNegativeTest-1101616844 tempest-VolumesNegativeTest-1101616844-project] 10.222.0.23 "GET /compute/v2.1/servers/452465c5-d313-4698-a666-9e814920b8fd" status: 200 len: 1315 microversion: 2.1 time: 0.328099 Oct 13 13:12:06.727503 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 150/283] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:12:06 2022] GET /compute/v2.1/servers/452465c5-d313-4698-a666-9e814920b8fd => generated 1315 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:12:06.817163 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-4d31c040-d18c-45d4-af9a-e53f4580dbc5 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Calling method '>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:12:06.818109 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-4d31c040-d18c-45d4-af9a-e53f4580dbc5 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] [instance: 0548a3eb-e119-482c-ac70-04fbc6f83bf7] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:12:06.828846 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-4d31c040-d18c-45d4-af9a-e53f4580dbc5 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:12:06.831772 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-4d31c040-d18c-45d4-af9a-e53f4580dbc5 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:12:06.833396 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-4d31c040-d18c-45d4-af9a-e53f4580dbc5 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:12:06.835325 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-4d31c040-d18c-45d4-af9a-e53f4580dbc5 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:12:06.836185 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-4d31c040-d18c-45d4-af9a-e53f4580dbc5 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:12:06.837734 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-4d31c040-d18c-45d4-af9a-e53f4580dbc5 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:12:06.850253 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-46c13d87-fa69-4a92-94bf-b801c9083e64 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Calling method '>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:12:06.850951 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-46c13d87-fa69-4a92-94bf-b801c9083e64 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] [instance: e125ab44-9111-4260-909d-95d57b7861a7] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:12:06.869222 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-46c13d87-fa69-4a92-94bf-b801c9083e64 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:12:06.872953 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-46c13d87-fa69-4a92-94bf-b801c9083e64 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:12:06.873465 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-46c13d87-fa69-4a92-94bf-b801c9083e64 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:12:06.874746 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-46c13d87-fa69-4a92-94bf-b801c9083e64 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:12:06.878577 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-46c13d87-fa69-4a92-94bf-b801c9083e64 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:12:06.879666 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-46c13d87-fa69-4a92-94bf-b801c9083e64 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:12:07.262921 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-46c13d87-fa69-4a92-94bf-b801c9083e64 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e783caddcad473dbdd764919286e244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecd3d5d2a3a54a07ba64f1fea4846c40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:12:07.272525 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-46c13d87-fa69-4a92-94bf-b801c9083e64 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] 10.222.0.23 "GET /compute/v2.1/servers/e125ab44-9111-4260-909d-95d57b7861a7" status: 200 len: 1724 microversion: 2.1 time: 0.427785 Oct 13 13:12:07.273682 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 151/284] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:12:06 2022] GET /compute/v2.1/servers/e125ab44-9111-4260-909d-95d57b7861a7 => generated 1724 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 13:12:07.278636 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [req-2194f6e7-7614-4c11-b467-eccb75113b5b req-05c59277-1465-4d92-94e6-27b10964a1a1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "452465c5-d313-4698-a666-9e814920b8fd", "name": "network-vif-plugged", "status": "completed", "tag": "8ea6a73b-f96b-45c1-b3fd-3688afc99566"}]} {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 13:12:07.282522 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-4d31c040-d18c-45d4-af9a-e53f4580dbc5 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '454203f47b434cca952a1cef56de559f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7312d0ac9248f2bfbece5611913ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:12:07.289085 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [req-2194f6e7-7614-4c11-b467-eccb75113b5b req-05c59277-1465-4d92-94e6-27b10964a1a1 service nova] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:12:07.289843 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [req-2194f6e7-7614-4c11-b467-eccb75113b5b req-05c59277-1465-4d92-94e6-27b10964a1a1 service nova] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:12:07.290508 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [req-2194f6e7-7614-4c11-b467-eccb75113b5b req-05c59277-1465-4d92-94e6-27b10964a1a1 service nova] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:12:07.296105 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-4d31c040-d18c-45d4-af9a-e53f4580dbc5 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] 10.222.0.23 "GET /compute/v2.1/servers/0548a3eb-e119-482c-ac70-04fbc6f83bf7" status: 200 len: 1510 microversion: 2.1 time: 0.481272 Oct 13 13:12:07.309421 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 134/285] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:12:06 2022] GET /compute/v2.1/servers/0548a3eb-e119-482c-ac70-04fbc6f83bf7 => generated 1510 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:12:07.312859 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.compute.server_external_events [req-2194f6e7-7614-4c11-b467-eccb75113b5b req-05c59277-1465-4d92-94e6-27b10964a1a1 service nova] Creating event network-vif-plugged:8ea6a73b-f96b-45c1-b3fd-3688afc99566 for instance 452465c5-d313-4698-a666-9e814920b8fd on hv-cinder-82660 Oct 13 13:12:07.319171 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [req-2194f6e7-7614-4c11-b467-eccb75113b5b req-05c59277-1465-4d92-94e6-27b10964a1a1 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044020 Oct 13 13:12:07.320381 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 152/286] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 13:12:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 13:12:07.324367 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-3b90f64b-69ef-4bd1-b687-95960658f7e9 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Calling method '>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:12:07.325195 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-3b90f64b-69ef-4bd1-b687-95960658f7e9 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] [instance: 6a4a7328-d884-4015-aadc-aa5062a77724] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:12:07.331742 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-3b90f64b-69ef-4bd1-b687-95960658f7e9 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:12:07.332497 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-3b90f64b-69ef-4bd1-b687-95960658f7e9 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:12:07.333097 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-3b90f64b-69ef-4bd1-b687-95960658f7e9 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:12:07.333988 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-3b90f64b-69ef-4bd1-b687-95960658f7e9 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:12:07.334606 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-3b90f64b-69ef-4bd1-b687-95960658f7e9 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:12:07.335224 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-3b90f64b-69ef-4bd1-b687-95960658f7e9 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:12:07.503718 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-3b90f64b-69ef-4bd1-b687-95960658f7e9 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8569afc405f24a0993a023c818a0c272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f85144e13e254365a86aa785093c8575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:12:07.514431 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-3b90f64b-69ef-4bd1-b687-95960658f7e9 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] 10.222.0.23 "GET /compute/v2.1/servers/6a4a7328-d884-4015-aadc-aa5062a77724" status: 200 len: 1513 microversion: 2.1 time: 0.202966 Oct 13 13:12:07.515336 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 135/287] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:12:07 2022] GET /compute/v2.1/servers/6a4a7328-d884-4015-aadc-aa5062a77724 => generated 1513 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:12:07.708855 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-8d57a74e-920d-4c55-9216-31b57181abdd tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Calling method '>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:12:07.710079 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-8d57a74e-920d-4c55-9216-31b57181abdd tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] [instance: 26bd475b-3495-4669-9985-d4a7dedb4bbf] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:12:07.717481 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-8d57a74e-920d-4c55-9216-31b57181abdd tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:12:07.718301 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-8d57a74e-920d-4c55-9216-31b57181abdd tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:12:07.718954 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-8d57a74e-920d-4c55-9216-31b57181abdd tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:12:07.720635 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-8d57a74e-920d-4c55-9216-31b57181abdd tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:12:07.721207 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-8d57a74e-920d-4c55-9216-31b57181abdd tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:12:07.722181 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-8d57a74e-920d-4c55-9216-31b57181abdd tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:12:07.752717 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-a0735b46-f873-41f3-9bef-fd7ddeb2f154 tempest-VolumesNegativeTest-1101616844 tempest-VolumesNegativeTest-1101616844-project] Calling method '>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:12:07.753402 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-a0735b46-f873-41f3-9bef-fd7ddeb2f154 tempest-VolumesNegativeTest-1101616844 tempest-VolumesNegativeTest-1101616844-project] [instance: 452465c5-d313-4698-a666-9e814920b8fd] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:12:07.783970 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-a0735b46-f873-41f3-9bef-fd7ddeb2f154 tempest-VolumesNegativeTest-1101616844 tempest-VolumesNegativeTest-1101616844-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:12:07.784563 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-a0735b46-f873-41f3-9bef-fd7ddeb2f154 tempest-VolumesNegativeTest-1101616844 tempest-VolumesNegativeTest-1101616844-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:12:07.785071 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-a0735b46-f873-41f3-9bef-fd7ddeb2f154 tempest-VolumesNegativeTest-1101616844 tempest-VolumesNegativeTest-1101616844-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:12:07.790762 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-a0735b46-f873-41f3-9bef-fd7ddeb2f154 tempest-VolumesNegativeTest-1101616844 tempest-VolumesNegativeTest-1101616844-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:12:07.791381 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-a0735b46-f873-41f3-9bef-fd7ddeb2f154 tempest-VolumesNegativeTest-1101616844 tempest-VolumesNegativeTest-1101616844-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:12:07.791990 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-a0735b46-f873-41f3-9bef-fd7ddeb2f154 tempest-VolumesNegativeTest-1101616844 tempest-VolumesNegativeTest-1101616844-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:12:07.951547 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-8d57a74e-920d-4c55-9216-31b57181abdd tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:12:07.963866 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-8d57a74e-920d-4c55-9216-31b57181abdd tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:12:07.971785 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-8d57a74e-920d-4c55-9216-31b57181abdd tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:12:07.973084 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-8d57a74e-920d-4c55-9216-31b57181abdd tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] 10.222.0.23 "GET /compute/v2.1/servers/26bd475b-3495-4669-9985-d4a7dedb4bbf" status: 200 len: 1724 microversion: 2.20 time: 0.269026 Oct 13 13:12:07.973815 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 153/288] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 13:12:07 2022] GET /compute/v2.1/servers/26bd475b-3495-4669-9985-d4a7dedb4bbf => generated 1724 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 13:12:08.057432 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-a0735b46-f873-41f3-9bef-fd7ddeb2f154 tempest-VolumesNegativeTest-1101616844 tempest-VolumesNegativeTest-1101616844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd5dc5471e5246f4878f1d91d59b68f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e74136856dcf42c48689e6976f16caad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:12:08.079936 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-a0735b46-f873-41f3-9bef-fd7ddeb2f154 tempest-VolumesNegativeTest-1101616844 tempest-VolumesNegativeTest-1101616844-project] 10.222.0.23 "GET /compute/v2.1/servers/452465c5-d313-4698-a666-9e814920b8fd" status: 200 len: 1315 microversion: 2.1 time: 0.331064 Oct 13 13:12:08.085073 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 136/289] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:12:07 2022] GET /compute/v2.1/servers/452465c5-d313-4698-a666-9e814920b8fd => generated 1315 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 13:12:08.298207 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-060b54a3-289f-40ee-adee-bab36855ea31 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Calling method '>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:12:08.299145 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-060b54a3-289f-40ee-adee-bab36855ea31 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] [instance: e125ab44-9111-4260-909d-95d57b7861a7] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:12:08.311998 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-060b54a3-289f-40ee-adee-bab36855ea31 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:12:08.312768 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-060b54a3-289f-40ee-adee-bab36855ea31 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:12:08.313567 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-060b54a3-289f-40ee-adee-bab36855ea31 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:12:08.319894 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-be9d4137-c7de-4a47-834d-8e9b7cbe678d tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Calling method '>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:12:08.321068 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-be9d4137-c7de-4a47-834d-8e9b7cbe678d tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] [instance: 0548a3eb-e119-482c-ac70-04fbc6f83bf7] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:12:08.326016 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-060b54a3-289f-40ee-adee-bab36855ea31 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:12:08.326769 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-060b54a3-289f-40ee-adee-bab36855ea31 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:12:08.328285 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-060b54a3-289f-40ee-adee-bab36855ea31 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:12:08.334288 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-be9d4137-c7de-4a47-834d-8e9b7cbe678d tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:12:08.334491 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-be9d4137-c7de-4a47-834d-8e9b7cbe678d tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:12:08.335018 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-be9d4137-c7de-4a47-834d-8e9b7cbe678d tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:12:08.335860 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-be9d4137-c7de-4a47-834d-8e9b7cbe678d tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:12:08.336387 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-be9d4137-c7de-4a47-834d-8e9b7cbe678d tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:12:08.336933 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-be9d4137-c7de-4a47-834d-8e9b7cbe678d tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:12:08.583083 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-060b54a3-289f-40ee-adee-bab36855ea31 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e783caddcad473dbdd764919286e244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecd3d5d2a3a54a07ba64f1fea4846c40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:12:08.603189 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-be9d4137-c7de-4a47-834d-8e9b7cbe678d tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '454203f47b434cca952a1cef56de559f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7312d0ac9248f2bfbece5611913ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:12:08.604313 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-060b54a3-289f-40ee-adee-bab36855ea31 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] 10.222.0.23 "GET /compute/v2.1/servers/e125ab44-9111-4260-909d-95d57b7861a7" status: 200 len: 1724 microversion: 2.1 time: 0.310438 Oct 13 13:12:08.605684 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 154/290] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:12:08 2022] GET /compute/v2.1/servers/e125ab44-9111-4260-909d-95d57b7861a7 => generated 1724 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:12:08.610428 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-26a3eb4a-2bfb-4dff-9157-0890f46fc90b tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Calling method '>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:12:08.611220 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-26a3eb4a-2bfb-4dff-9157-0890f46fc90b tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] [instance: 6a4a7328-d884-4015-aadc-aa5062a77724] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:12:08.625257 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-26a3eb4a-2bfb-4dff-9157-0890f46fc90b tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:12:08.625847 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-26a3eb4a-2bfb-4dff-9157-0890f46fc90b tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:12:08.626493 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-26a3eb4a-2bfb-4dff-9157-0890f46fc90b tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:12:08.626814 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-be9d4137-c7de-4a47-834d-8e9b7cbe678d tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] 10.222.0.23 "GET /compute/v2.1/servers/0548a3eb-e119-482c-ac70-04fbc6f83bf7" status: 200 len: 1516 microversion: 2.1 time: 0.311264 Oct 13 13:12:08.627347 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-26a3eb4a-2bfb-4dff-9157-0890f46fc90b tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:12:08.628055 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-26a3eb4a-2bfb-4dff-9157-0890f46fc90b tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:12:08.628684 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-26a3eb4a-2bfb-4dff-9157-0890f46fc90b tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:12:08.646405 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 137/291] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:12:08 2022] GET /compute/v2.1/servers/0548a3eb-e119-482c-ac70-04fbc6f83bf7 => generated 1516 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:12:08.811026 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-26a3eb4a-2bfb-4dff-9157-0890f46fc90b tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8569afc405f24a0993a023c818a0c272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f85144e13e254365a86aa785093c8575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:12:08.821701 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-26a3eb4a-2bfb-4dff-9157-0890f46fc90b tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] 10.222.0.23 "GET /compute/v2.1/servers/6a4a7328-d884-4015-aadc-aa5062a77724" status: 200 len: 1513 microversion: 2.1 time: 0.213232 Oct 13 13:12:08.835618 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 155/292] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:12:08 2022] GET /compute/v2.1/servers/6a4a7328-d884-4015-aadc-aa5062a77724 => generated 1513 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:12:08.977819 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [req-5bc1e102-b016-4d14-8888-fa734aa14ed2 req-2ae24df4-fe95-47ca-b8b8-358a842e9653 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6a4a7328-d884-4015-aadc-aa5062a77724", "name": "network-vif-deleted", "tag": "879af4f7-b860-4ff7-afae-5448deb00962"}]} {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 13:12:08.987310 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [req-5bc1e102-b016-4d14-8888-fa734aa14ed2 req-2ae24df4-fe95-47ca-b8b8-358a842e9653 service nova] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:12:08.987781 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [req-5bc1e102-b016-4d14-8888-fa734aa14ed2 req-2ae24df4-fe95-47ca-b8b8-358a842e9653 service nova] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:12:08.988459 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [req-5bc1e102-b016-4d14-8888-fa734aa14ed2 req-2ae24df4-fe95-47ca-b8b8-358a842e9653 service nova] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:12:09.001810 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.compute.server_external_events [req-5bc1e102-b016-4d14-8888-fa734aa14ed2 req-2ae24df4-fe95-47ca-b8b8-358a842e9653 service nova] Creating event network-vif-deleted:879af4f7-b860-4ff7-afae-5448deb00962 for instance 6a4a7328-d884-4015-aadc-aa5062a77724 on hv-cinder-82660 Oct 13 13:12:09.008558 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [req-5bc1e102-b016-4d14-8888-fa734aa14ed2 req-2ae24df4-fe95-47ca-b8b8-358a842e9653 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034904 Oct 13 13:12:09.011142 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-5717b703-372f-44ea-926d-480f2a9805c0 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Calling method '>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:12:09.012253 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-5717b703-372f-44ea-926d-480f2a9805c0 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] [instance: 26bd475b-3495-4669-9985-d4a7dedb4bbf] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:12:09.012436 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 138/293] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 13:12:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 13:12:09.022822 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-5717b703-372f-44ea-926d-480f2a9805c0 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:12:09.027228 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-5717b703-372f-44ea-926d-480f2a9805c0 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:12:09.028024 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-5717b703-372f-44ea-926d-480f2a9805c0 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:12:09.029748 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-5717b703-372f-44ea-926d-480f2a9805c0 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:12:09.030396 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-5717b703-372f-44ea-926d-480f2a9805c0 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:12:09.031611 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-5717b703-372f-44ea-926d-480f2a9805c0 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:12:09.115135 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-3b861bcf-9da2-4cf7-a88f-9b8f7103d80c tempest-VolumesNegativeTest-1101616844 tempest-VolumesNegativeTest-1101616844-project] Calling method '>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:12:09.116183 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-3b861bcf-9da2-4cf7-a88f-9b8f7103d80c tempest-VolumesNegativeTest-1101616844 tempest-VolumesNegativeTest-1101616844-project] [instance: 452465c5-d313-4698-a666-9e814920b8fd] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:12:09.132733 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-3b861bcf-9da2-4cf7-a88f-9b8f7103d80c tempest-VolumesNegativeTest-1101616844 tempest-VolumesNegativeTest-1101616844-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:12:09.133496 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-3b861bcf-9da2-4cf7-a88f-9b8f7103d80c tempest-VolumesNegativeTest-1101616844 tempest-VolumesNegativeTest-1101616844-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:12:09.134139 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-3b861bcf-9da2-4cf7-a88f-9b8f7103d80c tempest-VolumesNegativeTest-1101616844 tempest-VolumesNegativeTest-1101616844-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:12:09.135078 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-3b861bcf-9da2-4cf7-a88f-9b8f7103d80c tempest-VolumesNegativeTest-1101616844 tempest-VolumesNegativeTest-1101616844-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:12:09.135825 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-3b861bcf-9da2-4cf7-a88f-9b8f7103d80c tempest-VolumesNegativeTest-1101616844 tempest-VolumesNegativeTest-1101616844-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:12:09.136430 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-3b861bcf-9da2-4cf7-a88f-9b8f7103d80c tempest-VolumesNegativeTest-1101616844 tempest-VolumesNegativeTest-1101616844-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:12:09.382307 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-5717b703-372f-44ea-926d-480f2a9805c0 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:12:09.395250 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-5717b703-372f-44ea-926d-480f2a9805c0 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:12:09.399450 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-5717b703-372f-44ea-926d-480f2a9805c0 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:12:09.401800 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-5717b703-372f-44ea-926d-480f2a9805c0 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] 10.222.0.23 "GET /compute/v2.1/servers/26bd475b-3495-4669-9985-d4a7dedb4bbf" status: 200 len: 1745 microversion: 2.20 time: 0.403471 Oct 13 13:12:09.405132 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 156/294] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 13:12:08 2022] GET /compute/v2.1/servers/26bd475b-3495-4669-9985-d4a7dedb4bbf => generated 1745 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 13 13:12:09.458907 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-3b861bcf-9da2-4cf7-a88f-9b8f7103d80c tempest-VolumesNegativeTest-1101616844 tempest-VolumesNegativeTest-1101616844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd5dc5471e5246f4878f1d91d59b68f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e74136856dcf42c48689e6976f16caad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:12:09.494715 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-3b861bcf-9da2-4cf7-a88f-9b8f7103d80c tempest-VolumesNegativeTest-1101616844 tempest-VolumesNegativeTest-1101616844-project] 10.222.0.23 "GET /compute/v2.1/servers/452465c5-d313-4698-a666-9e814920b8fd" status: 200 len: 1315 microversion: 2.1 time: 0.384598 Oct 13 13:12:09.495354 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 139/295] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:12:09 2022] GET /compute/v2.1/servers/452465c5-d313-4698-a666-9e814920b8fd => generated 1315 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 13:12:09.633241 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-3898df7c-c6f5-4eb2-bec4-afa24e6188e5 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Calling method '>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:12:09.633942 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-3898df7c-c6f5-4eb2-bec4-afa24e6188e5 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] [instance: e125ab44-9111-4260-909d-95d57b7861a7] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:12:09.640825 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-3898df7c-c6f5-4eb2-bec4-afa24e6188e5 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:12:09.641453 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-3898df7c-c6f5-4eb2-bec4-afa24e6188e5 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:12:09.641897 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-3898df7c-c6f5-4eb2-bec4-afa24e6188e5 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:12:09.642641 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-3898df7c-c6f5-4eb2-bec4-afa24e6188e5 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:12:09.643491 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-3898df7c-c6f5-4eb2-bec4-afa24e6188e5 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:12:09.643949 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-3898df7c-c6f5-4eb2-bec4-afa24e6188e5 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:12:09.655515 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG dbcounter [-] [118814] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=118814) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:12:09.802595 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-3898df7c-c6f5-4eb2-bec4-afa24e6188e5 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e783caddcad473dbdd764919286e244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecd3d5d2a3a54a07ba64f1fea4846c40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:12:09.812260 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-3898df7c-c6f5-4eb2-bec4-afa24e6188e5 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] 10.222.0.23 "GET /compute/v2.1/servers/e125ab44-9111-4260-909d-95d57b7861a7" status: 200 len: 1724 microversion: 2.1 time: 0.182757 Oct 13 13:12:09.813197 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 157/296] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:12:09 2022] GET /compute/v2.1/servers/e125ab44-9111-4260-909d-95d57b7861a7 => generated 1724 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:12:09.848800 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-a47cf098-0540-4c9d-ad0a-275f040e653d tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Calling method '>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:12:09.849613 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-a47cf098-0540-4c9d-ad0a-275f040e653d tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] [instance: 6a4a7328-d884-4015-aadc-aa5062a77724] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:12:09.855542 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-a47cf098-0540-4c9d-ad0a-275f040e653d tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:12:09.856315 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-a47cf098-0540-4c9d-ad0a-275f040e653d tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:12:09.856816 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-a47cf098-0540-4c9d-ad0a-275f040e653d tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:12:09.857731 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-a47cf098-0540-4c9d-ad0a-275f040e653d tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:12:09.858316 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-a47cf098-0540-4c9d-ad0a-275f040e653d tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:12:09.858824 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-a47cf098-0540-4c9d-ad0a-275f040e653d tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:12:09.906094 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-a47cf098-0540-4c9d-ad0a-275f040e653d tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:12:09.907144 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-a47cf098-0540-4c9d-ad0a-275f040e653d tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:12:09.907803 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-a47cf098-0540-4c9d-ad0a-275f040e653d tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:12:09.908448 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.objects.instance [None req-a47cf098-0540-4c9d-ad0a-275f040e653d tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Lazy-loading 'fault' on Instance uuid 6a4a7328-d884-4015-aadc-aa5062a77724 {{(pid=118815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 13 13:12:09.959954 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-a47cf098-0540-4c9d-ad0a-275f040e653d tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8569afc405f24a0993a023c818a0c272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f85144e13e254365a86aa785093c8575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:12:09.968456 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-a47cf098-0540-4c9d-ad0a-275f040e653d tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] 10.222.0.23 "GET /compute/v2.1/servers/6a4a7328-d884-4015-aadc-aa5062a77724" status: 200 len: 1309 microversion: 2.1 time: 0.123744 Oct 13 13:12:09.969675 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 140/297] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:12:09 2022] GET /compute/v2.1/servers/6a4a7328-d884-4015-aadc-aa5062a77724 => generated 1309 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:12:10.228310 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-da125e27-691e-4bed-a2a5-fa51110f72a0 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Action: 'create', calling method: .version_select at 0x7f5093f22d30>, body: {"keypair": {"name": "tempest-keypair-352459096", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMjNPgGBBwrOa5HU+5wtgr+JmOHRzPDa3jrvXTZAjAxY1EKyoV+t50moLHyPl0ALG0Gn5cAElBw9DpblG9KGngF87zY3d46YOl9driYc5m59n+KN+S0dS/r8QoljH6cS5Q=="}} {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 13:12:10.248154 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.quota [None req-da125e27-691e-4bed-a2a5-fa51110f72a0 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Getting quotas for project 5e7312d0ac9248f2bfbece5611913ab2. Resources: {'key_pairs'} {{(pid=118814) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 13 13:12:10.253260 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.quota [None req-da125e27-691e-4bed-a2a5-fa51110f72a0 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Getting quotas for user 454203f47b434cca952a1cef56de559f and project 5e7312d0ac9248f2bfbece5611913ab2. Resources: {'key_pairs'} {{(pid=118814) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 13 13:12:10.283687 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-da125e27-691e-4bed-a2a5-fa51110f72a0 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.059164 Oct 13 13:12:10.284549 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 158/298] 10.222.0.23 () {60 vars in 1159 bytes} [Thu Oct 13 13:12:10 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 13:12:10.447963 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-ce2b0f3e-a29f-4707-bb23-e56eef8ae976 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Calling method '>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:12:10.449011 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-ce2b0f3e-a29f-4707-bb23-e56eef8ae976 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] [instance: 26bd475b-3495-4669-9985-d4a7dedb4bbf] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:12:10.472209 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-ce2b0f3e-a29f-4707-bb23-e56eef8ae976 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:12:10.474798 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-ce2b0f3e-a29f-4707-bb23-e56eef8ae976 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:12:10.476142 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-ce2b0f3e-a29f-4707-bb23-e56eef8ae976 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:12:10.479425 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-ce2b0f3e-a29f-4707-bb23-e56eef8ae976 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:12:10.480207 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-ce2b0f3e-a29f-4707-bb23-e56eef8ae976 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:12:10.481790 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-ce2b0f3e-a29f-4707-bb23-e56eef8ae976 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:12:10.525757 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-28d5b4cf-d401-4654-ba9f-d37554452c3f tempest-VolumesNegativeTest-1101616844 tempest-VolumesNegativeTest-1101616844-project] Calling method '>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:12:10.526492 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-28d5b4cf-d401-4654-ba9f-d37554452c3f tempest-VolumesNegativeTest-1101616844 tempest-VolumesNegativeTest-1101616844-project] [instance: 452465c5-d313-4698-a666-9e814920b8fd] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:12:10.536464 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-28d5b4cf-d401-4654-ba9f-d37554452c3f tempest-VolumesNegativeTest-1101616844 tempest-VolumesNegativeTest-1101616844-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:12:10.536967 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-28d5b4cf-d401-4654-ba9f-d37554452c3f tempest-VolumesNegativeTest-1101616844 tempest-VolumesNegativeTest-1101616844-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:12:10.537541 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-28d5b4cf-d401-4654-ba9f-d37554452c3f tempest-VolumesNegativeTest-1101616844 tempest-VolumesNegativeTest-1101616844-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:12:10.538432 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-28d5b4cf-d401-4654-ba9f-d37554452c3f tempest-VolumesNegativeTest-1101616844 tempest-VolumesNegativeTest-1101616844-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:12:10.538905 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-28d5b4cf-d401-4654-ba9f-d37554452c3f tempest-VolumesNegativeTest-1101616844 tempest-VolumesNegativeTest-1101616844-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:12:10.539520 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-28d5b4cf-d401-4654-ba9f-d37554452c3f tempest-VolumesNegativeTest-1101616844 tempest-VolumesNegativeTest-1101616844-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:12:10.805053 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-ce2b0f3e-a29f-4707-bb23-e56eef8ae976 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:12:10.818113 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-ce2b0f3e-a29f-4707-bb23-e56eef8ae976 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:12:10.821151 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-ce2b0f3e-a29f-4707-bb23-e56eef8ae976 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:12:10.822637 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-ce2b0f3e-a29f-4707-bb23-e56eef8ae976 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] 10.222.0.23 "GET /compute/v2.1/servers/26bd475b-3495-4669-9985-d4a7dedb4bbf" status: 200 len: 1745 microversion: 2.20 time: 0.386229 Oct 13 13:12:10.823929 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 141/299] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 13:12:10 2022] GET /compute/v2.1/servers/26bd475b-3495-4669-9985-d4a7dedb4bbf => generated 1745 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 13:12:10.849506 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-6442a708-ad76-446a-8e38-4c9300d3944f tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Calling method '>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:12:10.850131 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-6442a708-ad76-446a-8e38-4c9300d3944f tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] [instance: e125ab44-9111-4260-909d-95d57b7861a7] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:12:10.871493 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-6442a708-ad76-446a-8e38-4c9300d3944f tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:12:10.876953 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-6442a708-ad76-446a-8e38-4c9300d3944f tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:12:10.877659 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-6442a708-ad76-446a-8e38-4c9300d3944f tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:12:10.878893 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-6442a708-ad76-446a-8e38-4c9300d3944f tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:12:10.881613 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-6442a708-ad76-446a-8e38-4c9300d3944f tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:12:10.882243 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-6442a708-ad76-446a-8e38-4c9300d3944f tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:12:10.889686 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-28d5b4cf-d401-4654-ba9f-d37554452c3f tempest-VolumesNegativeTest-1101616844 tempest-VolumesNegativeTest-1101616844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd5dc5471e5246f4878f1d91d59b68f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e74136856dcf42c48689e6976f16caad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:12:10.911901 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-28d5b4cf-d401-4654-ba9f-d37554452c3f tempest-VolumesNegativeTest-1101616844 tempest-VolumesNegativeTest-1101616844-project] 10.222.0.23 "GET /compute/v2.1/servers/452465c5-d313-4698-a666-9e814920b8fd" status: 200 len: 1465 microversion: 2.1 time: 0.394433 Oct 13 13:12:10.937033 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 159/300] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:12:10 2022] GET /compute/v2.1/servers/452465c5-d313-4698-a666-9e814920b8fd => generated 1465 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:12:10.993861 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-537b7dfd-5999-4822-be07-997d72f724f5 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Calling method '>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:12:10.994908 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-537b7dfd-5999-4822-be07-997d72f724f5 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] [instance: 6a4a7328-d884-4015-aadc-aa5062a77724] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:12:11.018748 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-537b7dfd-5999-4822-be07-997d72f724f5 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:12:11.021872 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-537b7dfd-5999-4822-be07-997d72f724f5 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:12:11.026372 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-537b7dfd-5999-4822-be07-997d72f724f5 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:12:11.030097 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-537b7dfd-5999-4822-be07-997d72f724f5 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:12:11.031807 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-537b7dfd-5999-4822-be07-997d72f724f5 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:12:11.032975 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-537b7dfd-5999-4822-be07-997d72f724f5 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:12:11.134530 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-537b7dfd-5999-4822-be07-997d72f724f5 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:12:11.135294 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-537b7dfd-5999-4822-be07-997d72f724f5 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:12:11.135887 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-537b7dfd-5999-4822-be07-997d72f724f5 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:12:11.136496 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.objects.instance [None req-537b7dfd-5999-4822-be07-997d72f724f5 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Lazy-loading 'fault' on Instance uuid 6a4a7328-d884-4015-aadc-aa5062a77724 {{(pid=118814) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 13 13:12:11.262126 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-6442a708-ad76-446a-8e38-4c9300d3944f tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e783caddcad473dbdd764919286e244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecd3d5d2a3a54a07ba64f1fea4846c40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:12:11.277817 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-537b7dfd-5999-4822-be07-997d72f724f5 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8569afc405f24a0993a023c818a0c272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f85144e13e254365a86aa785093c8575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:12:11.281595 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-6442a708-ad76-446a-8e38-4c9300d3944f tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] 10.222.0.23 "GET /compute/v2.1/servers/e125ab44-9111-4260-909d-95d57b7861a7" status: 200 len: 1724 microversion: 2.1 time: 0.441173 Oct 13 13:12:11.288871 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 142/301] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:12:10 2022] GET /compute/v2.1/servers/e125ab44-9111-4260-909d-95d57b7861a7 => generated 1724 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:12:11.300507 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-537b7dfd-5999-4822-be07-997d72f724f5 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] 10.222.0.23 "GET /compute/v2.1/servers/6a4a7328-d884-4015-aadc-aa5062a77724" status: 200 len: 1309 microversion: 2.1 time: 0.302284 Oct 13 13:12:11.305626 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 160/302] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:12:10 2022] GET /compute/v2.1/servers/6a4a7328-d884-4015-aadc-aa5062a77724 => generated 1309 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:12:11.317285 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-07c3698b-6261-4064-a5b6-32e0ce1bd69c tempest-VolumesNegativeTest-1101616844 tempest-VolumesNegativeTest-1101616844-project] Calling method '>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:12:11.323879 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-07c3698b-6261-4064-a5b6-32e0ce1bd69c tempest-VolumesNegativeTest-1101616844 tempest-VolumesNegativeTest-1101616844-project] [instance: 452465c5-d313-4698-a666-9e814920b8fd] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:12:11.338418 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-07c3698b-6261-4064-a5b6-32e0ce1bd69c tempest-VolumesNegativeTest-1101616844 tempest-VolumesNegativeTest-1101616844-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:12:11.338909 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-07c3698b-6261-4064-a5b6-32e0ce1bd69c tempest-VolumesNegativeTest-1101616844 tempest-VolumesNegativeTest-1101616844-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:12:11.341939 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-07c3698b-6261-4064-a5b6-32e0ce1bd69c tempest-VolumesNegativeTest-1101616844 tempest-VolumesNegativeTest-1101616844-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:12:11.343992 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-07c3698b-6261-4064-a5b6-32e0ce1bd69c tempest-VolumesNegativeTest-1101616844 tempest-VolumesNegativeTest-1101616844-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:12:11.346358 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-07c3698b-6261-4064-a5b6-32e0ce1bd69c tempest-VolumesNegativeTest-1101616844 tempest-VolumesNegativeTest-1101616844-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:12:11.347009 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-07c3698b-6261-4064-a5b6-32e0ce1bd69c tempest-VolumesNegativeTest-1101616844 tempest-VolumesNegativeTest-1101616844-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:12:11.400374 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-07c3698b-6261-4064-a5b6-32e0ce1bd69c tempest-VolumesNegativeTest-1101616844 tempest-VolumesNegativeTest-1101616844-project] [instance: 452465c5-d313-4698-a666-9e814920b8fd] Going to try to terminate instance {{(pid=118815) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 13 13:12:11.591451 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-07c3698b-6261-4064-a5b6-32e0ce1bd69c tempest-VolumesNegativeTest-1101616844 tempest-VolumesNegativeTest-1101616844-project] 10.222.0.23 "DELETE /compute/v2.1/servers/452465c5-d313-4698-a666-9e814920b8fd" status: 204 len: 0 microversion: 2.1 time: 0.291153 Oct 13 13:12:11.598962 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 143/303] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Oct 13 13:12:11 2022] DELETE /compute/v2.1/servers/452465c5-d313-4698-a666-9e814920b8fd => generated 0 bytes in 305 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 13 13:12:11.605426 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-c37bc595-8648-4065-87ad-c13172be274e tempest-VolumesNegativeTest-1101616844 tempest-VolumesNegativeTest-1101616844-project] Calling method '>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:12:11.608317 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-c37bc595-8648-4065-87ad-c13172be274e tempest-VolumesNegativeTest-1101616844 tempest-VolumesNegativeTest-1101616844-project] [instance: 452465c5-d313-4698-a666-9e814920b8fd] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:12:11.618340 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-c37bc595-8648-4065-87ad-c13172be274e tempest-VolumesNegativeTest-1101616844 tempest-VolumesNegativeTest-1101616844-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:12:11.619160 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-c37bc595-8648-4065-87ad-c13172be274e tempest-VolumesNegativeTest-1101616844 tempest-VolumesNegativeTest-1101616844-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:12:11.619859 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-c37bc595-8648-4065-87ad-c13172be274e tempest-VolumesNegativeTest-1101616844 tempest-VolumesNegativeTest-1101616844-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:12:11.620684 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-c37bc595-8648-4065-87ad-c13172be274e tempest-VolumesNegativeTest-1101616844 tempest-VolumesNegativeTest-1101616844-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:12:11.621374 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-c37bc595-8648-4065-87ad-c13172be274e tempest-VolumesNegativeTest-1101616844 tempest-VolumesNegativeTest-1101616844-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:12:11.621875 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-c37bc595-8648-4065-87ad-c13172be274e tempest-VolumesNegativeTest-1101616844 tempest-VolumesNegativeTest-1101616844-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:12:11.853176 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-41fc75a0-c588-46e8-855a-b20e113827c9 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Calling method '>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:12:11.854573 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-41fc75a0-c588-46e8-855a-b20e113827c9 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] [instance: 26bd475b-3495-4669-9985-d4a7dedb4bbf] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:12:11.875235 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-41fc75a0-c588-46e8-855a-b20e113827c9 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:12:11.877526 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-41fc75a0-c588-46e8-855a-b20e113827c9 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:12:11.877991 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-41fc75a0-c588-46e8-855a-b20e113827c9 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:12:11.883661 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-41fc75a0-c588-46e8-855a-b20e113827c9 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:12:11.886648 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-41fc75a0-c588-46e8-855a-b20e113827c9 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:12:11.887135 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-41fc75a0-c588-46e8-855a-b20e113827c9 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:12:11.897106 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-c37bc595-8648-4065-87ad-c13172be274e tempest-VolumesNegativeTest-1101616844 tempest-VolumesNegativeTest-1101616844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd5dc5471e5246f4878f1d91d59b68f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e74136856dcf42c48689e6976f16caad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:12:11.919743 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-c37bc595-8648-4065-87ad-c13172be274e tempest-VolumesNegativeTest-1101616844 tempest-VolumesNegativeTest-1101616844-project] 10.222.0.23 "GET /compute/v2.1/servers/452465c5-d313-4698-a666-9e814920b8fd" status: 200 len: 1471 microversion: 2.1 time: 0.318860 Oct 13 13:12:11.919900 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 161/304] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:12:11 2022] GET /compute/v2.1/servers/452465c5-d313-4698-a666-9e814920b8fd => generated 1471 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 13:12:12.247656 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-41fc75a0-c588-46e8-855a-b20e113827c9 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:12:12.258813 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-41fc75a0-c588-46e8-855a-b20e113827c9 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:12:12.263843 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-41fc75a0-c588-46e8-855a-b20e113827c9 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:12:12.271841 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-41fc75a0-c588-46e8-855a-b20e113827c9 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] 10.222.0.23 "GET /compute/v2.1/servers/26bd475b-3495-4669-9985-d4a7dedb4bbf" status: 200 len: 1740 microversion: 2.20 time: 0.422907 Oct 13 13:12:12.272775 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 144/305] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 13:12:11 2022] GET /compute/v2.1/servers/26bd475b-3495-4669-9985-d4a7dedb4bbf => generated 1740 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 13:12:12.318561 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-a83967e9-117b-403b-b6f9-776416a363c6 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Calling method '>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:12:12.319751 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-a83967e9-117b-403b-b6f9-776416a363c6 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] [instance: e125ab44-9111-4260-909d-95d57b7861a7] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:12:12.328908 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-b62444a4-871b-464b-b4a1-19645fc4c947 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Calling method '>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:12:12.329592 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-b62444a4-871b-464b-b4a1-19645fc4c947 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] [instance: 6a4a7328-d884-4015-aadc-aa5062a77724] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:12:12.339548 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-b62444a4-871b-464b-b4a1-19645fc4c947 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:12:12.342063 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-a83967e9-117b-403b-b6f9-776416a363c6 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:12:12.342269 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-b62444a4-871b-464b-b4a1-19645fc4c947 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:12:12.342835 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-b62444a4-871b-464b-b4a1-19645fc4c947 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:12:12.343670 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-b62444a4-871b-464b-b4a1-19645fc4c947 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:12:12.346521 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-b62444a4-871b-464b-b4a1-19645fc4c947 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:12:12.347028 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-b62444a4-871b-464b-b4a1-19645fc4c947 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:12:12.350011 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-a83967e9-117b-403b-b6f9-776416a363c6 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:12:12.355771 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-a83967e9-117b-403b-b6f9-776416a363c6 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:12:12.356795 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-a83967e9-117b-403b-b6f9-776416a363c6 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:12:12.357457 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-a83967e9-117b-403b-b6f9-776416a363c6 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:12:12.367855 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-a83967e9-117b-403b-b6f9-776416a363c6 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:12:12.382234 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.wsgi [None req-b62444a4-871b-464b-b4a1-19645fc4c947 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] HTTP exception thrown: Instance 6a4a7328-d884-4015-aadc-aa5062a77724 could not be found. Oct 13 13:12:12.385785 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-b62444a4-871b-464b-b4a1-19645fc4c947 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Request method failure captured: Oct 13 13:12:12.385785 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: request: GET /compute/v2.1/servers/6a4a7328-d884-4015-aadc-aa5062a77724 HTTP/1.1 Oct 13 13:12:12.385785 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: Accept: application/json Oct 13 13:12:12.385785 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: Accept-Encoding: identity Oct 13 13:12:12.385785 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: Connection: close Oct 13 13:12:12.385785 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: Content-Length: 0 Oct 13 13:12:12.385785 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: Content-Type: application/json Oct 13 13:12:12.385785 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: Host: 10.222.0.23 Oct 13 13:12:12.385785 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: Openstack-System-Scope: None Oct 13 13:12:12.385785 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: User-Agent: python-urllib3/1.26.12 Oct 13 13:12:12.385785 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Auth-Token: gAAAAABjSA5YP4eOQZTZUapLiAkyn5untQ_FRcQH_de5_rpv5hU-TjyKUAn-Z5Lh8S5A6q_ef7BVb-Lq4SU3xYP94lnCC7--lyO_lLga2RjvauicnahCtBZ_PK5DCHC5L_0FG9n_H0cxMMhPPuTF-WiOCDEL6KoOKBp0_kncIPb0uI92pYCX56I Oct 13 13:12:12.385785 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Domain-Id: None Oct 13 13:12:12.385785 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Domain-Name: None Oct 13 13:12:12.385785 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Identity-Status: Confirmed Oct 13 13:12:12.385785 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Is-Admin-Project: True Oct 13 13:12:12.385785 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Project-Domain-Id: default Oct 13 13:12:12.385785 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Project-Domain-Name: Default Oct 13 13:12:12.385785 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Project-Id: f85144e13e254365a86aa785093c8575 Oct 13 13:12:12.385785 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Project-Name: tempest-VolumesSnapshotTestJSON-81979141 Oct 13 13:12:12.385785 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Role: reader,member Oct 13 13:12:12.385785 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Roles: reader,member Oct 13 13:12:12.387150 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_f85144e13e254365a86aa785093c8575"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/f85144e13e254365a86aa785093c8575"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/f85144e13e254365a86aa785093c8575"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/f85144e13e254365a86aa785093c8575"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}] Oct 13 13:12:12.387150 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Tenant: tempest-VolumesSnapshotTestJSON-81979141 Oct 13 13:12:12.387150 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Tenant-Id: f85144e13e254365a86aa785093c8575 Oct 13 13:12:12.387150 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-81979141 Oct 13 13:12:12.387150 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-User: tempest-VolumesSnapshotTestJSON-81979141-project Oct 13 13:12:12.387150 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-User-Domain-Id: default Oct 13 13:12:12.387150 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-User-Domain-Name: Default Oct 13 13:12:12.387150 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-User-Id: 8569afc405f24a0993a023c818a0c272 Oct 13 13:12:12.387150 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-User-Name: tempest-VolumesSnapshotTestJSON-81979141-project Oct 13 13:12:12.387150 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: method: > Oct 13 13:12:12.387150 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: exception: Instance 6a4a7328-d884-4015-aadc-aa5062a77724 could not be found. Oct 13 13:12:12.387150 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: action_args: {'id': '6a4a7328-d884-4015-aadc-aa5062a77724'} Oct 13 13:12:12.387902 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 13:12:12.387902 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 13:12:12.387902 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 13 13:12:12.387902 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 13 13:12:12.387902 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 13 13:12:12.387902 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 13 13:12:12.387902 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 13 13:12:12.387902 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 13 13:12:12.387902 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 13 13:12:12.387902 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 13 13:12:12.387902 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6a4a7328-d884-4015-aadc-aa5062a77724 could not be found. Oct 13 13:12:12.387902 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi Oct 13 13:12:12.387902 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 13:12:12.387902 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi Oct 13 13:12:12.387902 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 13:12:12.387902 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 13:12:12.387902 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 13:12:12.387902 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 13:12:12.387902 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 13:12:12.387902 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 13:12:12.389043 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 13:12:12.389043 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 13 13:12:12.389043 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 13 13:12:12.389043 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 13 13:12:12.389043 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 13 13:12:12.389043 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 13 13:12:12.389043 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 13 13:12:12.389043 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6a4a7328-d884-4015-aadc-aa5062a77724 could not be found. Oct 13 13:12:12.389043 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi Oct 13 13:12:12.389043 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 13:12:12.389043 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi Oct 13 13:12:12.389043 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 13:12:12.389043 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 13:12:12.389043 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 13:12:12.389043 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 13:12:12.389043 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 13:12:12.389043 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6a4a7328-d884-4015-aadc-aa5062a77724 could not be found. Oct 13 13:12:12.389043 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi Oct 13 13:12:12.390078 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-b62444a4-871b-464b-b4a1-19645fc4c947 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Returning 404 to user: Instance 6a4a7328-d884-4015-aadc-aa5062a77724 could not be found. {{(pid=118815) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 13:12:12.390078 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-b62444a4-871b-464b-b4a1-19645fc4c947 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] 10.222.0.23 "GET /compute/v2.1/servers/6a4a7328-d884-4015-aadc-aa5062a77724" status: 404 len: 111 microversion: 2.1 time: 0.061158 Oct 13 13:12:12.390078 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 145/306] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:12:12 2022] GET /compute/v2.1/servers/6a4a7328-d884-4015-aadc-aa5062a77724 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 13 13:12:12.953728 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-4a3f9450-2252-4eec-b62d-d9e464948afc tempest-VolumesNegativeTest-1101616844 tempest-VolumesNegativeTest-1101616844-project] Calling method '>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:12:12.954394 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-4a3f9450-2252-4eec-b62d-d9e464948afc tempest-VolumesNegativeTest-1101616844 tempest-VolumesNegativeTest-1101616844-project] [instance: 452465c5-d313-4698-a666-9e814920b8fd] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:12:12.965206 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-4a3f9450-2252-4eec-b62d-d9e464948afc tempest-VolumesNegativeTest-1101616844 tempest-VolumesNegativeTest-1101616844-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:12:12.967713 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-4a3f9450-2252-4eec-b62d-d9e464948afc tempest-VolumesNegativeTest-1101616844 tempest-VolumesNegativeTest-1101616844-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:12:12.971406 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-4a3f9450-2252-4eec-b62d-d9e464948afc tempest-VolumesNegativeTest-1101616844 tempest-VolumesNegativeTest-1101616844-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:12:12.972446 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-4a3f9450-2252-4eec-b62d-d9e464948afc tempest-VolumesNegativeTest-1101616844 tempest-VolumesNegativeTest-1101616844-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:12:12.975880 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-4a3f9450-2252-4eec-b62d-d9e464948afc tempest-VolumesNegativeTest-1101616844 tempest-VolumesNegativeTest-1101616844-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:12:12.976562 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-4a3f9450-2252-4eec-b62d-d9e464948afc tempest-VolumesNegativeTest-1101616844 tempest-VolumesNegativeTest-1101616844-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:12:13.418873 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-a83967e9-117b-403b-b6f9-776416a363c6 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e783caddcad473dbdd764919286e244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecd3d5d2a3a54a07ba64f1fea4846c40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:12:13.435128 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-a83967e9-117b-403b-b6f9-776416a363c6 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] 10.222.0.23 "GET /compute/v2.1/servers/e125ab44-9111-4260-909d-95d57b7861a7" status: 200 len: 1724 microversion: 2.1 time: 1.120692 Oct 13 13:12:13.446909 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 162/307] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:12:12 2022] GET /compute/v2.1/servers/e125ab44-9111-4260-909d-95d57b7861a7 => generated 1724 bytes in 1136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:12:13.452736 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [req-8b1827b3-2b95-4b0d-8da3-2059dccaa72a req-f7a058a0-47e0-4f3a-a2a4-e25a77154012 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "26bd475b-3495-4669-9985-d4a7dedb4bbf", "name": "network-vif-plugged", "status": "completed", "tag": "bd0eddba-ab0b-4c35-805b-853067734898"}]} {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 13:12:13.475936 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [req-8b1827b3-2b95-4b0d-8da3-2059dccaa72a req-f7a058a0-47e0-4f3a-a2a4-e25a77154012 service nova] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:12:13.476815 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [req-8b1827b3-2b95-4b0d-8da3-2059dccaa72a req-f7a058a0-47e0-4f3a-a2a4-e25a77154012 service nova] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:12:13.477655 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [req-8b1827b3-2b95-4b0d-8da3-2059dccaa72a req-f7a058a0-47e0-4f3a-a2a4-e25a77154012 service nova] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:12:13.490383 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.compute.server_external_events [req-8b1827b3-2b95-4b0d-8da3-2059dccaa72a req-f7a058a0-47e0-4f3a-a2a4-e25a77154012 service nova] Creating event network-vif-plugged:bd0eddba-ab0b-4c35-805b-853067734898 for instance 26bd475b-3495-4669-9985-d4a7dedb4bbf on hv-cinder-82660 Oct 13 13:12:13.499613 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [req-8b1827b3-2b95-4b0d-8da3-2059dccaa72a req-f7a058a0-47e0-4f3a-a2a4-e25a77154012 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051014 Oct 13 13:12:13.500607 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 163/308] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 13:12:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 13:12:13.507867 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-4e53a18b-3204-46c4-969c-c8c7e99b19a6 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Calling method '>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:12:13.522714 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-4e53a18b-3204-46c4-969c-c8c7e99b19a6 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] [instance: 26bd475b-3495-4669-9985-d4a7dedb4bbf] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:12:13.533469 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-4e53a18b-3204-46c4-969c-c8c7e99b19a6 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:12:13.539594 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-4e53a18b-3204-46c4-969c-c8c7e99b19a6 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:12:13.540370 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-4e53a18b-3204-46c4-969c-c8c7e99b19a6 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:12:13.547834 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-4e53a18b-3204-46c4-969c-c8c7e99b19a6 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:12:13.549053 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-4e53a18b-3204-46c4-969c-c8c7e99b19a6 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:12:13.549792 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-4e53a18b-3204-46c4-969c-c8c7e99b19a6 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:12:13.567579 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-4a3f9450-2252-4eec-b62d-d9e464948afc tempest-VolumesNegativeTest-1101616844 tempest-VolumesNegativeTest-1101616844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd5dc5471e5246f4878f1d91d59b68f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e74136856dcf42c48689e6976f16caad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:12:13.577664 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-4a3f9450-2252-4eec-b62d-d9e464948afc tempest-VolumesNegativeTest-1101616844 tempest-VolumesNegativeTest-1101616844-project] 10.222.0.23 "GET /compute/v2.1/servers/452465c5-d313-4698-a666-9e814920b8fd" status: 200 len: 1471 microversion: 2.1 time: 0.627688 Oct 13 13:12:13.578833 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 146/309] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:12:12 2022] GET /compute/v2.1/servers/452465c5-d313-4698-a666-9e814920b8fd => generated 1471 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:12:13.773838 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-32aadd6c-9778-4fee-8f7d-db063223b2f8 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-2079079399", "imageRef": "e2cdd20b-2540-48bc-a05c-d6a2e7e9a66e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "6c7eaa8a-d195-41e7-950e-394b3e71b249"}], "security_groups": [{"name": "tempest-securitygroup--2117039536"}], "key_name": "tempest-keypair-352459096", "user_data": "}} {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 13:12:13.948100 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-4e53a18b-3204-46c4-969c-c8c7e99b19a6 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:12:13.959778 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-4e53a18b-3204-46c4-969c-c8c7e99b19a6 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:12:13.974144 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-4e53a18b-3204-46c4-969c-c8c7e99b19a6 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:12:13.980126 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-4e53a18b-3204-46c4-969c-c8c7e99b19a6 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] 10.222.0.23 "GET /compute/v2.1/servers/26bd475b-3495-4669-9985-d4a7dedb4bbf" status: 200 len: 1740 microversion: 2.20 time: 0.473920 Oct 13 13:12:13.982246 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 164/310] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 13:12:13 2022] GET /compute/v2.1/servers/26bd475b-3495-4669-9985-d4a7dedb4bbf => generated 1740 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 13:12:14.473416 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-f4ee94b7-d3fa-4a57-a3ad-e149aef1680a tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Calling method '>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:12:14.474889 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-f4ee94b7-d3fa-4a57-a3ad-e149aef1680a tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] [instance: e125ab44-9111-4260-909d-95d57b7861a7] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:12:14.487015 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-f4ee94b7-d3fa-4a57-a3ad-e149aef1680a tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:12:14.488312 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-f4ee94b7-d3fa-4a57-a3ad-e149aef1680a tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:12:14.488996 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-f4ee94b7-d3fa-4a57-a3ad-e149aef1680a tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:12:14.491209 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-f4ee94b7-d3fa-4a57-a3ad-e149aef1680a tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:12:14.501833 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-f4ee94b7-d3fa-4a57-a3ad-e149aef1680a tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:12:14.502858 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-f4ee94b7-d3fa-4a57-a3ad-e149aef1680a tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:12:14.759337 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-f4ee94b7-d3fa-4a57-a3ad-e149aef1680a tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e783caddcad473dbdd764919286e244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecd3d5d2a3a54a07ba64f1fea4846c40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:12:14.777695 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-f4ee94b7-d3fa-4a57-a3ad-e149aef1680a tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] 10.222.0.23 "GET /compute/v2.1/servers/e125ab44-9111-4260-909d-95d57b7861a7" status: 200 len: 1724 microversion: 2.1 time: 0.311654 Oct 13 13:12:14.778783 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 165/311] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:12:14 2022] GET /compute/v2.1/servers/e125ab44-9111-4260-909d-95d57b7861a7 => generated 1724 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:12:14.790854 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-cffd1c1d-f4db-444d-8e99-70d2c874e7e1 tempest-VolumesNegativeTest-1101616844 tempest-VolumesNegativeTest-1101616844-project] Calling method '>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:12:14.791628 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-cffd1c1d-f4db-444d-8e99-70d2c874e7e1 tempest-VolumesNegativeTest-1101616844 tempest-VolumesNegativeTest-1101616844-project] [instance: 452465c5-d313-4698-a666-9e814920b8fd] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:12:14.815910 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-cffd1c1d-f4db-444d-8e99-70d2c874e7e1 tempest-VolumesNegativeTest-1101616844 tempest-VolumesNegativeTest-1101616844-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:12:14.817526 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-cffd1c1d-f4db-444d-8e99-70d2c874e7e1 tempest-VolumesNegativeTest-1101616844 tempest-VolumesNegativeTest-1101616844-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:12:14.818064 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-cffd1c1d-f4db-444d-8e99-70d2c874e7e1 tempest-VolumesNegativeTest-1101616844 tempest-VolumesNegativeTest-1101616844-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:12:14.818908 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-cffd1c1d-f4db-444d-8e99-70d2c874e7e1 tempest-VolumesNegativeTest-1101616844 tempest-VolumesNegativeTest-1101616844-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:12:14.819497 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-cffd1c1d-f4db-444d-8e99-70d2c874e7e1 tempest-VolumesNegativeTest-1101616844 tempest-VolumesNegativeTest-1101616844-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:12:14.820038 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-cffd1c1d-f4db-444d-8e99-70d2c874e7e1 tempest-VolumesNegativeTest-1101616844 tempest-VolumesNegativeTest-1101616844-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:12:15.001242 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-cffd1c1d-f4db-444d-8e99-70d2c874e7e1 tempest-VolumesNegativeTest-1101616844 tempest-VolumesNegativeTest-1101616844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd5dc5471e5246f4878f1d91d59b68f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e74136856dcf42c48689e6976f16caad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:12:15.016820 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-cffd1c1d-f4db-444d-8e99-70d2c874e7e1 tempest-VolumesNegativeTest-1101616844 tempest-VolumesNegativeTest-1101616844-project] 10.222.0.23 "GET /compute/v2.1/servers/452465c5-d313-4698-a666-9e814920b8fd" status: 200 len: 1429 microversion: 2.1 time: 0.236725 Oct 13 13:12:15.017781 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 166/312] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:12:14 2022] GET /compute/v2.1/servers/452465c5-d313-4698-a666-9e814920b8fd => generated 1429 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:12:15.029585 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [req-112933f4-be6b-4cae-8fff-95469caebf76 req-4d76e144-920f-4989-b87d-df9d902b3083 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "452465c5-d313-4698-a666-9e814920b8fd", "name": "network-vif-deleted", "tag": "8ea6a73b-f96b-45c1-b3fd-3688afc99566"}]} {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 13:12:15.040956 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [req-112933f4-be6b-4cae-8fff-95469caebf76 req-4d76e144-920f-4989-b87d-df9d902b3083 service nova] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:12:15.041735 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [req-112933f4-be6b-4cae-8fff-95469caebf76 req-4d76e144-920f-4989-b87d-df9d902b3083 service nova] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:12:15.042338 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [req-112933f4-be6b-4cae-8fff-95469caebf76 req-4d76e144-920f-4989-b87d-df9d902b3083 service nova] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:12:15.055363 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.compute.server_external_events [req-112933f4-be6b-4cae-8fff-95469caebf76 req-4d76e144-920f-4989-b87d-df9d902b3083 service nova] Creating event network-vif-deleted:8ea6a73b-f96b-45c1-b3fd-3688afc99566 for instance 452465c5-d313-4698-a666-9e814920b8fd on hv-cinder-82660 Oct 13 13:12:15.061607 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [req-112933f4-be6b-4cae-8fff-95469caebf76 req-4d76e144-920f-4989-b87d-df9d902b3083 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042204 Oct 13 13:12:15.062203 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 167/313] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 13:12:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 13:12:15.071299 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-ac41d745-060d-486b-9727-0d2eb7ac03a6 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Calling method '>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:12:15.072906 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-ac41d745-060d-486b-9727-0d2eb7ac03a6 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] [instance: 26bd475b-3495-4669-9985-d4a7dedb4bbf] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:12:15.081295 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-ac41d745-060d-486b-9727-0d2eb7ac03a6 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:12:15.082457 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-ac41d745-060d-486b-9727-0d2eb7ac03a6 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:12:15.083003 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-ac41d745-060d-486b-9727-0d2eb7ac03a6 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:12:15.083853 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-ac41d745-060d-486b-9727-0d2eb7ac03a6 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:12:15.084473 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-ac41d745-060d-486b-9727-0d2eb7ac03a6 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:12:15.085106 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-ac41d745-060d-486b-9727-0d2eb7ac03a6 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:12:15.231586 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-ac41d745-060d-486b-9727-0d2eb7ac03a6 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:12:15.242589 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-ac41d745-060d-486b-9727-0d2eb7ac03a6 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:12:15.244073 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-ac41d745-060d-486b-9727-0d2eb7ac03a6 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:12:15.245249 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-ac41d745-060d-486b-9727-0d2eb7ac03a6 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] 10.222.0.23 "GET /compute/v2.1/servers/26bd475b-3495-4669-9985-d4a7dedb4bbf" status: 200 len: 1740 microversion: 2.20 time: 0.181835 Oct 13 13:12:15.259625 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 168/314] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 13:12:15 2022] GET /compute/v2.1/servers/26bd475b-3495-4669-9985-d4a7dedb4bbf => generated 1740 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 13:12:15.259625 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-302edbf7-2b54-4f1d-bf71-11bad3fe0467 tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Action: 'create', calling method: .version_select at 0x7f5093e464c0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-80445656", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ7lBfiyqtgyqMbQDHNh4Ek2QnrYWcBIJaxxKhU7ftpNuACufAwZVU87F5fdICbFMVkDJK1nD3hB7/MaViGccttwmY4xbRS4sOuUnNuANEUArhd568g2ZZycGL362ZubyA=="}} {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 13:12:15.276138 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.quota [None req-302edbf7-2b54-4f1d-bf71-11bad3fe0467 tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Getting quotas for project 3ed5038c799342d48edc980983f1d996. Resources: {'key_pairs'} {{(pid=118814) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 13 13:12:15.280149 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.quota [None req-302edbf7-2b54-4f1d-bf71-11bad3fe0467 tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Getting quotas for user 7d89667e52b24295ba619203c02c7bd4 and project 3ed5038c799342d48edc980983f1d996. Resources: {'key_pairs'} {{(pid=118814) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 13 13:12:15.291132 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG dbcounter [-] [118814] Writing DB stats nova_api:SELECT=99,nova_api:INSERT=1 {{(pid=118814) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:12:15.317645 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-302edbf7-2b54-4f1d-bf71-11bad3fe0467 tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 401 microversion: 2.1 time: 0.065652 Oct 13 13:12:15.330031 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 169/315] 10.222.0.23 () {60 vars in 1159 bytes} [Thu Oct 13 13:12:15 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 13:12:15.345660 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.network.neutron [None req-32aadd6c-9778-4fee-8f7d-db063223b2f8 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] validate_networks() for [('6c7eaa8a-d195-41e7-950e-394b3e71b249', None, None, None, None, None)] {{(pid=118815) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 13 13:12:15.527337 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-013d3aa3-6e39-4e63-ab19-66c637e4c32d tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1609157801", "imageRef": "007eb4c2-0509-4bd8-9040-f26579042df3", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-80445656", "networks": [{"uuid": "166f36a0-8f38-4dea-a79f-656b2b96b465"}]}} {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 13:12:15.600799 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.network.neutron [None req-013d3aa3-6e39-4e63-ab19-66c637e4c32d tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] validate_networks() for [('166f36a0-8f38-4dea-a79f-656b2b96b465', None, None, None, None, None)] {{(pid=118814) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 13 13:12:16.240546 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.virt.hardware [None req-32aadd6c-9778-4fee-8f7d-db063223b2f8 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Flavor limits 0:0:0 {{(pid=118815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 13 13:12:16.240980 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.virt.hardware [None req-32aadd6c-9778-4fee-8f7d-db063223b2f8 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Image limits 0:0:0 {{(pid=118815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 13 13:12:16.241591 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.virt.hardware [None req-32aadd6c-9778-4fee-8f7d-db063223b2f8 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Flavor pref 0:0:0 {{(pid=118815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 13 13:12:16.242011 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.virt.hardware [None req-32aadd6c-9778-4fee-8f7d-db063223b2f8 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Image pref 0:0:0 {{(pid=118815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 13 13:12:16.242445 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.virt.hardware [None req-32aadd6c-9778-4fee-8f7d-db063223b2f8 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 13 13:12:16.251956 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-32aadd6c-9778-4fee-8f7d-db063223b2f8 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:12:16.252656 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-32aadd6c-9778-4fee-8f7d-db063223b2f8 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:12:16.253252 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-32aadd6c-9778-4fee-8f7d-db063223b2f8 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:12:16.254735 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-32aadd6c-9778-4fee-8f7d-db063223b2f8 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:12:16.255531 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-32aadd6c-9778-4fee-8f7d-db063223b2f8 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:12:16.256086 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-32aadd6c-9778-4fee-8f7d-db063223b2f8 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:12:16.262436 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG dbcounter [-] [118815] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:12:16.278439 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.quota [None req-32aadd6c-9778-4fee-8f7d-db063223b2f8 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Getting quotas for project 5e7312d0ac9248f2bfbece5611913ab2. Resources: {'instances', 'cores', 'ram'} {{(pid=118815) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 13 13:12:16.283306 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.quota [None req-32aadd6c-9778-4fee-8f7d-db063223b2f8 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Getting quotas for user 454203f47b434cca952a1cef56de559f and project 5e7312d0ac9248f2bfbece5611913ab2. Resources: {'instances', 'cores', 'ram'} {{(pid=118815) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 13 13:12:16.296221 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-32aadd6c-9778-4fee-8f7d-db063223b2f8 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Going to run 1 instances... {{(pid=118815) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 13 13:12:16.298665 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-32aadd6c-9778-4fee-8f7d-db063223b2f8 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] [instance: b4ba0fd3-eb17-4e05-acaa-5570c1e364d7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e2cdd20b-2540-48bc-a05c-d6a2e7e9a66e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118815) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 13 13:12:16.359153 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-32aadd6c-9778-4fee-8f7d-db063223b2f8 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 2.591547 Oct 13 13:12:16.360843 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 147/316] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Oct 13 13:12:13 2022] POST /compute/v2.1/servers => generated 409 bytes in 2594 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 13 13:12:16.366747 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-d9e8fce3-fc2b-4263-81a4-a4c879fc7e92 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Calling method '>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:12:16.367852 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-d9e8fce3-fc2b-4263-81a4-a4c879fc7e92 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] [instance: e125ab44-9111-4260-909d-95d57b7861a7] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:12:16.375087 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-d9e8fce3-fc2b-4263-81a4-a4c879fc7e92 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:12:16.375776 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-d9e8fce3-fc2b-4263-81a4-a4c879fc7e92 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:12:16.377114 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-d9e8fce3-fc2b-4263-81a4-a4c879fc7e92 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:12:16.377996 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-d9e8fce3-fc2b-4263-81a4-a4c879fc7e92 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:12:16.379160 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-d9e8fce3-fc2b-4263-81a4-a4c879fc7e92 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:12:16.379733 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-d9e8fce3-fc2b-4263-81a4-a4c879fc7e92 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:12:16.516827 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.virt.hardware [None req-013d3aa3-6e39-4e63-ab19-66c637e4c32d tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Flavor limits 0:0:0 {{(pid=118814) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 13 13:12:16.517455 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.virt.hardware [None req-013d3aa3-6e39-4e63-ab19-66c637e4c32d tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Image limits 0:0:0 {{(pid=118814) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 13 13:12:16.518394 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.virt.hardware [None req-013d3aa3-6e39-4e63-ab19-66c637e4c32d tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Flavor pref 0:0:0 {{(pid=118814) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 13 13:12:16.519089 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.virt.hardware [None req-013d3aa3-6e39-4e63-ab19-66c637e4c32d tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Image pref 0:0:0 {{(pid=118814) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 13 13:12:16.519757 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.virt.hardware [None req-013d3aa3-6e39-4e63-ab19-66c637e4c32d tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118814) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 13 13:12:16.538884 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-013d3aa3-6e39-4e63-ab19-66c637e4c32d tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:12:16.542593 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-013d3aa3-6e39-4e63-ab19-66c637e4c32d tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:12:16.543493 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-013d3aa3-6e39-4e63-ab19-66c637e4c32d tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:12:16.554489 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-013d3aa3-6e39-4e63-ab19-66c637e4c32d tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:12:16.555949 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-013d3aa3-6e39-4e63-ab19-66c637e4c32d tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:12:16.557147 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-013d3aa3-6e39-4e63-ab19-66c637e4c32d tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:12:16.620440 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.quota [None req-013d3aa3-6e39-4e63-ab19-66c637e4c32d tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Getting quotas for project 3ed5038c799342d48edc980983f1d996. Resources: {'instances', 'cores', 'ram'} {{(pid=118814) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 13 13:12:16.632210 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.quota [None req-013d3aa3-6e39-4e63-ab19-66c637e4c32d tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Getting quotas for user 7d89667e52b24295ba619203c02c7bd4 and project 3ed5038c799342d48edc980983f1d996. Resources: {'instances', 'cores', 'ram'} {{(pid=118814) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 13 13:12:16.655613 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-013d3aa3-6e39-4e63-ab19-66c637e4c32d tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Going to run 1 instances... {{(pid=118814) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 13 13:12:16.658068 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-013d3aa3-6e39-4e63-ab19-66c637e4c32d tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] [instance: 59e81a58-9400-4cea-aa38-b24b394e33d7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='007eb4c2-0509-4bd8-9040-f26579042df3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118814) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 13 13:12:16.734675 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-d9e8fce3-fc2b-4263-81a4-a4c879fc7e92 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e783caddcad473dbdd764919286e244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecd3d5d2a3a54a07ba64f1fea4846c40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:12:16.736226 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-013d3aa3-6e39-4e63-ab19-66c637e4c32d tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.216011 Oct 13 13:12:16.738524 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 170/317] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Oct 13 13:12:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 1220 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 13 13:12:16.751785 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-ee7ebd20-b903-473a-a73e-f168c4ce9f9f tempest-VolumesNegativeTest-1101616844 tempest-VolumesNegativeTest-1101616844-project] Calling method '>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:12:16.754931 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-ee7ebd20-b903-473a-a73e-f168c4ce9f9f tempest-VolumesNegativeTest-1101616844 tempest-VolumesNegativeTest-1101616844-project] [instance: 452465c5-d313-4698-a666-9e814920b8fd] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:12:16.760741 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-d9e8fce3-fc2b-4263-81a4-a4c879fc7e92 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] 10.222.0.23 "GET /compute/v2.1/servers/e125ab44-9111-4260-909d-95d57b7861a7" status: 200 len: 1724 microversion: 2.1 time: 0.398507 Oct 13 13:12:16.762007 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 148/318] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:12:16 2022] GET /compute/v2.1/servers/e125ab44-9111-4260-909d-95d57b7861a7 => generated 1724 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:12:16.770660 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-1047d562-0fd6-4d5f-9f4d-562b97721ef0 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Calling method '>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:12:16.770884 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-ee7ebd20-b903-473a-a73e-f168c4ce9f9f tempest-VolumesNegativeTest-1101616844 tempest-VolumesNegativeTest-1101616844-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:12:16.772035 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-1047d562-0fd6-4d5f-9f4d-562b97721ef0 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] [instance: 26bd475b-3495-4669-9985-d4a7dedb4bbf] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:12:16.773469 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-ee7ebd20-b903-473a-a73e-f168c4ce9f9f tempest-VolumesNegativeTest-1101616844 tempest-VolumesNegativeTest-1101616844-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:12:16.774156 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-ee7ebd20-b903-473a-a73e-f168c4ce9f9f tempest-VolumesNegativeTest-1101616844 tempest-VolumesNegativeTest-1101616844-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:12:16.778361 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-ee7ebd20-b903-473a-a73e-f168c4ce9f9f tempest-VolumesNegativeTest-1101616844 tempest-VolumesNegativeTest-1101616844-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:12:16.779362 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-ee7ebd20-b903-473a-a73e-f168c4ce9f9f tempest-VolumesNegativeTest-1101616844 tempest-VolumesNegativeTest-1101616844-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:12:16.780072 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-ee7ebd20-b903-473a-a73e-f168c4ce9f9f tempest-VolumesNegativeTest-1101616844 tempest-VolumesNegativeTest-1101616844-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:12:16.787862 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-1047d562-0fd6-4d5f-9f4d-562b97721ef0 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:12:16.788955 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-1047d562-0fd6-4d5f-9f4d-562b97721ef0 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:12:16.790257 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-1047d562-0fd6-4d5f-9f4d-562b97721ef0 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:12:16.791680 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-1047d562-0fd6-4d5f-9f4d-562b97721ef0 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:12:16.792765 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-1047d562-0fd6-4d5f-9f4d-562b97721ef0 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:12:16.793428 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-1047d562-0fd6-4d5f-9f4d-562b97721ef0 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:12:16.899412 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-ee7ebd20-b903-473a-a73e-f168c4ce9f9f tempest-VolumesNegativeTest-1101616844 tempest-VolumesNegativeTest-1101616844-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:12:16.903833 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-ee7ebd20-b903-473a-a73e-f168c4ce9f9f tempest-VolumesNegativeTest-1101616844 tempest-VolumesNegativeTest-1101616844-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:12:16.905821 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-ee7ebd20-b903-473a-a73e-f168c4ce9f9f tempest-VolumesNegativeTest-1101616844 tempest-VolumesNegativeTest-1101616844-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:12:16.907418 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.objects.instance [None req-ee7ebd20-b903-473a-a73e-f168c4ce9f9f tempest-VolumesNegativeTest-1101616844 tempest-VolumesNegativeTest-1101616844-project] Lazy-loading 'fault' on Instance uuid 452465c5-d313-4698-a666-9e814920b8fd {{(pid=118814) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 13 13:12:17.064335 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-ee7ebd20-b903-473a-a73e-f168c4ce9f9f tempest-VolumesNegativeTest-1101616844 tempest-VolumesNegativeTest-1101616844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd5dc5471e5246f4878f1d91d59b68f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e74136856dcf42c48689e6976f16caad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:12:17.075247 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-ee7ebd20-b903-473a-a73e-f168c4ce9f9f tempest-VolumesNegativeTest-1101616844 tempest-VolumesNegativeTest-1101616844-project] 10.222.0.23 "GET /compute/v2.1/servers/452465c5-d313-4698-a666-9e814920b8fd" status: 200 len: 1305 microversion: 2.1 time: 0.335361 Oct 13 13:12:17.080422 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 171/319] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:12:16 2022] GET /compute/v2.1/servers/452465c5-d313-4698-a666-9e814920b8fd => generated 1305 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:12:17.100146 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-9efb1e15-963b-4a1a-a59d-0811d96e89b5 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Calling method '>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:12:17.100669 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-9efb1e15-963b-4a1a-a59d-0811d96e89b5 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] [instance: b4ba0fd3-eb17-4e05-acaa-5570c1e364d7] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:12:17.122135 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-9efb1e15-963b-4a1a-a59d-0811d96e89b5 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:12:17.122716 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-9efb1e15-963b-4a1a-a59d-0811d96e89b5 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:12:17.128173 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-9efb1e15-963b-4a1a-a59d-0811d96e89b5 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:12:17.131308 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-9efb1e15-963b-4a1a-a59d-0811d96e89b5 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:12:17.131815 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-9efb1e15-963b-4a1a-a59d-0811d96e89b5 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:12:17.132252 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-9efb1e15-963b-4a1a-a59d-0811d96e89b5 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:12:17.195568 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-1047d562-0fd6-4d5f-9f4d-562b97721ef0 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:12:17.217474 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-1047d562-0fd6-4d5f-9f4d-562b97721ef0 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:12:17.219254 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-1047d562-0fd6-4d5f-9f4d-562b97721ef0 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:12:17.221049 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-1047d562-0fd6-4d5f-9f4d-562b97721ef0 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] 10.222.0.23 "GET /compute/v2.1/servers/26bd475b-3495-4669-9985-d4a7dedb4bbf" status: 200 len: 1740 microversion: 2.20 time: 0.457874 Oct 13 13:12:17.221702 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 149/320] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 13:12:16 2022] GET /compute/v2.1/servers/26bd475b-3495-4669-9985-d4a7dedb4bbf => generated 1740 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 13:12:17.250089 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-11c26deb-3275-4449-bd85-a595a89bfed3 tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Calling method '>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:12:17.250953 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-11c26deb-3275-4449-bd85-a595a89bfed3 tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] [instance: 59e81a58-9400-4cea-aa38-b24b394e33d7] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:12:17.269558 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG dbcounter [-] [118815] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=118815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:12:17.329300 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-9efb1e15-963b-4a1a-a59d-0811d96e89b5 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '454203f47b434cca952a1cef56de559f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7312d0ac9248f2bfbece5611913ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:12:17.338056 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-9efb1e15-963b-4a1a-a59d-0811d96e89b5 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] 10.222.0.23 "GET /compute/v2.1/servers/b4ba0fd3-eb17-4e05-acaa-5570c1e364d7" status: 200 len: 1249 microversion: 2.1 time: 0.256525 Oct 13 13:12:17.352627 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 172/321] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:12:17 2022] GET /compute/v2.1/servers/b4ba0fd3-eb17-4e05-acaa-5570c1e364d7 => generated 1249 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:12:17.356613 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-11c26deb-3275-4449-bd85-a595a89bfed3 tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d89667e52b24295ba619203c02c7bd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed5038c799342d48edc980983f1d996', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:12:17.364784 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-11c26deb-3275-4449-bd85-a595a89bfed3 tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] 10.222.0.23 "GET /compute/v2.1/servers/59e81a58-9400-4cea-aa38-b24b394e33d7" status: 200 len: 1257 microversion: 2.1 time: 0.121668 Oct 13 13:12:17.368042 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 150/322] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:12:17 2022] GET /compute/v2.1/servers/59e81a58-9400-4cea-aa38-b24b394e33d7 => generated 1257 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:12:17.789517 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-ffaaa9a1-4d02-4b80-89c2-ae555d67a8ad tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Calling method '>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:12:17.790825 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-ffaaa9a1-4d02-4b80-89c2-ae555d67a8ad tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] [instance: e125ab44-9111-4260-909d-95d57b7861a7] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:12:17.798880 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-ffaaa9a1-4d02-4b80-89c2-ae555d67a8ad tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:12:17.799620 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-ffaaa9a1-4d02-4b80-89c2-ae555d67a8ad tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:12:17.800254 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-ffaaa9a1-4d02-4b80-89c2-ae555d67a8ad tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:12:17.802811 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-ffaaa9a1-4d02-4b80-89c2-ae555d67a8ad tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:12:17.803516 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-ffaaa9a1-4d02-4b80-89c2-ae555d67a8ad tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:12:17.804137 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-ffaaa9a1-4d02-4b80-89c2-ae555d67a8ad tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:12:18.031988 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-ffaaa9a1-4d02-4b80-89c2-ae555d67a8ad tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e783caddcad473dbdd764919286e244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecd3d5d2a3a54a07ba64f1fea4846c40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:12:18.042831 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-ffaaa9a1-4d02-4b80-89c2-ae555d67a8ad tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] 10.222.0.23 "GET /compute/v2.1/servers/e125ab44-9111-4260-909d-95d57b7861a7" status: 200 len: 1701 microversion: 2.1 time: 0.259633 Oct 13 13:12:18.052447 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 173/323] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:12:17 2022] GET /compute/v2.1/servers/e125ab44-9111-4260-909d-95d57b7861a7 => generated 1701 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:12:18.072693 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-66015e03-2405-476b-bf65-3fcef2928fe9 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 13:12:18.081801 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-66015e03-2405-476b-bf65-3fcef2928fe9 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:12:18.083339 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-66015e03-2405-476b-bf65-3fcef2928fe9 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:12:18.084202 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-66015e03-2405-476b-bf65-3fcef2928fe9 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:12:18.103089 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-ba3190c4-6544-4a68-817d-5b77a74d7589 tempest-VolumesNegativeTest-1101616844 tempest-VolumesNegativeTest-1101616844-project] Calling method '>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:12:18.104651 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-ba3190c4-6544-4a68-817d-5b77a74d7589 tempest-VolumesNegativeTest-1101616844 tempest-VolumesNegativeTest-1101616844-project] [instance: 452465c5-d313-4698-a666-9e814920b8fd] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:12:18.115358 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-ba3190c4-6544-4a68-817d-5b77a74d7589 tempest-VolumesNegativeTest-1101616844 tempest-VolumesNegativeTest-1101616844-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:12:18.115946 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-ba3190c4-6544-4a68-817d-5b77a74d7589 tempest-VolumesNegativeTest-1101616844 tempest-VolumesNegativeTest-1101616844-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:12:18.116383 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-66015e03-2405-476b-bf65-3fcef2928fe9 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] [instance: e125ab44-9111-4260-909d-95d57b7861a7] Going to try to start instance {{(pid=118815) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 13 13:12:18.116509 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-ba3190c4-6544-4a68-817d-5b77a74d7589 tempest-VolumesNegativeTest-1101616844 tempest-VolumesNegativeTest-1101616844-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:12:18.117278 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-ba3190c4-6544-4a68-817d-5b77a74d7589 tempest-VolumesNegativeTest-1101616844 tempest-VolumesNegativeTest-1101616844-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:12:18.117886 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-ba3190c4-6544-4a68-817d-5b77a74d7589 tempest-VolumesNegativeTest-1101616844 tempest-VolumesNegativeTest-1101616844-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:12:18.118387 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-ba3190c4-6544-4a68-817d-5b77a74d7589 tempest-VolumesNegativeTest-1101616844 tempest-VolumesNegativeTest-1101616844-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:12:18.135655 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.wsgi [None req-ba3190c4-6544-4a68-817d-5b77a74d7589 tempest-VolumesNegativeTest-1101616844 tempest-VolumesNegativeTest-1101616844-project] HTTP exception thrown: Instance 452465c5-d313-4698-a666-9e814920b8fd could not be found. Oct 13 13:12:18.138366 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-ba3190c4-6544-4a68-817d-5b77a74d7589 tempest-VolumesNegativeTest-1101616844 tempest-VolumesNegativeTest-1101616844-project] Request method failure captured: Oct 13 13:12:18.138366 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: request: GET /compute/v2.1/servers/452465c5-d313-4698-a666-9e814920b8fd HTTP/1.1 Oct 13 13:12:18.138366 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: Accept: application/json Oct 13 13:12:18.138366 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: Accept-Encoding: identity Oct 13 13:12:18.138366 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: Connection: close Oct 13 13:12:18.138366 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: Content-Length: 0 Oct 13 13:12:18.138366 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: Content-Type: application/json Oct 13 13:12:18.138366 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: Host: 10.222.0.23 Oct 13 13:12:18.138366 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: Openstack-System-Scope: None Oct 13 13:12:18.138366 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: User-Agent: python-urllib3/1.26.12 Oct 13 13:12:18.138366 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Auth-Token: gAAAAABjSA6OjvJ-3y2om83jEkpwRKngrkMrJmikXbb2D47n41ANUmFk_cJ_6MItfbLNjeG9Y3M-01spLkQpOMg9SCYYqXU24EdI2w_O9VQIRiGAw6povmPERlO2RRDzUHbHD3FjHpuL9lEN4HAhZ6VUg-NjVVH8aGlMTrw5aU5nHBZKaYd4FvE Oct 13 13:12:18.138366 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Domain-Id: None Oct 13 13:12:18.138366 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Domain-Name: None Oct 13 13:12:18.138366 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Identity-Status: Confirmed Oct 13 13:12:18.138366 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Is-Admin-Project: True Oct 13 13:12:18.138366 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Project-Domain-Id: default Oct 13 13:12:18.138366 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Project-Domain-Name: Default Oct 13 13:12:18.138366 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Project-Id: e74136856dcf42c48689e6976f16caad Oct 13 13:12:18.138366 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Project-Name: tempest-VolumesNegativeTest-1101616844 Oct 13 13:12:18.138366 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Role: reader,member Oct 13 13:12:18.138366 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Roles: reader,member Oct 13 13:12:18.139980 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_e74136856dcf42c48689e6976f16caad"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e74136856dcf42c48689e6976f16caad"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e74136856dcf42c48689e6976f16caad"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/e74136856dcf42c48689e6976f16caad"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}] Oct 13 13:12:18.139980 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Tenant: tempest-VolumesNegativeTest-1101616844 Oct 13 13:12:18.139980 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Tenant-Id: e74136856dcf42c48689e6976f16caad Oct 13 13:12:18.139980 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Tenant-Name: tempest-VolumesNegativeTest-1101616844 Oct 13 13:12:18.139980 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-User: tempest-VolumesNegativeTest-1101616844-project Oct 13 13:12:18.139980 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-User-Domain-Id: default Oct 13 13:12:18.139980 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-User-Domain-Name: Default Oct 13 13:12:18.139980 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-User-Id: fd5dc5471e5246f4878f1d91d59b68f2 Oct 13 13:12:18.139980 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-User-Name: tempest-VolumesNegativeTest-1101616844-project Oct 13 13:12:18.139980 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: method: > Oct 13 13:12:18.139980 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: exception: Instance 452465c5-d313-4698-a666-9e814920b8fd could not be found. Oct 13 13:12:18.139980 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: action_args: {'id': '452465c5-d313-4698-a666-9e814920b8fd'} Oct 13 13:12:18.140908 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 13:12:18.140908 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 13:12:18.140908 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 13 13:12:18.140908 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 13 13:12:18.140908 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 13 13:12:18.140908 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 13 13:12:18.140908 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 13 13:12:18.140908 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 13 13:12:18.140908 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 13 13:12:18.140908 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 13 13:12:18.140908 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 452465c5-d313-4698-a666-9e814920b8fd could not be found. Oct 13 13:12:18.140908 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi Oct 13 13:12:18.140908 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 13:12:18.140908 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi Oct 13 13:12:18.140908 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 13:12:18.140908 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 13:12:18.140908 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 13:12:18.140908 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 13:12:18.140908 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 13:12:18.140908 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 13:12:18.142360 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 13:12:18.142360 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 13 13:12:18.142360 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 13 13:12:18.142360 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 13 13:12:18.142360 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 13 13:12:18.142360 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 13 13:12:18.142360 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 13 13:12:18.142360 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 452465c5-d313-4698-a666-9e814920b8fd could not be found. Oct 13 13:12:18.142360 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi Oct 13 13:12:18.142360 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 13:12:18.142360 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi Oct 13 13:12:18.142360 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 13:12:18.142360 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 13:12:18.142360 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 13:12:18.142360 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 13:12:18.142360 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 13:12:18.142360 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 452465c5-d313-4698-a666-9e814920b8fd could not be found. Oct 13 13:12:18.142360 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi Oct 13 13:12:18.144752 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-ba3190c4-6544-4a68-817d-5b77a74d7589 tempest-VolumesNegativeTest-1101616844 tempest-VolumesNegativeTest-1101616844-project] Returning 404 to user: Instance 452465c5-d313-4698-a666-9e814920b8fd could not be found. {{(pid=118814) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 13:12:18.145444 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-ba3190c4-6544-4a68-817d-5b77a74d7589 tempest-VolumesNegativeTest-1101616844 tempest-VolumesNegativeTest-1101616844-project] 10.222.0.23 "GET /compute/v2.1/servers/452465c5-d313-4698-a666-9e814920b8fd" status: 404 len: 111 microversion: 2.1 time: 0.046885 Oct 13 13:12:18.146245 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 174/324] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:12:18 2022] GET /compute/v2.1/servers/452465c5-d313-4698-a666-9e814920b8fd => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 13 13:12:18.220127 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-66015e03-2405-476b-bf65-3fcef2928fe9 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] 10.222.0.23 "POST /compute/v2.1/servers/e125ab44-9111-4260-909d-95d57b7861a7/action" status: 202 len: 0 microversion: 2.1 time: 0.154852 Oct 13 13:12:18.222135 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 151/325] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Oct 13 13:12:18 2022] POST /compute/v2.1/servers/e125ab44-9111-4260-909d-95d57b7861a7/action => generated 0 bytes in 158 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 13 13:12:18.230955 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-08b64d5f-c9a0-4391-aaa5-29b40fd1a294 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Calling method '>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:12:18.231593 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-08b64d5f-c9a0-4391-aaa5-29b40fd1a294 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] [instance: e125ab44-9111-4260-909d-95d57b7861a7] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:12:18.242508 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-08b64d5f-c9a0-4391-aaa5-29b40fd1a294 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:12:18.243002 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-08b64d5f-c9a0-4391-aaa5-29b40fd1a294 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:12:18.247890 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-08b64d5f-c9a0-4391-aaa5-29b40fd1a294 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:12:18.249064 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-19492946-2b59-4990-85bc-0eaee8d9fb50 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Calling method '>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:12:18.249752 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-19492946-2b59-4990-85bc-0eaee8d9fb50 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] [instance: 26bd475b-3495-4669-9985-d4a7dedb4bbf] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:12:18.251500 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-08b64d5f-c9a0-4391-aaa5-29b40fd1a294 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:12:18.253823 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-08b64d5f-c9a0-4391-aaa5-29b40fd1a294 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:12:18.254361 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-08b64d5f-c9a0-4391-aaa5-29b40fd1a294 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:12:18.262375 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-19492946-2b59-4990-85bc-0eaee8d9fb50 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:12:18.263197 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-19492946-2b59-4990-85bc-0eaee8d9fb50 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:12:18.263838 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-19492946-2b59-4990-85bc-0eaee8d9fb50 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:12:18.264561 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-19492946-2b59-4990-85bc-0eaee8d9fb50 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:12:18.269879 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-19492946-2b59-4990-85bc-0eaee8d9fb50 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:12:18.272939 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-19492946-2b59-4990-85bc-0eaee8d9fb50 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:12:18.781779 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-19492946-2b59-4990-85bc-0eaee8d9fb50 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:12:18.796218 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-19492946-2b59-4990-85bc-0eaee8d9fb50 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:12:18.805531 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-19492946-2b59-4990-85bc-0eaee8d9fb50 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:12:18.814213 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-19492946-2b59-4990-85bc-0eaee8d9fb50 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] 10.222.0.23 "GET /compute/v2.1/servers/26bd475b-3495-4669-9985-d4a7dedb4bbf" status: 200 len: 1740 microversion: 2.20 time: 0.569312 Oct 13 13:12:18.815089 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 152/326] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 13:12:18 2022] GET /compute/v2.1/servers/26bd475b-3495-4669-9985-d4a7dedb4bbf => generated 1740 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 13:12:18.840641 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-6e8cf7b2-2a12-49fd-bcea-1576c92d12bd tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Calling method '>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:12:18.844061 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-08b64d5f-c9a0-4391-aaa5-29b40fd1a294 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e783caddcad473dbdd764919286e244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecd3d5d2a3a54a07ba64f1fea4846c40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:12:18.855629 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-6e8cf7b2-2a12-49fd-bcea-1576c92d12bd tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] [instance: b4ba0fd3-eb17-4e05-acaa-5570c1e364d7] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:12:18.870096 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-6e8cf7b2-2a12-49fd-bcea-1576c92d12bd tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:12:18.873286 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-6e8cf7b2-2a12-49fd-bcea-1576c92d12bd tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:12:18.875319 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-6e8cf7b2-2a12-49fd-bcea-1576c92d12bd tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:12:18.875816 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-08b64d5f-c9a0-4391-aaa5-29b40fd1a294 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] 10.222.0.23 "GET /compute/v2.1/servers/e125ab44-9111-4260-909d-95d57b7861a7" status: 200 len: 1710 microversion: 2.1 time: 0.649158 Oct 13 13:12:18.876504 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-6e8cf7b2-2a12-49fd-bcea-1576c92d12bd tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:12:18.877912 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 175/327] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:12:18 2022] GET /compute/v2.1/servers/e125ab44-9111-4260-909d-95d57b7861a7 => generated 1710 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:12:18.881568 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-6e8cf7b2-2a12-49fd-bcea-1576c92d12bd tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:12:18.882092 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-6e8cf7b2-2a12-49fd-bcea-1576c92d12bd tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:12:18.904564 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-06ba3b55-aad2-47a7-b939-f428e8876b08 tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Calling method '>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:12:18.913316 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-06ba3b55-aad2-47a7-b939-f428e8876b08 tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] [instance: 59e81a58-9400-4cea-aa38-b24b394e33d7] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:12:18.930469 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-06ba3b55-aad2-47a7-b939-f428e8876b08 tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:12:18.934903 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-06ba3b55-aad2-47a7-b939-f428e8876b08 tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:12:18.938837 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-06ba3b55-aad2-47a7-b939-f428e8876b08 tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:12:18.941377 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-06ba3b55-aad2-47a7-b939-f428e8876b08 tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:12:18.942304 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-06ba3b55-aad2-47a7-b939-f428e8876b08 tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:12:18.946489 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-06ba3b55-aad2-47a7-b939-f428e8876b08 tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:12:19.073796 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-6e8cf7b2-2a12-49fd-bcea-1576c92d12bd tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '454203f47b434cca952a1cef56de559f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7312d0ac9248f2bfbece5611913ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:12:19.087452 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-6e8cf7b2-2a12-49fd-bcea-1576c92d12bd tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] 10.222.0.23 "GET /compute/v2.1/servers/b4ba0fd3-eb17-4e05-acaa-5570c1e364d7" status: 200 len: 1303 microversion: 2.1 time: 0.258174 Oct 13 13:12:19.090638 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 153/328] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:12:18 2022] GET /compute/v2.1/servers/b4ba0fd3-eb17-4e05-acaa-5570c1e364d7 => generated 1303 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:12:19.115211 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-06ba3b55-aad2-47a7-b939-f428e8876b08 tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d89667e52b24295ba619203c02c7bd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed5038c799342d48edc980983f1d996', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:12:19.125031 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-06ba3b55-aad2-47a7-b939-f428e8876b08 tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] 10.222.0.23 "GET /compute/v2.1/servers/59e81a58-9400-4cea-aa38-b24b394e33d7" status: 200 len: 1309 microversion: 2.1 time: 0.242559 Oct 13 13:12:19.139356 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 176/329] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:12:18 2022] GET /compute/v2.1/servers/59e81a58-9400-4cea-aa38-b24b394e33d7 => generated 1309 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:12:19.845244 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-19760d42-371a-49ac-9592-07a7867cb15f tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Calling method '>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:12:19.845678 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-19760d42-371a-49ac-9592-07a7867cb15f tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] [instance: 26bd475b-3495-4669-9985-d4a7dedb4bbf] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:12:19.854029 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-19760d42-371a-49ac-9592-07a7867cb15f tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:12:19.854533 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-19760d42-371a-49ac-9592-07a7867cb15f tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:12:19.855886 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-19760d42-371a-49ac-9592-07a7867cb15f tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:12:19.856627 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-19760d42-371a-49ac-9592-07a7867cb15f tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:12:19.857244 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-19760d42-371a-49ac-9592-07a7867cb15f tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:12:19.857686 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-19760d42-371a-49ac-9592-07a7867cb15f tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:12:19.904857 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-d881943f-f6bd-4292-852c-a8f9a274500b tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Calling method '>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:12:19.905602 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-d881943f-f6bd-4292-852c-a8f9a274500b tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] [instance: e125ab44-9111-4260-909d-95d57b7861a7] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:12:19.915726 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-d881943f-f6bd-4292-852c-a8f9a274500b tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:12:19.916633 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-d881943f-f6bd-4292-852c-a8f9a274500b tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:12:19.917087 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-d881943f-f6bd-4292-852c-a8f9a274500b tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:12:19.921386 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-d881943f-f6bd-4292-852c-a8f9a274500b tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:12:19.924545 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-d881943f-f6bd-4292-852c-a8f9a274500b tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:12:19.927734 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-d881943f-f6bd-4292-852c-a8f9a274500b tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:12:20.203675 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-d881943f-f6bd-4292-852c-a8f9a274500b tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e783caddcad473dbdd764919286e244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecd3d5d2a3a54a07ba64f1fea4846c40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:12:20.207709 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG dbcounter [-] [118814] Writing DB stats nova_cell1:SELECT=100 {{(pid=118814) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:12:20.221425 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-d881943f-f6bd-4292-852c-a8f9a274500b tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] 10.222.0.23 "GET /compute/v2.1/servers/e125ab44-9111-4260-909d-95d57b7861a7" status: 200 len: 1710 microversion: 2.1 time: 0.313889 Oct 13 13:12:20.240603 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 177/330] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:12:19 2022] GET /compute/v2.1/servers/e125ab44-9111-4260-909d-95d57b7861a7 => generated 1710 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 13:12:20.244938 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-19760d42-371a-49ac-9592-07a7867cb15f tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:12:20.246266 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-4a6a5e2e-e873-43a3-b1c2-c8be30f7dbb5 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Calling method '>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:12:20.246884 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-4a6a5e2e-e873-43a3-b1c2-c8be30f7dbb5 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] [instance: b4ba0fd3-eb17-4e05-acaa-5570c1e364d7] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:12:20.254711 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-4a6a5e2e-e873-43a3-b1c2-c8be30f7dbb5 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:12:20.255771 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-4a6a5e2e-e873-43a3-b1c2-c8be30f7dbb5 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:12:20.256752 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-4a6a5e2e-e873-43a3-b1c2-c8be30f7dbb5 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:12:20.257631 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-4a6a5e2e-e873-43a3-b1c2-c8be30f7dbb5 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:12:20.258248 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-4a6a5e2e-e873-43a3-b1c2-c8be30f7dbb5 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:12:20.259212 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-4a6a5e2e-e873-43a3-b1c2-c8be30f7dbb5 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:12:20.263303 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-19760d42-371a-49ac-9592-07a7867cb15f tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:12:20.268285 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-19760d42-371a-49ac-9592-07a7867cb15f tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:12:20.273631 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-19760d42-371a-49ac-9592-07a7867cb15f tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] 10.222.0.23 "GET /compute/v2.1/servers/26bd475b-3495-4669-9985-d4a7dedb4bbf" status: 200 len: 1740 microversion: 2.20 time: 0.432695 Oct 13 13:12:20.276521 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 154/331] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 13:12:19 2022] GET /compute/v2.1/servers/26bd475b-3495-4669-9985-d4a7dedb4bbf => generated 1740 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 13:12:20.287807 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-c561a28e-2200-40fb-82cd-9de370fbb8e1 tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Calling method '>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:12:20.288749 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-c561a28e-2200-40fb-82cd-9de370fbb8e1 tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] [instance: 59e81a58-9400-4cea-aa38-b24b394e33d7] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:12:20.306968 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-c561a28e-2200-40fb-82cd-9de370fbb8e1 tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:12:20.307662 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-c561a28e-2200-40fb-82cd-9de370fbb8e1 tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:12:20.308411 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-c561a28e-2200-40fb-82cd-9de370fbb8e1 tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:12:20.309385 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-c561a28e-2200-40fb-82cd-9de370fbb8e1 tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:12:20.310074 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-c561a28e-2200-40fb-82cd-9de370fbb8e1 tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:12:20.311745 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-c561a28e-2200-40fb-82cd-9de370fbb8e1 tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:12:20.406708 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-c561a28e-2200-40fb-82cd-9de370fbb8e1 tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d89667e52b24295ba619203c02c7bd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed5038c799342d48edc980983f1d996', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:12:20.419363 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-c561a28e-2200-40fb-82cd-9de370fbb8e1 tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] 10.222.0.23 "GET /compute/v2.1/servers/59e81a58-9400-4cea-aa38-b24b394e33d7" status: 200 len: 1317 microversion: 2.1 time: 0.140295 Oct 13 13:12:20.420983 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 155/332] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:12:20 2022] GET /compute/v2.1/servers/59e81a58-9400-4cea-aa38-b24b394e33d7 => generated 1317 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:12:20.513057 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-4a6a5e2e-e873-43a3-b1c2-c8be30f7dbb5 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '454203f47b434cca952a1cef56de559f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7312d0ac9248f2bfbece5611913ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:12:20.522412 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-4a6a5e2e-e873-43a3-b1c2-c8be30f7dbb5 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] 10.222.0.23 "GET /compute/v2.1/servers/b4ba0fd3-eb17-4e05-acaa-5570c1e364d7" status: 200 len: 1371 microversion: 2.1 time: 0.280666 Oct 13 13:12:20.524752 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 178/333] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:12:20 2022] GET /compute/v2.1/servers/b4ba0fd3-eb17-4e05-acaa-5570c1e364d7 => generated 1371 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:12:21.245801 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-bade496d-061b-4572-84db-4552b5666b75 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Calling method '>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:12:21.246414 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-bade496d-061b-4572-84db-4552b5666b75 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] [instance: e125ab44-9111-4260-909d-95d57b7861a7] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:12:21.253717 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-bade496d-061b-4572-84db-4552b5666b75 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:12:21.254686 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-bade496d-061b-4572-84db-4552b5666b75 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:12:21.255222 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-bade496d-061b-4572-84db-4552b5666b75 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:12:21.256096 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-bade496d-061b-4572-84db-4552b5666b75 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:12:21.256372 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-bade496d-061b-4572-84db-4552b5666b75 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:12:21.257003 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-bade496d-061b-4572-84db-4552b5666b75 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:12:21.302245 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-b357b577-8112-4588-b7ac-1c6065e1df52 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Calling method '>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:12:21.303100 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-b357b577-8112-4588-b7ac-1c6065e1df52 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] [instance: 26bd475b-3495-4669-9985-d4a7dedb4bbf] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:12:21.310089 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-b357b577-8112-4588-b7ac-1c6065e1df52 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:12:21.310676 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-b357b577-8112-4588-b7ac-1c6065e1df52 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:12:21.311212 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-b357b577-8112-4588-b7ac-1c6065e1df52 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:12:21.311994 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-b357b577-8112-4588-b7ac-1c6065e1df52 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:12:21.312533 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-b357b577-8112-4588-b7ac-1c6065e1df52 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:12:21.313030 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-b357b577-8112-4588-b7ac-1c6065e1df52 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:12:21.475526 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-bade496d-061b-4572-84db-4552b5666b75 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e783caddcad473dbdd764919286e244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecd3d5d2a3a54a07ba64f1fea4846c40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:12:21.485162 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-bade496d-061b-4572-84db-4552b5666b75 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] 10.222.0.23 "GET /compute/v2.1/servers/e125ab44-9111-4260-909d-95d57b7861a7" status: 200 len: 1710 microversion: 2.1 time: 0.243096 Oct 13 13:12:21.485753 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 156/334] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:12:21 2022] GET /compute/v2.1/servers/e125ab44-9111-4260-909d-95d57b7861a7 => generated 1710 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:12:21.499174 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-abf9663b-fdf4-44ac-9f41-0fe09b10569e tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Calling method '>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:12:21.500363 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-abf9663b-fdf4-44ac-9f41-0fe09b10569e tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] [instance: 59e81a58-9400-4cea-aa38-b24b394e33d7] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:12:21.508194 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-abf9663b-fdf4-44ac-9f41-0fe09b10569e tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:12:21.508964 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-abf9663b-fdf4-44ac-9f41-0fe09b10569e tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:12:21.509544 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-abf9663b-fdf4-44ac-9f41-0fe09b10569e tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:12:21.510439 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-abf9663b-fdf4-44ac-9f41-0fe09b10569e tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:12:21.510966 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-abf9663b-fdf4-44ac-9f41-0fe09b10569e tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:12:21.511472 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-abf9663b-fdf4-44ac-9f41-0fe09b10569e tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:12:21.527813 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-b357b577-8112-4588-b7ac-1c6065e1df52 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:12:21.536391 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-b357b577-8112-4588-b7ac-1c6065e1df52 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:12:21.538169 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-b357b577-8112-4588-b7ac-1c6065e1df52 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:12:21.538956 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-b357b577-8112-4588-b7ac-1c6065e1df52 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] 10.222.0.23 "GET /compute/v2.1/servers/26bd475b-3495-4669-9985-d4a7dedb4bbf" status: 200 len: 1740 microversion: 2.20 time: 0.240990 Oct 13 13:12:21.539782 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 179/335] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 13:12:21 2022] GET /compute/v2.1/servers/26bd475b-3495-4669-9985-d4a7dedb4bbf => generated 1740 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 13:12:21.546820 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-0587b2bd-f7a3-46ff-93ff-842f97183900 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Calling method '>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:12:21.547672 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-0587b2bd-f7a3-46ff-93ff-842f97183900 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] [instance: b4ba0fd3-eb17-4e05-acaa-5570c1e364d7] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:12:21.553962 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-0587b2bd-f7a3-46ff-93ff-842f97183900 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:12:21.554949 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-0587b2bd-f7a3-46ff-93ff-842f97183900 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:12:21.555714 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-0587b2bd-f7a3-46ff-93ff-842f97183900 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:12:21.556539 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-0587b2bd-f7a3-46ff-93ff-842f97183900 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:12:21.557116 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-0587b2bd-f7a3-46ff-93ff-842f97183900 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:12:21.557672 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-0587b2bd-f7a3-46ff-93ff-842f97183900 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:12:21.602333 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-abf9663b-fdf4-44ac-9f41-0fe09b10569e tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d89667e52b24295ba619203c02c7bd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed5038c799342d48edc980983f1d996', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:12:21.612584 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-abf9663b-fdf4-44ac-9f41-0fe09b10569e tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] 10.222.0.23 "GET /compute/v2.1/servers/59e81a58-9400-4cea-aa38-b24b394e33d7" status: 200 len: 1317 microversion: 2.1 time: 0.125330 Oct 13 13:12:21.613304 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 157/336] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:12:21 2022] GET /compute/v2.1/servers/59e81a58-9400-4cea-aa38-b24b394e33d7 => generated 1317 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:12:21.726108 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-0587b2bd-f7a3-46ff-93ff-842f97183900 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '454203f47b434cca952a1cef56de559f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7312d0ac9248f2bfbece5611913ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:12:21.741657 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-0587b2bd-f7a3-46ff-93ff-842f97183900 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] 10.222.0.23 "GET /compute/v2.1/servers/b4ba0fd3-eb17-4e05-acaa-5570c1e364d7" status: 200 len: 1371 microversion: 2.1 time: 0.198646 Oct 13 13:12:21.742505 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 180/337] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:12:21 2022] GET /compute/v2.1/servers/b4ba0fd3-eb17-4e05-acaa-5570c1e364d7 => generated 1371 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 13:12:22.293812 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-ab5ae6ba-22d7-4e81-b53f-b58b6c8a738d tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-406794858", "imageRef": "e2cdd20b-2540-48bc-a05c-d6a2e7e9a66e", "flavorRef": "452", "networks": [{"uuid": "5b4f82fe-1259-480a-b97a-2403a9b4130d"}]}} {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 13:12:22.413343 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.network.neutron [None req-ab5ae6ba-22d7-4e81-b53f-b58b6c8a738d tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] validate_networks() for [('5b4f82fe-1259-480a-b97a-2403a9b4130d', None, None, None, None, None)] {{(pid=118815) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 13 13:12:22.515823 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-db1c6670-0ac5-4aa0-bc5f-e9ff57015b03 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Calling method '>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:12:22.516564 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-db1c6670-0ac5-4aa0-bc5f-e9ff57015b03 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] [instance: e125ab44-9111-4260-909d-95d57b7861a7] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:12:22.531738 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-db1c6670-0ac5-4aa0-bc5f-e9ff57015b03 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:12:22.532234 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-db1c6670-0ac5-4aa0-bc5f-e9ff57015b03 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:12:22.532667 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-db1c6670-0ac5-4aa0-bc5f-e9ff57015b03 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:12:22.533368 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-db1c6670-0ac5-4aa0-bc5f-e9ff57015b03 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:12:22.533814 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-db1c6670-0ac5-4aa0-bc5f-e9ff57015b03 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:12:22.534234 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-db1c6670-0ac5-4aa0-bc5f-e9ff57015b03 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:12:22.945750 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-db1c6670-0ac5-4aa0-bc5f-e9ff57015b03 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e783caddcad473dbdd764919286e244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecd3d5d2a3a54a07ba64f1fea4846c40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:12:22.954837 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-db1c6670-0ac5-4aa0-bc5f-e9ff57015b03 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] 10.222.0.23 "GET /compute/v2.1/servers/e125ab44-9111-4260-909d-95d57b7861a7" status: 200 len: 1710 microversion: 2.1 time: 0.442899 Oct 13 13:12:22.981104 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 181/338] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:12:22 2022] GET /compute/v2.1/servers/e125ab44-9111-4260-909d-95d57b7861a7 => generated 1710 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:12:22.985994 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-25953d23-31ac-4db9-8dd8-aa51042d7669 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Calling method '>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:12:22.992808 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-25953d23-31ac-4db9-8dd8-aa51042d7669 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] [instance: 26bd475b-3495-4669-9985-d4a7dedb4bbf] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:12:23.018069 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-25953d23-31ac-4db9-8dd8-aa51042d7669 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:12:23.018910 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-25953d23-31ac-4db9-8dd8-aa51042d7669 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:12:23.020069 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-25953d23-31ac-4db9-8dd8-aa51042d7669 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:12:23.021530 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-25953d23-31ac-4db9-8dd8-aa51042d7669 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:12:23.022159 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-25953d23-31ac-4db9-8dd8-aa51042d7669 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:12:23.022752 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-25953d23-31ac-4db9-8dd8-aa51042d7669 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:12:23.278469 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.virt.hardware [None req-ab5ae6ba-22d7-4e81-b53f-b58b6c8a738d tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Flavor limits 0:0:0 {{(pid=118815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 13 13:12:23.279312 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.virt.hardware [None req-ab5ae6ba-22d7-4e81-b53f-b58b6c8a738d tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Image limits 0:0:0 {{(pid=118815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 13 13:12:23.279929 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.virt.hardware [None req-ab5ae6ba-22d7-4e81-b53f-b58b6c8a738d tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Flavor pref 0:0:0 {{(pid=118815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 13 13:12:23.280534 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.virt.hardware [None req-ab5ae6ba-22d7-4e81-b53f-b58b6c8a738d tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Image pref 0:0:0 {{(pid=118815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 13 13:12:23.281096 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.virt.hardware [None req-ab5ae6ba-22d7-4e81-b53f-b58b6c8a738d tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 13 13:12:23.295001 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-25953d23-31ac-4db9-8dd8-aa51042d7669 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:12:23.311532 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-25953d23-31ac-4db9-8dd8-aa51042d7669 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:12:23.313449 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-25953d23-31ac-4db9-8dd8-aa51042d7669 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:12:23.314437 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-ab5ae6ba-22d7-4e81-b53f-b58b6c8a738d tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:12:23.315464 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-ab5ae6ba-22d7-4e81-b53f-b58b6c8a738d tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:12:23.317087 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-ab5ae6ba-22d7-4e81-b53f-b58b6c8a738d tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:12:23.317978 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-ab5ae6ba-22d7-4e81-b53f-b58b6c8a738d tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:12:23.321333 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-25953d23-31ac-4db9-8dd8-aa51042d7669 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] 10.222.0.23 "GET /compute/v2.1/servers/26bd475b-3495-4669-9985-d4a7dedb4bbf" status: 200 len: 1740 microversion: 2.20 time: 0.334701 Oct 13 13:12:23.323003 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-ab5ae6ba-22d7-4e81-b53f-b58b6c8a738d tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:12:23.323625 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 182/339] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 13:12:22 2022] GET /compute/v2.1/servers/26bd475b-3495-4669-9985-d4a7dedb4bbf => generated 1740 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 13:12:23.324247 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-ab5ae6ba-22d7-4e81-b53f-b58b6c8a738d tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:12:23.329076 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-4590a8b2-fb82-4e16-8572-1f2ae0664792 tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Calling method '>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:12:23.343686 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-4590a8b2-fb82-4e16-8572-1f2ae0664792 tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] [instance: 59e81a58-9400-4cea-aa38-b24b394e33d7] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:12:23.360999 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-4590a8b2-fb82-4e16-8572-1f2ae0664792 tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:12:23.361777 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-4590a8b2-fb82-4e16-8572-1f2ae0664792 tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:12:23.363473 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-4590a8b2-fb82-4e16-8572-1f2ae0664792 tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:12:23.365411 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-4590a8b2-fb82-4e16-8572-1f2ae0664792 tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:12:23.366306 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-4590a8b2-fb82-4e16-8572-1f2ae0664792 tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:12:23.367535 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-4590a8b2-fb82-4e16-8572-1f2ae0664792 tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:12:23.375510 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.quota [None req-ab5ae6ba-22d7-4e81-b53f-b58b6c8a738d tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Getting quotas for project f85144e13e254365a86aa785093c8575. Resources: {'instances', 'cores', 'ram'} {{(pid=118815) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 13 13:12:23.390165 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.quota [None req-ab5ae6ba-22d7-4e81-b53f-b58b6c8a738d tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Getting quotas for user 8569afc405f24a0993a023c818a0c272 and project f85144e13e254365a86aa785093c8575. Resources: {'instances', 'cores', 'ram'} {{(pid=118815) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 13 13:12:23.422853 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-ab5ae6ba-22d7-4e81-b53f-b58b6c8a738d tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Going to run 1 instances... {{(pid=118815) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 13 13:12:23.425899 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-ab5ae6ba-22d7-4e81-b53f-b58b6c8a738d tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] [instance: c8c61fd5-2f2a-4cd9-a439-00943de4dda6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e2cdd20b-2540-48bc-a05c-d6a2e7e9a66e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118815) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 13 13:12:23.495630 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-4590a8b2-fb82-4e16-8572-1f2ae0664792 tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d89667e52b24295ba619203c02c7bd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed5038c799342d48edc980983f1d996', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:12:23.509658 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-4590a8b2-fb82-4e16-8572-1f2ae0664792 tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] 10.222.0.23 "GET /compute/v2.1/servers/59e81a58-9400-4cea-aa38-b24b394e33d7" status: 200 len: 1315 microversion: 2.1 time: 0.184127 Oct 13 13:12:23.510267 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 183/340] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:12:23 2022] GET /compute/v2.1/servers/59e81a58-9400-4cea-aa38-b24b394e33d7 => generated 1315 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:12:23.523408 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-6b4bdc8d-3f7e-4b52-aa08-fa45a9ddc294 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Calling method '>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:12:23.523408 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-6b4bdc8d-3f7e-4b52-aa08-fa45a9ddc294 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] [instance: b4ba0fd3-eb17-4e05-acaa-5570c1e364d7] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:12:23.529399 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-6b4bdc8d-3f7e-4b52-aa08-fa45a9ddc294 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:12:23.531707 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-6b4bdc8d-3f7e-4b52-aa08-fa45a9ddc294 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:12:23.532302 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-6b4bdc8d-3f7e-4b52-aa08-fa45a9ddc294 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:12:23.533172 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-6b4bdc8d-3f7e-4b52-aa08-fa45a9ddc294 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:12:23.533771 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-6b4bdc8d-3f7e-4b52-aa08-fa45a9ddc294 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:12:23.535310 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-6b4bdc8d-3f7e-4b52-aa08-fa45a9ddc294 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:12:23.580097 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-ab5ae6ba-22d7-4e81-b53f-b58b6c8a738d tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.292537 Oct 13 13:12:23.588330 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 158/341] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Oct 13 13:12:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 1301 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 13 13:12:23.605025 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-b1a43436-7917-4795-9dc1-263a340a03be tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Calling method '>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:12:23.610582 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-b1a43436-7917-4795-9dc1-263a340a03be tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] [instance: c8c61fd5-2f2a-4cd9-a439-00943de4dda6] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:12:23.833697 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-b1a43436-7917-4795-9dc1-263a340a03be tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8569afc405f24a0993a023c818a0c272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f85144e13e254365a86aa785093c8575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:12:23.846470 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-b1a43436-7917-4795-9dc1-263a340a03be tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c61fd5-2f2a-4cd9-a439-00943de4dda6" status: 200 len: 1218 microversion: 2.1 time: 0.250161 Oct 13 13:12:23.849186 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 159/342] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:12:23 2022] GET /compute/v2.1/servers/c8c61fd5-2f2a-4cd9-a439-00943de4dda6 => generated 1218 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:12:23.981866 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-f5f5a8dd-50d2-4e01-b83f-aa1cb746c7d3 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Calling method '>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:12:23.982478 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-f5f5a8dd-50d2-4e01-b83f-aa1cb746c7d3 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] [instance: e125ab44-9111-4260-909d-95d57b7861a7] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:12:24.047038 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-6b4bdc8d-3f7e-4b52-aa08-fa45a9ddc294 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '454203f47b434cca952a1cef56de559f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7312d0ac9248f2bfbece5611913ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:12:24.051807 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-f5f5a8dd-50d2-4e01-b83f-aa1cb746c7d3 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:12:24.052385 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-f5f5a8dd-50d2-4e01-b83f-aa1cb746c7d3 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.056s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:12:24.052838 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-f5f5a8dd-50d2-4e01-b83f-aa1cb746c7d3 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:12:24.053584 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-f5f5a8dd-50d2-4e01-b83f-aa1cb746c7d3 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:12:24.054023 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-f5f5a8dd-50d2-4e01-b83f-aa1cb746c7d3 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:12:24.054446 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-f5f5a8dd-50d2-4e01-b83f-aa1cb746c7d3 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:12:24.056358 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-6b4bdc8d-3f7e-4b52-aa08-fa45a9ddc294 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] 10.222.0.23 "GET /compute/v2.1/servers/b4ba0fd3-eb17-4e05-acaa-5570c1e364d7" status: 200 len: 1371 microversion: 2.1 time: 0.545095 Oct 13 13:12:24.084716 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 184/343] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:12:23 2022] GET /compute/v2.1/servers/b4ba0fd3-eb17-4e05-acaa-5570c1e364d7 => generated 1371 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:12:24.359528 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-6ddd1dad-4ca1-4a74-99c4-62c263fbb6c1 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Calling method '>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:12:24.360961 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-6ddd1dad-4ca1-4a74-99c4-62c263fbb6c1 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] [instance: 26bd475b-3495-4669-9985-d4a7dedb4bbf] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:12:24.398204 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-6ddd1dad-4ca1-4a74-99c4-62c263fbb6c1 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:12:24.401831 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-6ddd1dad-4ca1-4a74-99c4-62c263fbb6c1 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:12:24.403828 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-6ddd1dad-4ca1-4a74-99c4-62c263fbb6c1 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:12:24.411327 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-6ddd1dad-4ca1-4a74-99c4-62c263fbb6c1 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:12:24.413467 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-6ddd1dad-4ca1-4a74-99c4-62c263fbb6c1 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:12:24.416774 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-6ddd1dad-4ca1-4a74-99c4-62c263fbb6c1 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:12:24.446967 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-f5f5a8dd-50d2-4e01-b83f-aa1cb746c7d3 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e783caddcad473dbdd764919286e244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecd3d5d2a3a54a07ba64f1fea4846c40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:12:24.457371 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-f5f5a8dd-50d2-4e01-b83f-aa1cb746c7d3 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] 10.222.0.23 "GET /compute/v2.1/servers/e125ab44-9111-4260-909d-95d57b7861a7" status: 200 len: 1710 microversion: 2.1 time: 0.478837 Oct 13 13:12:24.459310 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 160/344] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:12:23 2022] GET /compute/v2.1/servers/e125ab44-9111-4260-909d-95d57b7861a7 => generated 1710 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 13:12:24.542350 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-a57ae3eb-d85c-4b48-b4cb-d04951789532 tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Calling method '>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:12:24.543446 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-a57ae3eb-d85c-4b48-b4cb-d04951789532 tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] [instance: 59e81a58-9400-4cea-aa38-b24b394e33d7] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:12:24.553584 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-a57ae3eb-d85c-4b48-b4cb-d04951789532 tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:12:24.554345 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-a57ae3eb-d85c-4b48-b4cb-d04951789532 tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:12:24.557440 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-a57ae3eb-d85c-4b48-b4cb-d04951789532 tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:12:24.558469 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-a57ae3eb-d85c-4b48-b4cb-d04951789532 tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:12:24.559188 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-a57ae3eb-d85c-4b48-b4cb-d04951789532 tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:12:24.560208 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-a57ae3eb-d85c-4b48-b4cb-d04951789532 tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:12:24.716937 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-a57ae3eb-d85c-4b48-b4cb-d04951789532 tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d89667e52b24295ba619203c02c7bd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed5038c799342d48edc980983f1d996', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:12:24.729568 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-a57ae3eb-d85c-4b48-b4cb-d04951789532 tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] 10.222.0.23 "GET /compute/v2.1/servers/59e81a58-9400-4cea-aa38-b24b394e33d7" status: 200 len: 1315 microversion: 2.1 time: 0.191449 Oct 13 13:12:24.730438 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 161/345] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:12:24 2022] GET /compute/v2.1/servers/59e81a58-9400-4cea-aa38-b24b394e33d7 => generated 1315 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 13:12:24.771394 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-6ddd1dad-4ca1-4a74-99c4-62c263fbb6c1 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:12:24.787669 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-6ddd1dad-4ca1-4a74-99c4-62c263fbb6c1 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:12:24.789950 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-6ddd1dad-4ca1-4a74-99c4-62c263fbb6c1 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:12:24.791294 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-6ddd1dad-4ca1-4a74-99c4-62c263fbb6c1 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] 10.222.0.23 "GET /compute/v2.1/servers/26bd475b-3495-4669-9985-d4a7dedb4bbf" status: 200 len: 1740 microversion: 2.20 time: 0.438528 Oct 13 13:12:24.811748 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 185/346] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 13:12:24 2022] GET /compute/v2.1/servers/26bd475b-3495-4669-9985-d4a7dedb4bbf => generated 1740 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 13:12:24.873787 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-1e775217-9fd0-4a78-b2ac-27dd1148d7d6 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Calling method '>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:12:24.874395 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-1e775217-9fd0-4a78-b2ac-27dd1148d7d6 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] [instance: c8c61fd5-2f2a-4cd9-a439-00943de4dda6] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:12:24.884980 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-1e775217-9fd0-4a78-b2ac-27dd1148d7d6 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:12:24.889637 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-1e775217-9fd0-4a78-b2ac-27dd1148d7d6 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:12:24.890103 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-1e775217-9fd0-4a78-b2ac-27dd1148d7d6 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:12:24.893180 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-1e775217-9fd0-4a78-b2ac-27dd1148d7d6 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:12:24.893180 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-1e775217-9fd0-4a78-b2ac-27dd1148d7d6 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:12:24.893180 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-1e775217-9fd0-4a78-b2ac-27dd1148d7d6 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:12:24.918588 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [req-51777feb-3cae-4648-bbe5-237ba319d5e5 req-da9324cd-85e3-4214-b597-03c4b9ab2312 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b4ba0fd3-eb17-4e05-acaa-5570c1e364d7", "tag": "feb1b7b8-f5e8-4310-8e6d-7eb1841b5c04"}]} {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 13:12:24.947190 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [req-51777feb-3cae-4648-bbe5-237ba319d5e5 req-da9324cd-85e3-4214-b597-03c4b9ab2312 service nova] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:12:24.948037 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [req-51777feb-3cae-4648-bbe5-237ba319d5e5 req-da9324cd-85e3-4214-b597-03c4b9ab2312 service nova] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:12:24.948705 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [req-51777feb-3cae-4648-bbe5-237ba319d5e5 req-da9324cd-85e3-4214-b597-03c4b9ab2312 service nova] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:12:24.962440 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.compute.server_external_events [req-51777feb-3cae-4648-bbe5-237ba319d5e5 req-da9324cd-85e3-4214-b597-03c4b9ab2312 service nova] Creating event network-changed:feb1b7b8-f5e8-4310-8e6d-7eb1841b5c04 for instance b4ba0fd3-eb17-4e05-acaa-5570c1e364d7 on hv-cinder-82660 Oct 13 13:12:24.996939 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [req-51777feb-3cae-4648-bbe5-237ba319d5e5 req-da9324cd-85e3-4214-b597-03c4b9ab2312 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081833 Oct 13 13:12:25.000904 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 186/347] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 13:12:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 13:12:25.032759 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-1e775217-9fd0-4a78-b2ac-27dd1148d7d6 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8569afc405f24a0993a023c818a0c272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f85144e13e254365a86aa785093c8575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:12:25.056601 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-1e775217-9fd0-4a78-b2ac-27dd1148d7d6 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c61fd5-2f2a-4cd9-a439-00943de4dda6" status: 200 len: 1270 microversion: 2.1 time: 0.175960 Oct 13 13:12:25.085449 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 162/348] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:12:24 2022] GET /compute/v2.1/servers/c8c61fd5-2f2a-4cd9-a439-00943de4dda6 => generated 1270 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:12:25.094758 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-da5121d0-c225-4207-a8e8-7d2ed14d7925 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Calling method '>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:12:25.095930 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-da5121d0-c225-4207-a8e8-7d2ed14d7925 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] [instance: b4ba0fd3-eb17-4e05-acaa-5570c1e364d7] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:12:25.125687 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-da5121d0-c225-4207-a8e8-7d2ed14d7925 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:12:25.126562 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-da5121d0-c225-4207-a8e8-7d2ed14d7925 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:12:25.127337 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-da5121d0-c225-4207-a8e8-7d2ed14d7925 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:12:25.128925 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-da5121d0-c225-4207-a8e8-7d2ed14d7925 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:12:25.129617 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-da5121d0-c225-4207-a8e8-7d2ed14d7925 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:12:25.130267 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-da5121d0-c225-4207-a8e8-7d2ed14d7925 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:12:25.453609 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-da5121d0-c225-4207-a8e8-7d2ed14d7925 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '454203f47b434cca952a1cef56de559f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7312d0ac9248f2bfbece5611913ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:12:25.464282 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-da5121d0-c225-4207-a8e8-7d2ed14d7925 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] 10.222.0.23 "GET /compute/v2.1/servers/b4ba0fd3-eb17-4e05-acaa-5570c1e364d7" status: 200 len: 1371 microversion: 2.1 time: 0.375249 Oct 13 13:12:25.465354 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 187/349] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:12:25 2022] GET /compute/v2.1/servers/b4ba0fd3-eb17-4e05-acaa-5570c1e364d7 => generated 1371 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:12:25.493119 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-8587d9ef-ec9e-4bec-b82c-9a73eee38b52 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Calling method '>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:12:25.494245 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-8587d9ef-ec9e-4bec-b82c-9a73eee38b52 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] [instance: e125ab44-9111-4260-909d-95d57b7861a7] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:12:25.504257 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-8587d9ef-ec9e-4bec-b82c-9a73eee38b52 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:12:25.512295 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-8587d9ef-ec9e-4bec-b82c-9a73eee38b52 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:12:25.512828 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-8587d9ef-ec9e-4bec-b82c-9a73eee38b52 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:12:25.514033 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-8587d9ef-ec9e-4bec-b82c-9a73eee38b52 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:12:25.514516 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-8587d9ef-ec9e-4bec-b82c-9a73eee38b52 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:12:25.514999 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-8587d9ef-ec9e-4bec-b82c-9a73eee38b52 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:12:25.756550 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-ec9c0788-913b-4af6-8f05-4cfbe2674cae tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Calling method '>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:12:25.757822 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-ec9c0788-913b-4af6-8f05-4cfbe2674cae tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] [instance: 59e81a58-9400-4cea-aa38-b24b394e33d7] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:12:25.762011 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-8587d9ef-ec9e-4bec-b82c-9a73eee38b52 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e783caddcad473dbdd764919286e244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecd3d5d2a3a54a07ba64f1fea4846c40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:12:25.771602 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-ec9c0788-913b-4af6-8f05-4cfbe2674cae tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:12:25.773166 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-ec9c0788-913b-4af6-8f05-4cfbe2674cae tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:12:25.773947 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-ec9c0788-913b-4af6-8f05-4cfbe2674cae tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:12:25.774846 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-ec9c0788-913b-4af6-8f05-4cfbe2674cae tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:12:25.776914 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-ec9c0788-913b-4af6-8f05-4cfbe2674cae tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:12:25.778106 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-8587d9ef-ec9e-4bec-b82c-9a73eee38b52 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] 10.222.0.23 "GET /compute/v2.1/servers/e125ab44-9111-4260-909d-95d57b7861a7" status: 200 len: 1714 microversion: 2.1 time: 0.291023 Oct 13 13:12:25.780245 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-ec9c0788-913b-4af6-8f05-4cfbe2674cae tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:12:25.780452 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 163/350] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:12:25 2022] GET /compute/v2.1/servers/e125ab44-9111-4260-909d-95d57b7861a7 => generated 1714 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:12:25.824431 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-e9084111-616a-496c-a237-3db640f8cb3f tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Calling method '>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:12:25.826722 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-e9084111-616a-496c-a237-3db640f8cb3f tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] [instance: 26bd475b-3495-4669-9985-d4a7dedb4bbf] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:12:25.840959 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-e9084111-616a-496c-a237-3db640f8cb3f tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:12:25.841970 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-e9084111-616a-496c-a237-3db640f8cb3f tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:12:25.844125 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-e9084111-616a-496c-a237-3db640f8cb3f tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:12:25.846577 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-e9084111-616a-496c-a237-3db640f8cb3f tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:12:25.851777 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-e9084111-616a-496c-a237-3db640f8cb3f tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:12:25.852397 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-e9084111-616a-496c-a237-3db640f8cb3f tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:12:26.286498 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-ec9c0788-913b-4af6-8f05-4cfbe2674cae tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d89667e52b24295ba619203c02c7bd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed5038c799342d48edc980983f1d996', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:12:26.297105 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-ec9c0788-913b-4af6-8f05-4cfbe2674cae tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] 10.222.0.23 "GET /compute/v2.1/servers/59e81a58-9400-4cea-aa38-b24b394e33d7" status: 200 len: 1357 microversion: 2.1 time: 0.546819 Oct 13 13:12:26.307717 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 188/351] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:12:25 2022] GET /compute/v2.1/servers/59e81a58-9400-4cea-aa38-b24b394e33d7 => generated 1357 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 13:12:26.318298 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-239eda9c-afd1-41e8-98cd-6a0fd8423047 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Calling method '>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:12:26.323248 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-239eda9c-afd1-41e8-98cd-6a0fd8423047 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] [instance: c8c61fd5-2f2a-4cd9-a439-00943de4dda6] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:12:26.349401 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-239eda9c-afd1-41e8-98cd-6a0fd8423047 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:12:26.357880 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-239eda9c-afd1-41e8-98cd-6a0fd8423047 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:12:26.358587 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-239eda9c-afd1-41e8-98cd-6a0fd8423047 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:12:26.364131 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-239eda9c-afd1-41e8-98cd-6a0fd8423047 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:12:26.364887 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-239eda9c-afd1-41e8-98cd-6a0fd8423047 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:12:26.365526 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-239eda9c-afd1-41e8-98cd-6a0fd8423047 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:12:26.418098 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-e9084111-616a-496c-a237-3db640f8cb3f tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:12:26.445848 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-e9084111-616a-496c-a237-3db640f8cb3f tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:12:26.454263 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-e9084111-616a-496c-a237-3db640f8cb3f tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:12:26.458554 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-e9084111-616a-496c-a237-3db640f8cb3f tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] 10.222.0.23 "GET /compute/v2.1/servers/26bd475b-3495-4669-9985-d4a7dedb4bbf" status: 200 len: 1740 microversion: 2.20 time: 0.640876 Oct 13 13:12:26.491486 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 164/352] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 13:12:25 2022] GET /compute/v2.1/servers/26bd475b-3495-4669-9985-d4a7dedb4bbf => generated 1740 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 13:12:26.499604 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-b2b63a1e-04c1-4b44-91e0-cfd3954d3fb5 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Calling method '>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:12:26.500283 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-239eda9c-afd1-41e8-98cd-6a0fd8423047 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8569afc405f24a0993a023c818a0c272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f85144e13e254365a86aa785093c8575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:12:26.501531 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-b2b63a1e-04c1-4b44-91e0-cfd3954d3fb5 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] [instance: b4ba0fd3-eb17-4e05-acaa-5570c1e364d7] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:12:26.511615 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-b2b63a1e-04c1-4b44-91e0-cfd3954d3fb5 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:12:26.512468 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-b2b63a1e-04c1-4b44-91e0-cfd3954d3fb5 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:12:26.518821 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-239eda9c-afd1-41e8-98cd-6a0fd8423047 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c61fd5-2f2a-4cd9-a439-00943de4dda6" status: 200 len: 1276 microversion: 2.1 time: 0.208132 Oct 13 13:12:26.520262 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 189/353] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:12:26 2022] GET /compute/v2.1/servers/c8c61fd5-2f2a-4cd9-a439-00943de4dda6 => generated 1276 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:12:26.526768 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-b2b63a1e-04c1-4b44-91e0-cfd3954d3fb5 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:12:26.528210 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-b2b63a1e-04c1-4b44-91e0-cfd3954d3fb5 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:12:26.529942 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-b2b63a1e-04c1-4b44-91e0-cfd3954d3fb5 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:12:26.531289 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-b2b63a1e-04c1-4b44-91e0-cfd3954d3fb5 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:12:26.794399 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-b2b63a1e-04c1-4b44-91e0-cfd3954d3fb5 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '454203f47b434cca952a1cef56de559f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7312d0ac9248f2bfbece5611913ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:12:26.806877 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-b2b63a1e-04c1-4b44-91e0-cfd3954d3fb5 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] 10.222.0.23 "GET /compute/v2.1/servers/b4ba0fd3-eb17-4e05-acaa-5570c1e364d7" status: 200 len: 1371 microversion: 2.1 time: 0.313433 Oct 13 13:12:26.814247 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 165/354] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:12:26 2022] GET /compute/v2.1/servers/b4ba0fd3-eb17-4e05-acaa-5570c1e364d7 => generated 1371 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:12:27.336256 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-bcf11178-730f-4222-a844-cb4d00fc0810 tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Calling method '>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:12:27.337666 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-bcf11178-730f-4222-a844-cb4d00fc0810 tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] [instance: 59e81a58-9400-4cea-aa38-b24b394e33d7] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:12:27.343622 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG dbcounter [-] [118814] Writing DB stats nova_cell0:SELECT=2 {{(pid=118814) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:12:27.344926 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG dbcounter [-] [118814] Writing DB stats nova_cell0:SELECT=14 {{(pid=118814) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:12:27.348441 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-bcf11178-730f-4222-a844-cb4d00fc0810 tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:12:27.349306 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-bcf11178-730f-4222-a844-cb4d00fc0810 tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:12:27.349912 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-bcf11178-730f-4222-a844-cb4d00fc0810 tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:12:27.350794 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-bcf11178-730f-4222-a844-cb4d00fc0810 tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:12:27.351605 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-bcf11178-730f-4222-a844-cb4d00fc0810 tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:12:27.352187 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-bcf11178-730f-4222-a844-cb4d00fc0810 tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:12:27.498780 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-87e1eaeb-eb58-4e82-ba16-5bcd66436fb0 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Calling method '>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:12:27.501973 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-87e1eaeb-eb58-4e82-ba16-5bcd66436fb0 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] [instance: 26bd475b-3495-4669-9985-d4a7dedb4bbf] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:12:27.519354 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-87e1eaeb-eb58-4e82-ba16-5bcd66436fb0 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:12:27.523527 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-87e1eaeb-eb58-4e82-ba16-5bcd66436fb0 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:12:27.524093 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-87e1eaeb-eb58-4e82-ba16-5bcd66436fb0 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:12:27.527701 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-87e1eaeb-eb58-4e82-ba16-5bcd66436fb0 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:12:27.528340 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-87e1eaeb-eb58-4e82-ba16-5bcd66436fb0 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:12:27.532897 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-87e1eaeb-eb58-4e82-ba16-5bcd66436fb0 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:12:27.537692 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG dbcounter [-] [118815] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:12:27.539565 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-bcf11178-730f-4222-a844-cb4d00fc0810 tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d89667e52b24295ba619203c02c7bd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed5038c799342d48edc980983f1d996', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:12:27.555304 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-bcf11178-730f-4222-a844-cb4d00fc0810 tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] 10.222.0.23 "GET /compute/v2.1/servers/59e81a58-9400-4cea-aa38-b24b394e33d7" status: 200 len: 1357 microversion: 2.1 time: 0.221638 Oct 13 13:12:27.556108 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 190/355] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:12:27 2022] GET /compute/v2.1/servers/59e81a58-9400-4cea-aa38-b24b394e33d7 => generated 1357 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:12:27.582781 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-61bfbd58-13dd-4a2a-b8a7-59a82751adc2 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Calling method '>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:12:27.583610 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-61bfbd58-13dd-4a2a-b8a7-59a82751adc2 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] [instance: c8c61fd5-2f2a-4cd9-a439-00943de4dda6] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:12:27.593308 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-61bfbd58-13dd-4a2a-b8a7-59a82751adc2 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:12:27.593814 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-61bfbd58-13dd-4a2a-b8a7-59a82751adc2 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:12:27.594388 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-61bfbd58-13dd-4a2a-b8a7-59a82751adc2 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:12:27.603781 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-61bfbd58-13dd-4a2a-b8a7-59a82751adc2 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:12:27.604643 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-61bfbd58-13dd-4a2a-b8a7-59a82751adc2 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:12:27.605309 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-61bfbd58-13dd-4a2a-b8a7-59a82751adc2 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:12:27.750742 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-61bfbd58-13dd-4a2a-b8a7-59a82751adc2 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8569afc405f24a0993a023c818a0c272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f85144e13e254365a86aa785093c8575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:12:27.763547 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-61bfbd58-13dd-4a2a-b8a7-59a82751adc2 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c61fd5-2f2a-4cd9-a439-00943de4dda6" status: 200 len: 1276 microversion: 2.1 time: 0.191914 Oct 13 13:12:27.779391 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-87e1eaeb-eb58-4e82-ba16-5bcd66436fb0 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:12:27.781184 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 191/356] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:12:27 2022] GET /compute/v2.1/servers/c8c61fd5-2f2a-4cd9-a439-00943de4dda6 => generated 1276 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:12:27.789881 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-87e1eaeb-eb58-4e82-ba16-5bcd66436fb0 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:12:27.791381 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-87e1eaeb-eb58-4e82-ba16-5bcd66436fb0 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:12:27.792609 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-87e1eaeb-eb58-4e82-ba16-5bcd66436fb0 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] 10.222.0.23 "GET /compute/v2.1/servers/26bd475b-3495-4669-9985-d4a7dedb4bbf" status: 200 len: 1740 microversion: 2.20 time: 0.298712 Oct 13 13:12:27.793221 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 166/357] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 13:12:27 2022] GET /compute/v2.1/servers/26bd475b-3495-4669-9985-d4a7dedb4bbf => generated 1740 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 13 13:12:27.840520 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-696c5a5b-eb3d-41ce-a7a5-4ffeb66b2c6c tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Calling method '>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:12:27.841183 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-696c5a5b-eb3d-41ce-a7a5-4ffeb66b2c6c tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] [instance: b4ba0fd3-eb17-4e05-acaa-5570c1e364d7] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:12:27.847403 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-696c5a5b-eb3d-41ce-a7a5-4ffeb66b2c6c tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:12:27.847829 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-696c5a5b-eb3d-41ce-a7a5-4ffeb66b2c6c tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:12:27.848270 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-696c5a5b-eb3d-41ce-a7a5-4ffeb66b2c6c tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:12:27.849107 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-696c5a5b-eb3d-41ce-a7a5-4ffeb66b2c6c tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:12:27.849570 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-696c5a5b-eb3d-41ce-a7a5-4ffeb66b2c6c tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:12:27.850179 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-696c5a5b-eb3d-41ce-a7a5-4ffeb66b2c6c tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:12:28.078182 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-696c5a5b-eb3d-41ce-a7a5-4ffeb66b2c6c tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '454203f47b434cca952a1cef56de559f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7312d0ac9248f2bfbece5611913ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:12:28.092548 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-696c5a5b-eb3d-41ce-a7a5-4ffeb66b2c6c tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] 10.222.0.23 "GET /compute/v2.1/servers/b4ba0fd3-eb17-4e05-acaa-5570c1e364d7" status: 200 len: 1371 microversion: 2.1 time: 0.255800 Oct 13 13:12:28.093897 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 192/358] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:12:27 2022] GET /compute/v2.1/servers/b4ba0fd3-eb17-4e05-acaa-5570c1e364d7 => generated 1371 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:12:28.312982 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [req-03756ea4-8904-4a52-98fa-33b23e6608b5 req-dd67ca3d-e8e1-48f4-ae7b-cc336f107eff service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "59e81a58-9400-4cea-aa38-b24b394e33d7", "tag": "5e82a763-989b-4ba3-b2d2-7ad17b260a77"}]} {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 13:12:28.327308 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [req-03756ea4-8904-4a52-98fa-33b23e6608b5 req-dd67ca3d-e8e1-48f4-ae7b-cc336f107eff service nova] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:12:28.328194 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [req-03756ea4-8904-4a52-98fa-33b23e6608b5 req-dd67ca3d-e8e1-48f4-ae7b-cc336f107eff service nova] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:12:28.330251 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [req-03756ea4-8904-4a52-98fa-33b23e6608b5 req-dd67ca3d-e8e1-48f4-ae7b-cc336f107eff service nova] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:12:28.343564 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.compute.server_external_events [req-03756ea4-8904-4a52-98fa-33b23e6608b5 req-dd67ca3d-e8e1-48f4-ae7b-cc336f107eff service nova] Creating event network-changed:5e82a763-989b-4ba3-b2d2-7ad17b260a77 for instance 59e81a58-9400-4cea-aa38-b24b394e33d7 on hv-cinder-82660 Oct 13 13:12:28.349002 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [req-03756ea4-8904-4a52-98fa-33b23e6608b5 req-dd67ca3d-e8e1-48f4-ae7b-cc336f107eff service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053201 Oct 13 13:12:28.349703 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 167/359] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 13:12:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 13:12:28.581788 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-8ea1184e-a457-494d-b781-e7969be4a71a tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Calling method '>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:12:28.582464 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-8ea1184e-a457-494d-b781-e7969be4a71a tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] [instance: 59e81a58-9400-4cea-aa38-b24b394e33d7] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:12:28.588661 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-8ea1184e-a457-494d-b781-e7969be4a71a tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:12:28.589151 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-8ea1184e-a457-494d-b781-e7969be4a71a tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:12:28.589592 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-8ea1184e-a457-494d-b781-e7969be4a71a tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:12:28.590480 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-8ea1184e-a457-494d-b781-e7969be4a71a tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:12:28.591113 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-8ea1184e-a457-494d-b781-e7969be4a71a tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:12:28.591703 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-8ea1184e-a457-494d-b781-e7969be4a71a tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:12:28.746457 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-8ea1184e-a457-494d-b781-e7969be4a71a tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d89667e52b24295ba619203c02c7bd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed5038c799342d48edc980983f1d996', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:12:28.754776 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-8ea1184e-a457-494d-b781-e7969be4a71a tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] 10.222.0.23 "GET /compute/v2.1/servers/59e81a58-9400-4cea-aa38-b24b394e33d7" status: 200 len: 1357 microversion: 2.1 time: 0.176736 Oct 13 13:12:28.755308 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 193/360] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:12:28 2022] GET /compute/v2.1/servers/59e81a58-9400-4cea-aa38-b24b394e33d7 => generated 1357 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:12:28.789286 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-e20b4109-1953-49e7-b60c-6bb0cce045ba tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Calling method '>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:12:28.789971 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-e20b4109-1953-49e7-b60c-6bb0cce045ba tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] [instance: c8c61fd5-2f2a-4cd9-a439-00943de4dda6] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:12:28.796065 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-e20b4109-1953-49e7-b60c-6bb0cce045ba tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:12:28.796540 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-e20b4109-1953-49e7-b60c-6bb0cce045ba tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:12:28.796971 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-e20b4109-1953-49e7-b60c-6bb0cce045ba tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:12:28.797645 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-e20b4109-1953-49e7-b60c-6bb0cce045ba tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:12:28.798091 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-e20b4109-1953-49e7-b60c-6bb0cce045ba tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:12:28.798507 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-e20b4109-1953-49e7-b60c-6bb0cce045ba tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:12:28.817915 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-bd03cc55-db1d-4954-b663-2559a0bb869a tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Calling method '>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:12:28.818629 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-bd03cc55-db1d-4954-b663-2559a0bb869a tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] [instance: 26bd475b-3495-4669-9985-d4a7dedb4bbf] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:12:28.824625 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-bd03cc55-db1d-4954-b663-2559a0bb869a tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:12:28.825109 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-bd03cc55-db1d-4954-b663-2559a0bb869a tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:12:28.825549 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-bd03cc55-db1d-4954-b663-2559a0bb869a tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:12:28.826235 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-bd03cc55-db1d-4954-b663-2559a0bb869a tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:12:28.826689 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-bd03cc55-db1d-4954-b663-2559a0bb869a tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:12:28.827152 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-bd03cc55-db1d-4954-b663-2559a0bb869a tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:12:29.009441 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-e20b4109-1953-49e7-b60c-6bb0cce045ba tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8569afc405f24a0993a023c818a0c272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f85144e13e254365a86aa785093c8575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:12:29.021759 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-e20b4109-1953-49e7-b60c-6bb0cce045ba tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c61fd5-2f2a-4cd9-a439-00943de4dda6" status: 200 len: 1318 microversion: 2.1 time: 0.237669 Oct 13 13:12:29.035870 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 168/361] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:12:28 2022] GET /compute/v2.1/servers/c8c61fd5-2f2a-4cd9-a439-00943de4dda6 => generated 1318 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:12:29.044584 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-bd03cc55-db1d-4954-b663-2559a0bb869a tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:12:29.054246 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-bd03cc55-db1d-4954-b663-2559a0bb869a tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:12:29.055764 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-bd03cc55-db1d-4954-b663-2559a0bb869a tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:12:29.056959 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-bd03cc55-db1d-4954-b663-2559a0bb869a tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] 10.222.0.23 "GET /compute/v2.1/servers/26bd475b-3495-4669-9985-d4a7dedb4bbf" status: 200 len: 1740 microversion: 2.20 time: 0.242969 Oct 13 13:12:29.058102 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 194/362] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 13:12:28 2022] GET /compute/v2.1/servers/26bd475b-3495-4669-9985-d4a7dedb4bbf => generated 1740 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 13:12:29.120088 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-e4586e8a-f6d4-4de1-8c6e-434fec8cb788 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Calling method '>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:12:29.120964 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-e4586e8a-f6d4-4de1-8c6e-434fec8cb788 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] [instance: b4ba0fd3-eb17-4e05-acaa-5570c1e364d7] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:12:29.127343 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-e4586e8a-f6d4-4de1-8c6e-434fec8cb788 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:12:29.128614 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-e4586e8a-f6d4-4de1-8c6e-434fec8cb788 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:12:29.129051 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-e4586e8a-f6d4-4de1-8c6e-434fec8cb788 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:12:29.129745 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-e4586e8a-f6d4-4de1-8c6e-434fec8cb788 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:12:29.130199 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-e4586e8a-f6d4-4de1-8c6e-434fec8cb788 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:12:29.130618 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-e4586e8a-f6d4-4de1-8c6e-434fec8cb788 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:12:29.256231 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-e4586e8a-f6d4-4de1-8c6e-434fec8cb788 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '454203f47b434cca952a1cef56de559f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7312d0ac9248f2bfbece5611913ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:12:29.263902 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-e4586e8a-f6d4-4de1-8c6e-434fec8cb788 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] 10.222.0.23 "GET /compute/v2.1/servers/b4ba0fd3-eb17-4e05-acaa-5570c1e364d7" status: 200 len: 1371 microversion: 2.1 time: 0.147659 Oct 13 13:12:29.264403 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 169/363] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:12:29 2022] GET /compute/v2.1/servers/b4ba0fd3-eb17-4e05-acaa-5570c1e364d7 => generated 1371 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:12:29.777592 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-c12f8198-4af0-4c73-a9b6-4638321ac95b tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Calling method '>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:12:29.779188 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-c12f8198-4af0-4c73-a9b6-4638321ac95b tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] [instance: 59e81a58-9400-4cea-aa38-b24b394e33d7] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:12:29.786787 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-c12f8198-4af0-4c73-a9b6-4638321ac95b tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:12:29.788268 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-c12f8198-4af0-4c73-a9b6-4638321ac95b tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:12:29.788813 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-c12f8198-4af0-4c73-a9b6-4638321ac95b tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:12:29.789620 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-c12f8198-4af0-4c73-a9b6-4638321ac95b tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:12:29.790201 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-c12f8198-4af0-4c73-a9b6-4638321ac95b tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:12:29.790721 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-c12f8198-4af0-4c73-a9b6-4638321ac95b tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:12:29.796138 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG dbcounter [-] [118814] Writing DB stats nova_cell1:SELECT=100 {{(pid=118814) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:12:29.945640 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-c12f8198-4af0-4c73-a9b6-4638321ac95b tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d89667e52b24295ba619203c02c7bd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed5038c799342d48edc980983f1d996', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:12:29.953232 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-c12f8198-4af0-4c73-a9b6-4638321ac95b tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] 10.222.0.23 "GET /compute/v2.1/servers/59e81a58-9400-4cea-aa38-b24b394e33d7" status: 200 len: 1357 microversion: 2.1 time: 0.179535 Oct 13 13:12:29.953781 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 195/364] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:12:29 2022] GET /compute/v2.1/servers/59e81a58-9400-4cea-aa38-b24b394e33d7 => generated 1357 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:12:30.045777 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-d7c481e2-53ab-41b3-aebd-e9dbeb2a2581 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Calling method '>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:12:30.046343 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-d7c481e2-53ab-41b3-aebd-e9dbeb2a2581 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] [instance: c8c61fd5-2f2a-4cd9-a439-00943de4dda6] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:12:30.053382 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-d7c481e2-53ab-41b3-aebd-e9dbeb2a2581 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:12:30.053869 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-d7c481e2-53ab-41b3-aebd-e9dbeb2a2581 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:12:30.054308 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-d7c481e2-53ab-41b3-aebd-e9dbeb2a2581 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:12:30.055001 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-d7c481e2-53ab-41b3-aebd-e9dbeb2a2581 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:12:30.055483 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-d7c481e2-53ab-41b3-aebd-e9dbeb2a2581 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:12:30.055911 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-d7c481e2-53ab-41b3-aebd-e9dbeb2a2581 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:12:30.083091 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-782c8500-96f9-48f7-89b4-e698d3ea22db tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Calling method '>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:12:30.083689 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-782c8500-96f9-48f7-89b4-e698d3ea22db tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] [instance: 26bd475b-3495-4669-9985-d4a7dedb4bbf] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:12:30.089600 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-782c8500-96f9-48f7-89b4-e698d3ea22db tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:12:30.090090 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-782c8500-96f9-48f7-89b4-e698d3ea22db tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:12:30.090507 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-782c8500-96f9-48f7-89b4-e698d3ea22db tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:12:30.091222 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-782c8500-96f9-48f7-89b4-e698d3ea22db tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:12:30.091667 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-782c8500-96f9-48f7-89b4-e698d3ea22db tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:12:30.092084 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-782c8500-96f9-48f7-89b4-e698d3ea22db tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:12:30.246363 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-d7c481e2-53ab-41b3-aebd-e9dbeb2a2581 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8569afc405f24a0993a023c818a0c272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f85144e13e254365a86aa785093c8575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:12:30.254017 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-d7c481e2-53ab-41b3-aebd-e9dbeb2a2581 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c61fd5-2f2a-4cd9-a439-00943de4dda6" status: 200 len: 1318 microversion: 2.1 time: 0.212133 Oct 13 13:12:30.267937 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 170/365] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:12:30 2022] GET /compute/v2.1/servers/c8c61fd5-2f2a-4cd9-a439-00943de4dda6 => generated 1318 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:12:30.287905 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-e28e7cdd-e3bc-4f85-bf4c-4b73b8d8d15f tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Calling method '>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:12:30.288512 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-e28e7cdd-e3bc-4f85-bf4c-4b73b8d8d15f tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] [instance: b4ba0fd3-eb17-4e05-acaa-5570c1e364d7] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:12:30.294356 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-e28e7cdd-e3bc-4f85-bf4c-4b73b8d8d15f tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:12:30.294846 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-e28e7cdd-e3bc-4f85-bf4c-4b73b8d8d15f tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:12:30.295324 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-e28e7cdd-e3bc-4f85-bf4c-4b73b8d8d15f tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:12:30.296076 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-e28e7cdd-e3bc-4f85-bf4c-4b73b8d8d15f tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:12:30.296477 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-e28e7cdd-e3bc-4f85-bf4c-4b73b8d8d15f tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:12:30.296881 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-e28e7cdd-e3bc-4f85-bf4c-4b73b8d8d15f tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:12:30.298793 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-782c8500-96f9-48f7-89b4-e698d3ea22db tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:12:30.307527 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-782c8500-96f9-48f7-89b4-e698d3ea22db tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:12:30.309206 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-782c8500-96f9-48f7-89b4-e698d3ea22db tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:12:30.310371 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-782c8500-96f9-48f7-89b4-e698d3ea22db tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] 10.222.0.23 "GET /compute/v2.1/servers/26bd475b-3495-4669-9985-d4a7dedb4bbf" status: 200 len: 1740 microversion: 2.20 time: 0.231163 Oct 13 13:12:30.317039 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 196/366] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 13:12:30 2022] GET /compute/v2.1/servers/26bd475b-3495-4669-9985-d4a7dedb4bbf => generated 1740 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 13 13:12:30.432442 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-e28e7cdd-e3bc-4f85-bf4c-4b73b8d8d15f tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '454203f47b434cca952a1cef56de559f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7312d0ac9248f2bfbece5611913ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:12:30.439874 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-e28e7cdd-e3bc-4f85-bf4c-4b73b8d8d15f tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] 10.222.0.23 "GET /compute/v2.1/servers/b4ba0fd3-eb17-4e05-acaa-5570c1e364d7" status: 200 len: 1371 microversion: 2.1 time: 0.156545 Oct 13 13:12:30.440437 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 171/367] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:12:30 2022] GET /compute/v2.1/servers/b4ba0fd3-eb17-4e05-acaa-5570c1e364d7 => generated 1371 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 13:12:30.978791 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-bc0ca323-2c6b-4284-96c7-b2d3b57277c0 tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Calling method '>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:12:30.981242 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-bc0ca323-2c6b-4284-96c7-b2d3b57277c0 tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] [instance: 59e81a58-9400-4cea-aa38-b24b394e33d7] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:12:30.990762 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-bc0ca323-2c6b-4284-96c7-b2d3b57277c0 tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:12:30.991268 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-bc0ca323-2c6b-4284-96c7-b2d3b57277c0 tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:12:30.991790 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-bc0ca323-2c6b-4284-96c7-b2d3b57277c0 tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:12:30.992479 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-bc0ca323-2c6b-4284-96c7-b2d3b57277c0 tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:12:30.992972 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-bc0ca323-2c6b-4284-96c7-b2d3b57277c0 tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:12:30.993344 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-bc0ca323-2c6b-4284-96c7-b2d3b57277c0 tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:12:31.138551 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-bc0ca323-2c6b-4284-96c7-b2d3b57277c0 tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d89667e52b24295ba619203c02c7bd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed5038c799342d48edc980983f1d996', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:12:31.146437 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-bc0ca323-2c6b-4284-96c7-b2d3b57277c0 tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] 10.222.0.23 "GET /compute/v2.1/servers/59e81a58-9400-4cea-aa38-b24b394e33d7" status: 200 len: 1357 microversion: 2.1 time: 0.174319 Oct 13 13:12:31.146997 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 197/368] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:12:30 2022] GET /compute/v2.1/servers/59e81a58-9400-4cea-aa38-b24b394e33d7 => generated 1357 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:12:31.277752 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-dab4e80f-a2d6-4f5f-8ff7-23a87274dbdc tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Calling method '>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:12:31.278362 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-dab4e80f-a2d6-4f5f-8ff7-23a87274dbdc tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] [instance: c8c61fd5-2f2a-4cd9-a439-00943de4dda6] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:12:31.284671 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-dab4e80f-a2d6-4f5f-8ff7-23a87274dbdc tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:12:31.285667 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-dab4e80f-a2d6-4f5f-8ff7-23a87274dbdc tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:12:31.286102 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-dab4e80f-a2d6-4f5f-8ff7-23a87274dbdc tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:12:31.286785 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-dab4e80f-a2d6-4f5f-8ff7-23a87274dbdc tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:12:31.287267 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-dab4e80f-a2d6-4f5f-8ff7-23a87274dbdc tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:12:31.287691 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-dab4e80f-a2d6-4f5f-8ff7-23a87274dbdc tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:12:31.335765 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-29f29dbe-e58f-4885-b90a-c8835d87fc92 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Calling method '>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:12:31.336635 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-29f29dbe-e58f-4885-b90a-c8835d87fc92 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] [instance: 26bd475b-3495-4669-9985-d4a7dedb4bbf] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:12:31.342777 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-29f29dbe-e58f-4885-b90a-c8835d87fc92 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:12:31.343304 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-29f29dbe-e58f-4885-b90a-c8835d87fc92 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:12:31.343736 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-29f29dbe-e58f-4885-b90a-c8835d87fc92 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:12:31.344418 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-29f29dbe-e58f-4885-b90a-c8835d87fc92 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:12:31.344868 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-29f29dbe-e58f-4885-b90a-c8835d87fc92 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:12:31.345287 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-29f29dbe-e58f-4885-b90a-c8835d87fc92 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:12:31.473235 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-dab4e80f-a2d6-4f5f-8ff7-23a87274dbdc tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8569afc405f24a0993a023c818a0c272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f85144e13e254365a86aa785093c8575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:12:31.481342 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-dab4e80f-a2d6-4f5f-8ff7-23a87274dbdc tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c61fd5-2f2a-4cd9-a439-00943de4dda6" status: 200 len: 1318 microversion: 2.1 time: 0.207369 Oct 13 13:12:31.482087 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 172/369] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:12:31 2022] GET /compute/v2.1/servers/c8c61fd5-2f2a-4cd9-a439-00943de4dda6 => generated 1318 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:12:31.487328 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-cc970cf8-76ad-44e9-9601-d823b99eccdd tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Calling method '>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:12:31.488671 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-cc970cf8-76ad-44e9-9601-d823b99eccdd tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] [instance: b4ba0fd3-eb17-4e05-acaa-5570c1e364d7] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:12:31.495210 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-cc970cf8-76ad-44e9-9601-d823b99eccdd tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:12:31.495815 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-cc970cf8-76ad-44e9-9601-d823b99eccdd tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:12:31.496353 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-cc970cf8-76ad-44e9-9601-d823b99eccdd tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:12:31.497146 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-cc970cf8-76ad-44e9-9601-d823b99eccdd tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:12:31.498045 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-cc970cf8-76ad-44e9-9601-d823b99eccdd tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:12:31.498172 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-cc970cf8-76ad-44e9-9601-d823b99eccdd tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:12:31.517872 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-29f29dbe-e58f-4885-b90a-c8835d87fc92 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:12:31.526390 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-29f29dbe-e58f-4885-b90a-c8835d87fc92 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:12:31.527874 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-29f29dbe-e58f-4885-b90a-c8835d87fc92 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:12:31.529066 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-29f29dbe-e58f-4885-b90a-c8835d87fc92 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] 10.222.0.23 "GET /compute/v2.1/servers/26bd475b-3495-4669-9985-d4a7dedb4bbf" status: 200 len: 1740 microversion: 2.20 time: 0.197472 Oct 13 13:12:31.529625 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 198/370] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 13:12:31 2022] GET /compute/v2.1/servers/26bd475b-3495-4669-9985-d4a7dedb4bbf => generated 1740 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 13 13:12:31.629231 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-cc970cf8-76ad-44e9-9601-d823b99eccdd tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '454203f47b434cca952a1cef56de559f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7312d0ac9248f2bfbece5611913ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:12:31.636799 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-cc970cf8-76ad-44e9-9601-d823b99eccdd tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] 10.222.0.23 "GET /compute/v2.1/servers/b4ba0fd3-eb17-4e05-acaa-5570c1e364d7" status: 200 len: 1371 microversion: 2.1 time: 0.153630 Oct 13 13:12:31.637362 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 173/371] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:12:31 2022] GET /compute/v2.1/servers/b4ba0fd3-eb17-4e05-acaa-5570c1e364d7 => generated 1371 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:12:32.169046 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-89445b60-4cd5-439c-9756-2decc09cac08 tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Calling method '>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:12:32.169618 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-89445b60-4cd5-439c-9756-2decc09cac08 tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] [instance: 59e81a58-9400-4cea-aa38-b24b394e33d7] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:12:32.176229 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-89445b60-4cd5-439c-9756-2decc09cac08 tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:12:32.176703 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-89445b60-4cd5-439c-9756-2decc09cac08 tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:12:32.177136 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-89445b60-4cd5-439c-9756-2decc09cac08 tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:12:32.177818 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-89445b60-4cd5-439c-9756-2decc09cac08 tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:12:32.178261 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-89445b60-4cd5-439c-9756-2decc09cac08 tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:12:32.178695 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-89445b60-4cd5-439c-9756-2decc09cac08 tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:12:32.308035 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-89445b60-4cd5-439c-9756-2decc09cac08 tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d89667e52b24295ba619203c02c7bd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed5038c799342d48edc980983f1d996', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:12:32.315446 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-89445b60-4cd5-439c-9756-2decc09cac08 tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] 10.222.0.23 "GET /compute/v2.1/servers/59e81a58-9400-4cea-aa38-b24b394e33d7" status: 200 len: 1357 microversion: 2.1 time: 0.150356 Oct 13 13:12:32.316001 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 199/372] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:12:32 2022] GET /compute/v2.1/servers/59e81a58-9400-4cea-aa38-b24b394e33d7 => generated 1357 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:12:32.504539 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-50e78a19-14bf-4844-919c-b2298444bd6b tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Calling method '>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:12:32.505122 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-50e78a19-14bf-4844-919c-b2298444bd6b tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] [instance: c8c61fd5-2f2a-4cd9-a439-00943de4dda6] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:12:32.511444 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-50e78a19-14bf-4844-919c-b2298444bd6b tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:12:32.511918 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-50e78a19-14bf-4844-919c-b2298444bd6b tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:12:32.512355 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-50e78a19-14bf-4844-919c-b2298444bd6b tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:12:32.513030 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-50e78a19-14bf-4844-919c-b2298444bd6b tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:12:32.513471 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-50e78a19-14bf-4844-919c-b2298444bd6b tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:12:32.513890 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-50e78a19-14bf-4844-919c-b2298444bd6b tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:12:32.554598 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-5bfb88f8-5628-47f7-a4db-9237a01add57 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Calling method '>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:12:32.555554 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-5bfb88f8-5628-47f7-a4db-9237a01add57 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] [instance: 26bd475b-3495-4669-9985-d4a7dedb4bbf] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:12:32.561218 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-5bfb88f8-5628-47f7-a4db-9237a01add57 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:12:32.561702 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-5bfb88f8-5628-47f7-a4db-9237a01add57 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:12:32.562134 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-5bfb88f8-5628-47f7-a4db-9237a01add57 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:12:32.562847 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-5bfb88f8-5628-47f7-a4db-9237a01add57 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:12:32.563304 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-5bfb88f8-5628-47f7-a4db-9237a01add57 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:12:32.563724 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-5bfb88f8-5628-47f7-a4db-9237a01add57 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:12:32.697739 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-50e78a19-14bf-4844-919c-b2298444bd6b tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8569afc405f24a0993a023c818a0c272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f85144e13e254365a86aa785093c8575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:12:32.705500 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-50e78a19-14bf-4844-919c-b2298444bd6b tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c61fd5-2f2a-4cd9-a439-00943de4dda6" status: 200 len: 1318 microversion: 2.1 time: 0.204823 Oct 13 13:12:32.706061 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 174/373] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:12:32 2022] GET /compute/v2.1/servers/c8c61fd5-2f2a-4cd9-a439-00943de4dda6 => generated 1318 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:12:32.710975 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-0418d5e0-4fa0-4f25-bd0a-2450d3c490ed tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Calling method '>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:12:32.711610 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-0418d5e0-4fa0-4f25-bd0a-2450d3c490ed tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] [instance: b4ba0fd3-eb17-4e05-acaa-5570c1e364d7] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:12:32.717171 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-0418d5e0-4fa0-4f25-bd0a-2450d3c490ed tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:12:32.717665 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-0418d5e0-4fa0-4f25-bd0a-2450d3c490ed tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:12:32.718106 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-0418d5e0-4fa0-4f25-bd0a-2450d3c490ed tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:12:32.718794 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-0418d5e0-4fa0-4f25-bd0a-2450d3c490ed tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:12:32.719279 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-0418d5e0-4fa0-4f25-bd0a-2450d3c490ed tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:12:32.719707 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-0418d5e0-4fa0-4f25-bd0a-2450d3c490ed tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:12:32.727594 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-5bfb88f8-5628-47f7-a4db-9237a01add57 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:12:32.735942 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-5bfb88f8-5628-47f7-a4db-9237a01add57 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:12:32.737379 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-5bfb88f8-5628-47f7-a4db-9237a01add57 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:12:32.738468 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-5bfb88f8-5628-47f7-a4db-9237a01add57 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] 10.222.0.23 "GET /compute/v2.1/servers/26bd475b-3495-4669-9985-d4a7dedb4bbf" status: 200 len: 1740 microversion: 2.20 time: 0.188362 Oct 13 13:12:32.739032 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 200/374] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 13:12:32 2022] GET /compute/v2.1/servers/26bd475b-3495-4669-9985-d4a7dedb4bbf => generated 1740 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 13:12:32.863835 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-0418d5e0-4fa0-4f25-bd0a-2450d3c490ed tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '454203f47b434cca952a1cef56de559f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7312d0ac9248f2bfbece5611913ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:12:32.872173 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-0418d5e0-4fa0-4f25-bd0a-2450d3c490ed tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] 10.222.0.23 "GET /compute/v2.1/servers/b4ba0fd3-eb17-4e05-acaa-5570c1e364d7" status: 200 len: 1371 microversion: 2.1 time: 0.165101 Oct 13 13:12:32.887336 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 175/375] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:12:32 2022] GET /compute/v2.1/servers/b4ba0fd3-eb17-4e05-acaa-5570c1e364d7 => generated 1371 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:12:33.337931 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-e5dbe1ea-c641-48a1-8a8a-31b00b3cd9ee tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Calling method '>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:12:33.338566 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-e5dbe1ea-c641-48a1-8a8a-31b00b3cd9ee tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] [instance: 59e81a58-9400-4cea-aa38-b24b394e33d7] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:12:33.344967 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-e5dbe1ea-c641-48a1-8a8a-31b00b3cd9ee tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:12:33.345447 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-e5dbe1ea-c641-48a1-8a8a-31b00b3cd9ee tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:12:33.345880 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-e5dbe1ea-c641-48a1-8a8a-31b00b3cd9ee tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:12:33.346564 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-e5dbe1ea-c641-48a1-8a8a-31b00b3cd9ee tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:12:33.347015 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-e5dbe1ea-c641-48a1-8a8a-31b00b3cd9ee tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:12:33.347521 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-e5dbe1ea-c641-48a1-8a8a-31b00b3cd9ee tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:12:33.470958 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-e5dbe1ea-c641-48a1-8a8a-31b00b3cd9ee tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d89667e52b24295ba619203c02c7bd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed5038c799342d48edc980983f1d996', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:12:33.478635 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-e5dbe1ea-c641-48a1-8a8a-31b00b3cd9ee tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] 10.222.0.23 "GET /compute/v2.1/servers/59e81a58-9400-4cea-aa38-b24b394e33d7" status: 200 len: 1357 microversion: 2.1 time: 0.144647 Oct 13 13:12:33.479222 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 201/376] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:12:33 2022] GET /compute/v2.1/servers/59e81a58-9400-4cea-aa38-b24b394e33d7 => generated 1357 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:12:33.728906 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-a5b29984-06b1-4220-83da-ce0142a12f11 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Calling method '>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:12:33.729484 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-a5b29984-06b1-4220-83da-ce0142a12f11 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] [instance: c8c61fd5-2f2a-4cd9-a439-00943de4dda6] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:12:33.731385 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG dbcounter [-] [118815] Writing DB stats nova_cell0:SELECT=4 {{(pid=118815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:12:33.737067 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-a5b29984-06b1-4220-83da-ce0142a12f11 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:12:33.737558 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-a5b29984-06b1-4220-83da-ce0142a12f11 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:12:33.738584 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-a5b29984-06b1-4220-83da-ce0142a12f11 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:12:33.739296 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-a5b29984-06b1-4220-83da-ce0142a12f11 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:12:33.739750 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-a5b29984-06b1-4220-83da-ce0142a12f11 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:12:33.740171 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-a5b29984-06b1-4220-83da-ce0142a12f11 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:12:33.771334 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-4be9b479-5833-44d0-8948-43b5b90ce611 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Calling method '>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:12:33.773227 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-4be9b479-5833-44d0-8948-43b5b90ce611 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] [instance: 26bd475b-3495-4669-9985-d4a7dedb4bbf] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:12:33.792887 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-4be9b479-5833-44d0-8948-43b5b90ce611 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:12:33.793385 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-4be9b479-5833-44d0-8948-43b5b90ce611 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:12:33.793823 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-4be9b479-5833-44d0-8948-43b5b90ce611 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:12:33.794530 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-4be9b479-5833-44d0-8948-43b5b90ce611 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:12:33.794981 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-4be9b479-5833-44d0-8948-43b5b90ce611 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:12:33.795437 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-4be9b479-5833-44d0-8948-43b5b90ce611 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:12:33.846099 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG dbcounter [-] [118815] Writing DB stats nova_cell0:SELECT=16 {{(pid=118815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:12:33.997585 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-a5b29984-06b1-4220-83da-ce0142a12f11 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8569afc405f24a0993a023c818a0c272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f85144e13e254365a86aa785093c8575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:12:34.005575 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-4be9b479-5833-44d0-8948-43b5b90ce611 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:12:34.007475 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-a5b29984-06b1-4220-83da-ce0142a12f11 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c61fd5-2f2a-4cd9-a439-00943de4dda6" status: 200 len: 1318 microversion: 2.1 time: 0.282363 Oct 13 13:12:34.021245 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-4be9b479-5833-44d0-8948-43b5b90ce611 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:12:34.021245 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-4be9b479-5833-44d0-8948-43b5b90ce611 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:12:34.021245 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-4be9b479-5833-44d0-8948-43b5b90ce611 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] 10.222.0.23 "GET /compute/v2.1/servers/26bd475b-3495-4669-9985-d4a7dedb4bbf" status: 200 len: 1740 microversion: 2.20 time: 0.253796 Oct 13 13:12:34.021642 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 202/377] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 13:12:33 2022] GET /compute/v2.1/servers/26bd475b-3495-4669-9985-d4a7dedb4bbf => generated 1740 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 13:12:34.022306 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 176/378] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:12:33 2022] GET /compute/v2.1/servers/c8c61fd5-2f2a-4cd9-a439-00943de4dda6 => generated 1318 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:12:34.031260 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-81fdc740-1ac0-4cdb-b3dd-d67c0ff7e896 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Calling method '>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:12:34.031260 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-81fdc740-1ac0-4cdb-b3dd-d67c0ff7e896 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] [instance: b4ba0fd3-eb17-4e05-acaa-5570c1e364d7] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:12:34.037007 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-81fdc740-1ac0-4cdb-b3dd-d67c0ff7e896 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:12:34.037513 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-81fdc740-1ac0-4cdb-b3dd-d67c0ff7e896 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:12:34.038027 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-81fdc740-1ac0-4cdb-b3dd-d67c0ff7e896 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:12:34.038880 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-81fdc740-1ac0-4cdb-b3dd-d67c0ff7e896 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:12:34.039369 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-81fdc740-1ac0-4cdb-b3dd-d67c0ff7e896 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:12:34.039799 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-81fdc740-1ac0-4cdb-b3dd-d67c0ff7e896 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:12:34.174465 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-81fdc740-1ac0-4cdb-b3dd-d67c0ff7e896 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '454203f47b434cca952a1cef56de559f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7312d0ac9248f2bfbece5611913ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:12:34.187906 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-81fdc740-1ac0-4cdb-b3dd-d67c0ff7e896 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] 10.222.0.23 "GET /compute/v2.1/servers/b4ba0fd3-eb17-4e05-acaa-5570c1e364d7" status: 200 len: 1371 microversion: 2.1 time: 0.165416 Oct 13 13:12:34.195362 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 203/379] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:12:34 2022] GET /compute/v2.1/servers/b4ba0fd3-eb17-4e05-acaa-5570c1e364d7 => generated 1371 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:12:34.501695 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-fd5798cc-d88b-495d-b0a4-f96a337c6640 tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Calling method '>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:12:34.502302 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-fd5798cc-d88b-495d-b0a4-f96a337c6640 tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] [instance: 59e81a58-9400-4cea-aa38-b24b394e33d7] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:12:34.508244 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-fd5798cc-d88b-495d-b0a4-f96a337c6640 tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:12:34.508719 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-fd5798cc-d88b-495d-b0a4-f96a337c6640 tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:12:34.509153 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-fd5798cc-d88b-495d-b0a4-f96a337c6640 tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:12:34.509829 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-fd5798cc-d88b-495d-b0a4-f96a337c6640 tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:12:34.510276 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-fd5798cc-d88b-495d-b0a4-f96a337c6640 tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:12:34.510718 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-fd5798cc-d88b-495d-b0a4-f96a337c6640 tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:12:34.660813 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-fd5798cc-d88b-495d-b0a4-f96a337c6640 tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d89667e52b24295ba619203c02c7bd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed5038c799342d48edc980983f1d996', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:12:34.668888 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-fd5798cc-d88b-495d-b0a4-f96a337c6640 tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] 10.222.0.23 "GET /compute/v2.1/servers/59e81a58-9400-4cea-aa38-b24b394e33d7" status: 200 len: 1357 microversion: 2.1 time: 0.170975 Oct 13 13:12:34.669794 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 177/380] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:12:34 2022] GET /compute/v2.1/servers/59e81a58-9400-4cea-aa38-b24b394e33d7 => generated 1357 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:12:35.041868 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-8527df61-47e1-489f-b85f-10726f827512 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Calling method '>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:12:35.042615 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-8527df61-47e1-489f-b85f-10726f827512 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] [instance: c8c61fd5-2f2a-4cd9-a439-00943de4dda6] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:12:35.049151 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-8527df61-47e1-489f-b85f-10726f827512 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:12:35.049635 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-8527df61-47e1-489f-b85f-10726f827512 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:12:35.050071 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-8527df61-47e1-489f-b85f-10726f827512 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:12:35.050832 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-8527df61-47e1-489f-b85f-10726f827512 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:12:35.051673 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-8527df61-47e1-489f-b85f-10726f827512 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:12:35.051906 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-b5666ac7-1ee2-44df-8290-800be07aea34 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Calling method '>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:12:35.052342 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-8527df61-47e1-489f-b85f-10726f827512 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:12:35.052643 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-b5666ac7-1ee2-44df-8290-800be07aea34 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] [instance: 26bd475b-3495-4669-9985-d4a7dedb4bbf] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:12:35.059300 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-b5666ac7-1ee2-44df-8290-800be07aea34 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:12:35.059855 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-b5666ac7-1ee2-44df-8290-800be07aea34 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:12:35.060395 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-b5666ac7-1ee2-44df-8290-800be07aea34 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:12:35.061157 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-b5666ac7-1ee2-44df-8290-800be07aea34 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:12:35.061707 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-b5666ac7-1ee2-44df-8290-800be07aea34 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:12:35.062189 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-b5666ac7-1ee2-44df-8290-800be07aea34 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:12:35.263679 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-8527df61-47e1-489f-b85f-10726f827512 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8569afc405f24a0993a023c818a0c272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f85144e13e254365a86aa785093c8575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:12:35.271357 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-8527df61-47e1-489f-b85f-10726f827512 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c61fd5-2f2a-4cd9-a439-00943de4dda6" status: 200 len: 1318 microversion: 2.1 time: 0.233301 Oct 13 13:12:35.272070 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 204/381] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:12:35 2022] GET /compute/v2.1/servers/c8c61fd5-2f2a-4cd9-a439-00943de4dda6 => generated 1318 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:12:35.276472 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-dd42ce59-e9fa-451c-8aae-49e508fb50c1 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Calling method '>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:12:35.277077 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-dd42ce59-e9fa-451c-8aae-49e508fb50c1 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] [instance: b4ba0fd3-eb17-4e05-acaa-5570c1e364d7] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:12:35.282715 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-dd42ce59-e9fa-451c-8aae-49e508fb50c1 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:12:35.283265 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-dd42ce59-e9fa-451c-8aae-49e508fb50c1 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:12:35.283710 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-dd42ce59-e9fa-451c-8aae-49e508fb50c1 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:12:35.287091 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-dd42ce59-e9fa-451c-8aae-49e508fb50c1 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:12:35.287091 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-dd42ce59-e9fa-451c-8aae-49e508fb50c1 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:12:35.287091 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-dd42ce59-e9fa-451c-8aae-49e508fb50c1 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:12:35.287374 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-b5666ac7-1ee2-44df-8290-800be07aea34 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:12:35.303688 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-b5666ac7-1ee2-44df-8290-800be07aea34 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:12:35.305517 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-b5666ac7-1ee2-44df-8290-800be07aea34 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:12:35.306920 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-b5666ac7-1ee2-44df-8290-800be07aea34 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] 10.222.0.23 "GET /compute/v2.1/servers/26bd475b-3495-4669-9985-d4a7dedb4bbf" status: 200 len: 1740 microversion: 2.20 time: 0.259581 Oct 13 13:12:35.308000 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 178/382] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 13:12:35 2022] GET /compute/v2.1/servers/26bd475b-3495-4669-9985-d4a7dedb4bbf => generated 1740 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 13 13:12:35.432928 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-dd42ce59-e9fa-451c-8aae-49e508fb50c1 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '454203f47b434cca952a1cef56de559f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7312d0ac9248f2bfbece5611913ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:12:35.440528 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-dd42ce59-e9fa-451c-8aae-49e508fb50c1 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] 10.222.0.23 "GET /compute/v2.1/servers/b4ba0fd3-eb17-4e05-acaa-5570c1e364d7" status: 200 len: 1371 microversion: 2.1 time: 0.167485 Oct 13 13:12:35.441122 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 205/383] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:12:35 2022] GET /compute/v2.1/servers/b4ba0fd3-eb17-4e05-acaa-5570c1e364d7 => generated 1371 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:12:35.693290 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-b845de7f-422b-445d-8405-24c75e83d121 tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Calling method '>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:12:35.694982 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-b845de7f-422b-445d-8405-24c75e83d121 tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] [instance: 59e81a58-9400-4cea-aa38-b24b394e33d7] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:12:35.700564 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-b845de7f-422b-445d-8405-24c75e83d121 tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:12:35.701051 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-b845de7f-422b-445d-8405-24c75e83d121 tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:12:35.701484 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-b845de7f-422b-445d-8405-24c75e83d121 tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:12:35.702179 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-b845de7f-422b-445d-8405-24c75e83d121 tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:12:35.702629 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-b845de7f-422b-445d-8405-24c75e83d121 tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:12:35.703118 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-b845de7f-422b-445d-8405-24c75e83d121 tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:12:35.840843 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-b845de7f-422b-445d-8405-24c75e83d121 tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d89667e52b24295ba619203c02c7bd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed5038c799342d48edc980983f1d996', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:12:35.848483 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-b845de7f-422b-445d-8405-24c75e83d121 tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] 10.222.0.23 "GET /compute/v2.1/servers/59e81a58-9400-4cea-aa38-b24b394e33d7" status: 200 len: 1357 microversion: 2.1 time: 0.159224 Oct 13 13:12:35.849041 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 179/384] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:12:35 2022] GET /compute/v2.1/servers/59e81a58-9400-4cea-aa38-b24b394e33d7 => generated 1357 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:12:36.296352 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-018fec84-47ca-427c-a108-d3f00d5c8812 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Calling method '>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:12:36.296983 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-018fec84-47ca-427c-a108-d3f00d5c8812 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] [instance: c8c61fd5-2f2a-4cd9-a439-00943de4dda6] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:12:36.305465 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-018fec84-47ca-427c-a108-d3f00d5c8812 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:12:36.305942 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-018fec84-47ca-427c-a108-d3f00d5c8812 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:12:36.306375 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-018fec84-47ca-427c-a108-d3f00d5c8812 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:12:36.307075 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-018fec84-47ca-427c-a108-d3f00d5c8812 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:12:36.307522 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-018fec84-47ca-427c-a108-d3f00d5c8812 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:12:36.307943 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-018fec84-47ca-427c-a108-d3f00d5c8812 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:12:36.337057 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-a7d132b5-4aab-4b2e-a397-dc14113286b1 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Calling method '>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:12:36.338245 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-a7d132b5-4aab-4b2e-a397-dc14113286b1 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] [instance: 26bd475b-3495-4669-9985-d4a7dedb4bbf] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:12:36.352217 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-a7d132b5-4aab-4b2e-a397-dc14113286b1 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:12:36.352807 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-a7d132b5-4aab-4b2e-a397-dc14113286b1 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:12:36.353317 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-a7d132b5-4aab-4b2e-a397-dc14113286b1 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:12:36.354090 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-a7d132b5-4aab-4b2e-a397-dc14113286b1 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:12:36.354562 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-a7d132b5-4aab-4b2e-a397-dc14113286b1 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:12:36.355007 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-a7d132b5-4aab-4b2e-a397-dc14113286b1 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:12:36.484492 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-018fec84-47ca-427c-a108-d3f00d5c8812 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8569afc405f24a0993a023c818a0c272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f85144e13e254365a86aa785093c8575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:12:36.492695 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-018fec84-47ca-427c-a108-d3f00d5c8812 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c61fd5-2f2a-4cd9-a439-00943de4dda6" status: 200 len: 1318 microversion: 2.1 time: 0.200155 Oct 13 13:12:36.493251 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 206/385] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:12:36 2022] GET /compute/v2.1/servers/c8c61fd5-2f2a-4cd9-a439-00943de4dda6 => generated 1318 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:12:36.497813 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-0fd3675f-808d-42cc-86fc-fdd9dc71d933 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Calling method '>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:12:36.498411 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-0fd3675f-808d-42cc-86fc-fdd9dc71d933 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] [instance: b4ba0fd3-eb17-4e05-acaa-5570c1e364d7] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:12:36.504717 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-0fd3675f-808d-42cc-86fc-fdd9dc71d933 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:12:36.505556 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-0fd3675f-808d-42cc-86fc-fdd9dc71d933 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:12:36.505694 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-0fd3675f-808d-42cc-86fc-fdd9dc71d933 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:12:36.506305 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-0fd3675f-808d-42cc-86fc-fdd9dc71d933 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:12:36.506755 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-0fd3675f-808d-42cc-86fc-fdd9dc71d933 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:12:36.507211 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-0fd3675f-808d-42cc-86fc-fdd9dc71d933 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:12:36.515564 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-a7d132b5-4aab-4b2e-a397-dc14113286b1 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:12:36.523659 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-a7d132b5-4aab-4b2e-a397-dc14113286b1 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:12:36.525090 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-a7d132b5-4aab-4b2e-a397-dc14113286b1 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:12:36.526236 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-a7d132b5-4aab-4b2e-a397-dc14113286b1 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] 10.222.0.23 "GET /compute/v2.1/servers/26bd475b-3495-4669-9985-d4a7dedb4bbf" status: 200 len: 1740 microversion: 2.20 time: 0.194721 Oct 13 13:12:36.526780 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 180/386] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 13:12:36 2022] GET /compute/v2.1/servers/26bd475b-3495-4669-9985-d4a7dedb4bbf => generated 1740 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 13 13:12:36.632702 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-0fd3675f-808d-42cc-86fc-fdd9dc71d933 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '454203f47b434cca952a1cef56de559f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7312d0ac9248f2bfbece5611913ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:12:36.640236 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-0fd3675f-808d-42cc-86fc-fdd9dc71d933 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] 10.222.0.23 "GET /compute/v2.1/servers/b4ba0fd3-eb17-4e05-acaa-5570c1e364d7" status: 200 len: 1371 microversion: 2.1 time: 0.146061 Oct 13 13:12:36.640785 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 207/387] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:12:36 2022] GET /compute/v2.1/servers/b4ba0fd3-eb17-4e05-acaa-5570c1e364d7 => generated 1371 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:12:36.870208 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-92ad2685-65c8-42ef-93a1-bfc546b3105e tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Calling method '>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:12:36.872498 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-92ad2685-65c8-42ef-93a1-bfc546b3105e tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] [instance: 59e81a58-9400-4cea-aa38-b24b394e33d7] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:12:36.878956 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-92ad2685-65c8-42ef-93a1-bfc546b3105e tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:12:36.879430 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-92ad2685-65c8-42ef-93a1-bfc546b3105e tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:12:36.879878 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-92ad2685-65c8-42ef-93a1-bfc546b3105e tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:12:36.880625 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-92ad2685-65c8-42ef-93a1-bfc546b3105e tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:12:36.881040 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-92ad2685-65c8-42ef-93a1-bfc546b3105e tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:12:36.881466 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-92ad2685-65c8-42ef-93a1-bfc546b3105e tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:12:37.018772 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-92ad2685-65c8-42ef-93a1-bfc546b3105e tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d89667e52b24295ba619203c02c7bd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed5038c799342d48edc980983f1d996', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:12:37.027067 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-92ad2685-65c8-42ef-93a1-bfc546b3105e tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] 10.222.0.23 "GET /compute/v2.1/servers/59e81a58-9400-4cea-aa38-b24b394e33d7" status: 200 len: 1357 microversion: 2.1 time: 0.160934 Oct 13 13:12:37.028092 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 181/388] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:12:36 2022] GET /compute/v2.1/servers/59e81a58-9400-4cea-aa38-b24b394e33d7 => generated 1357 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:12:37.516149 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-2457b324-5fa6-4475-93d4-dbd8a80cfb02 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Calling method '>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:12:37.516668 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-2457b324-5fa6-4475-93d4-dbd8a80cfb02 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] [instance: c8c61fd5-2f2a-4cd9-a439-00943de4dda6] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:12:37.522902 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-2457b324-5fa6-4475-93d4-dbd8a80cfb02 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:12:37.524028 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-2457b324-5fa6-4475-93d4-dbd8a80cfb02 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:12:37.524469 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-2457b324-5fa6-4475-93d4-dbd8a80cfb02 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:12:37.525241 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-2457b324-5fa6-4475-93d4-dbd8a80cfb02 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:12:37.525687 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-2457b324-5fa6-4475-93d4-dbd8a80cfb02 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:12:37.526291 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-2457b324-5fa6-4475-93d4-dbd8a80cfb02 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:12:37.553396 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-68522838-e304-477e-b3c1-0b82c4623cca tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Calling method '>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:12:37.554085 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-68522838-e304-477e-b3c1-0b82c4623cca tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] [instance: 26bd475b-3495-4669-9985-d4a7dedb4bbf] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:12:37.566966 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-68522838-e304-477e-b3c1-0b82c4623cca tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:12:37.568557 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-68522838-e304-477e-b3c1-0b82c4623cca tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:12:37.568557 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-68522838-e304-477e-b3c1-0b82c4623cca tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:12:37.574177 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-68522838-e304-477e-b3c1-0b82c4623cca tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:12:37.574878 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-68522838-e304-477e-b3c1-0b82c4623cca tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:12:37.575155 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-68522838-e304-477e-b3c1-0b82c4623cca tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:12:38.030859 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-2457b324-5fa6-4475-93d4-dbd8a80cfb02 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8569afc405f24a0993a023c818a0c272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f85144e13e254365a86aa785093c8575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:12:38.038658 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-2457b324-5fa6-4475-93d4-dbd8a80cfb02 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c61fd5-2f2a-4cd9-a439-00943de4dda6" status: 200 len: 1318 microversion: 2.1 time: 0.526410 Oct 13 13:12:38.039262 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 208/389] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:12:37 2022] GET /compute/v2.1/servers/c8c61fd5-2f2a-4cd9-a439-00943de4dda6 => generated 1318 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:12:38.043700 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-c3d02327-9b0a-45ba-8baa-a4dae6095073 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Calling method '>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:12:38.044313 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-c3d02327-9b0a-45ba-8baa-a4dae6095073 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] [instance: b4ba0fd3-eb17-4e05-acaa-5570c1e364d7] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:12:38.045778 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-68522838-e304-477e-b3c1-0b82c4623cca tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:12:38.046054 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG dbcounter [-] [118814] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=118814) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:12:38.051668 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-c3d02327-9b0a-45ba-8baa-a4dae6095073 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:12:38.052164 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-c3d02327-9b0a-45ba-8baa-a4dae6095073 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:12:38.052606 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-c3d02327-9b0a-45ba-8baa-a4dae6095073 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:12:38.053523 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-c3d02327-9b0a-45ba-8baa-a4dae6095073 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:12:38.053984 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-c3d02327-9b0a-45ba-8baa-a4dae6095073 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:12:38.054412 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-c3d02327-9b0a-45ba-8baa-a4dae6095073 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:12:38.055398 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-68522838-e304-477e-b3c1-0b82c4623cca tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:12:38.056899 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-68522838-e304-477e-b3c1-0b82c4623cca tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:12:38.058057 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-68522838-e304-477e-b3c1-0b82c4623cca tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] 10.222.0.23 "GET /compute/v2.1/servers/26bd475b-3495-4669-9985-d4a7dedb4bbf" status: 200 len: 1722 microversion: 2.20 time: 0.509860 Oct 13 13:12:38.058829 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 182/390] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 13:12:37 2022] GET /compute/v2.1/servers/26bd475b-3495-4669-9985-d4a7dedb4bbf => generated 1722 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 13 13:12:38.063583 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [req-e440aed9-8b04-405b-8335-67c472cf5ff6 req-7a8f4229-f7ae-446a-adb4-6f0efb27644e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c8c61fd5-2f2a-4cd9-a439-00943de4dda6", "tag": "47c8bf5c-a500-440a-a247-090d3dbe386b"}]} {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 13:12:38.073385 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [req-e440aed9-8b04-405b-8335-67c472cf5ff6 req-7a8f4229-f7ae-446a-adb4-6f0efb27644e service nova] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:12:38.073862 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [req-e440aed9-8b04-405b-8335-67c472cf5ff6 req-7a8f4229-f7ae-446a-adb4-6f0efb27644e service nova] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:12:38.074296 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [req-e440aed9-8b04-405b-8335-67c472cf5ff6 req-7a8f4229-f7ae-446a-adb4-6f0efb27644e service nova] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:12:38.085436 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.compute.server_external_events [req-e440aed9-8b04-405b-8335-67c472cf5ff6 req-7a8f4229-f7ae-446a-adb4-6f0efb27644e service nova] Creating event network-changed:47c8bf5c-a500-440a-a247-090d3dbe386b for instance c8c61fd5-2f2a-4cd9-a439-00943de4dda6 on hv-cinder-82660 Oct 13 13:12:38.090199 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [req-e440aed9-8b04-405b-8335-67c472cf5ff6 req-7a8f4229-f7ae-446a-adb4-6f0efb27644e service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030053 Oct 13 13:12:38.090782 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 183/391] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 13:12:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 13:12:38.095625 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-b95306a3-d6e9-43f6-9d33-c13d12bc515c tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Calling method '>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:12:38.096318 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-b95306a3-d6e9-43f6-9d33-c13d12bc515c tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] [instance: 59e81a58-9400-4cea-aa38-b24b394e33d7] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:12:38.102546 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-b95306a3-d6e9-43f6-9d33-c13d12bc515c tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:12:38.103184 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-b95306a3-d6e9-43f6-9d33-c13d12bc515c tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:12:38.103543 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-b95306a3-d6e9-43f6-9d33-c13d12bc515c tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:12:38.104417 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-b95306a3-d6e9-43f6-9d33-c13d12bc515c tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:12:38.104886 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-b95306a3-d6e9-43f6-9d33-c13d12bc515c tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:12:38.105320 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-b95306a3-d6e9-43f6-9d33-c13d12bc515c tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:12:38.109474 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG dbcounter [-] [118815] Writing DB stats nova_cell1:SELECT=100 {{(pid=118815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:12:38.247208 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-c3d02327-9b0a-45ba-8baa-a4dae6095073 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '454203f47b434cca952a1cef56de559f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7312d0ac9248f2bfbece5611913ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:12:38.255216 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-c3d02327-9b0a-45ba-8baa-a4dae6095073 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] 10.222.0.23 "GET /compute/v2.1/servers/b4ba0fd3-eb17-4e05-acaa-5570c1e364d7" status: 200 len: 1371 microversion: 2.1 time: 0.214978 Oct 13 13:12:38.255781 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 209/392] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:12:38 2022] GET /compute/v2.1/servers/b4ba0fd3-eb17-4e05-acaa-5570c1e364d7 => generated 1371 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:12:38.267675 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-b95306a3-d6e9-43f6-9d33-c13d12bc515c tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d89667e52b24295ba619203c02c7bd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed5038c799342d48edc980983f1d996', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:12:38.275941 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-b95306a3-d6e9-43f6-9d33-c13d12bc515c tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] 10.222.0.23 "GET /compute/v2.1/servers/59e81a58-9400-4cea-aa38-b24b394e33d7" status: 200 len: 1357 microversion: 2.1 time: 0.184048 Oct 13 13:12:38.276497 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 184/393] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:12:38 2022] GET /compute/v2.1/servers/59e81a58-9400-4cea-aa38-b24b394e33d7 => generated 1357 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:12:39.061773 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-d3a3d505-834b-4917-ae08-4f5f8af9780d tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Calling method '>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:12:39.062374 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-d3a3d505-834b-4917-ae08-4f5f8af9780d tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] [instance: c8c61fd5-2f2a-4cd9-a439-00943de4dda6] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:12:39.069565 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-d3a3d505-834b-4917-ae08-4f5f8af9780d tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:12:39.070048 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-d3a3d505-834b-4917-ae08-4f5f8af9780d tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:12:39.070478 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-d3a3d505-834b-4917-ae08-4f5f8af9780d tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:12:39.071198 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-d3a3d505-834b-4917-ae08-4f5f8af9780d tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:12:39.071644 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-d3a3d505-834b-4917-ae08-4f5f8af9780d tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:12:39.072064 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-d3a3d505-834b-4917-ae08-4f5f8af9780d tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:12:39.085899 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-70a1b111-7198-4288-9b52-cf8189edc8dc tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Calling method '>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:12:39.086573 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-70a1b111-7198-4288-9b52-cf8189edc8dc tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] [instance: 26bd475b-3495-4669-9985-d4a7dedb4bbf] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:12:39.094288 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-70a1b111-7198-4288-9b52-cf8189edc8dc tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:12:39.094786 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-70a1b111-7198-4288-9b52-cf8189edc8dc tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:12:39.095882 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-70a1b111-7198-4288-9b52-cf8189edc8dc tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:12:39.096741 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-70a1b111-7198-4288-9b52-cf8189edc8dc tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:12:39.097229 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-70a1b111-7198-4288-9b52-cf8189edc8dc tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:12:39.097663 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-70a1b111-7198-4288-9b52-cf8189edc8dc tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:12:39.267124 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-d3a3d505-834b-4917-ae08-4f5f8af9780d tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8569afc405f24a0993a023c818a0c272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f85144e13e254365a86aa785093c8575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:12:39.275693 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-d3a3d505-834b-4917-ae08-4f5f8af9780d tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c61fd5-2f2a-4cd9-a439-00943de4dda6" status: 200 len: 1318 microversion: 2.1 time: 0.217695 Oct 13 13:12:39.276599 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 210/394] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:12:39 2022] GET /compute/v2.1/servers/c8c61fd5-2f2a-4cd9-a439-00943de4dda6 => generated 1318 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 13:12:39.278517 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-70a1b111-7198-4288-9b52-cf8189edc8dc tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:12:39.281106 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-0b7234d5-c69a-4fb5-b115-792d1fad10b2 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Calling method '>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:12:39.281793 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-0b7234d5-c69a-4fb5-b115-792d1fad10b2 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] [instance: b4ba0fd3-eb17-4e05-acaa-5570c1e364d7] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:12:39.287469 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-0b7234d5-c69a-4fb5-b115-792d1fad10b2 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:12:39.287888 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-70a1b111-7198-4288-9b52-cf8189edc8dc tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:12:39.288033 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-0b7234d5-c69a-4fb5-b115-792d1fad10b2 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:12:39.288379 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-0b7234d5-c69a-4fb5-b115-792d1fad10b2 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:12:39.289067 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-0b7234d5-c69a-4fb5-b115-792d1fad10b2 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:12:39.289366 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-70a1b111-7198-4288-9b52-cf8189edc8dc tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:12:39.289520 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-0b7234d5-c69a-4fb5-b115-792d1fad10b2 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:12:39.289938 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-0b7234d5-c69a-4fb5-b115-792d1fad10b2 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:12:39.290506 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-70a1b111-7198-4288-9b52-cf8189edc8dc tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] 10.222.0.23 "GET /compute/v2.1/servers/26bd475b-3495-4669-9985-d4a7dedb4bbf" status: 200 len: 1722 microversion: 2.20 time: 0.209232 Oct 13 13:12:39.291497 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 185/395] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 13:12:39 2022] GET /compute/v2.1/servers/26bd475b-3495-4669-9985-d4a7dedb4bbf => generated 1722 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 13 13:12:39.298578 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-0e28d766-54d1-4d0c-b6fe-46d8bc760cc5 tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Calling method '>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:12:39.299337 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-0e28d766-54d1-4d0c-b6fe-46d8bc760cc5 tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] [instance: 59e81a58-9400-4cea-aa38-b24b394e33d7] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:12:39.306074 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-0e28d766-54d1-4d0c-b6fe-46d8bc760cc5 tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:12:39.306666 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-0e28d766-54d1-4d0c-b6fe-46d8bc760cc5 tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:12:39.307242 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-0e28d766-54d1-4d0c-b6fe-46d8bc760cc5 tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:12:39.308073 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-0e28d766-54d1-4d0c-b6fe-46d8bc760cc5 tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:12:39.308621 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-0e28d766-54d1-4d0c-b6fe-46d8bc760cc5 tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:12:39.309142 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-0e28d766-54d1-4d0c-b6fe-46d8bc760cc5 tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:12:39.478477 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-0b7234d5-c69a-4fb5-b115-792d1fad10b2 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '454203f47b434cca952a1cef56de559f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7312d0ac9248f2bfbece5611913ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:12:39.481972 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG dbcounter [-] [118814] Writing DB stats nova_cell1:SELECT=100 {{(pid=118814) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:12:39.487070 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-0b7234d5-c69a-4fb5-b115-792d1fad10b2 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] 10.222.0.23 "GET /compute/v2.1/servers/b4ba0fd3-eb17-4e05-acaa-5570c1e364d7" status: 200 len: 1371 microversion: 2.1 time: 0.209411 Oct 13 13:12:39.487848 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 211/396] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:12:39 2022] GET /compute/v2.1/servers/b4ba0fd3-eb17-4e05-acaa-5570c1e364d7 => generated 1371 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:12:39.489959 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-0e28d766-54d1-4d0c-b6fe-46d8bc760cc5 tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d89667e52b24295ba619203c02c7bd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed5038c799342d48edc980983f1d996', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:12:39.497969 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-0e28d766-54d1-4d0c-b6fe-46d8bc760cc5 tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] 10.222.0.23 "GET /compute/v2.1/servers/59e81a58-9400-4cea-aa38-b24b394e33d7" status: 200 len: 1357 microversion: 2.1 time: 0.204327 Oct 13 13:12:39.498520 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 186/397] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:12:39 2022] GET /compute/v2.1/servers/59e81a58-9400-4cea-aa38-b24b394e33d7 => generated 1357 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 13:12:40.040695 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [req-93adbfa3-ea6e-4360-aa3a-0c1880836efa req-cdf46940-3333-4d54-816d-ca33856b3f9a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "26bd475b-3495-4669-9985-d4a7dedb4bbf", "name": "network-vif-unplugged", "status": "completed", "tag": "bd0eddba-ab0b-4c35-805b-853067734898"}]} {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 13:12:40.051107 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [req-93adbfa3-ea6e-4360-aa3a-0c1880836efa req-cdf46940-3333-4d54-816d-ca33856b3f9a service nova] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:12:40.051704 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [req-93adbfa3-ea6e-4360-aa3a-0c1880836efa req-cdf46940-3333-4d54-816d-ca33856b3f9a service nova] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:12:40.052206 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [req-93adbfa3-ea6e-4360-aa3a-0c1880836efa req-cdf46940-3333-4d54-816d-ca33856b3f9a service nova] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:12:40.063793 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.compute.server_external_events [req-93adbfa3-ea6e-4360-aa3a-0c1880836efa req-cdf46940-3333-4d54-816d-ca33856b3f9a service nova] Creating event network-vif-unplugged:bd0eddba-ab0b-4c35-805b-853067734898 for instance 26bd475b-3495-4669-9985-d4a7dedb4bbf on hv-cinder-82660 Oct 13 13:12:40.069682 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [req-93adbfa3-ea6e-4360-aa3a-0c1880836efa req-cdf46940-3333-4d54-816d-ca33856b3f9a service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032871 Oct 13 13:12:40.070263 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 212/398] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 13:12:40 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 13:12:40.297975 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-1bd1ab5e-5337-4155-b0a7-4221f6d4f368 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Calling method '>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:12:40.298582 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-1bd1ab5e-5337-4155-b0a7-4221f6d4f368 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] [instance: c8c61fd5-2f2a-4cd9-a439-00943de4dda6] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:12:40.305866 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-1bd1ab5e-5337-4155-b0a7-4221f6d4f368 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:12:40.306343 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-1bd1ab5e-5337-4155-b0a7-4221f6d4f368 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:12:40.306775 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-1bd1ab5e-5337-4155-b0a7-4221f6d4f368 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:12:40.307480 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-1bd1ab5e-5337-4155-b0a7-4221f6d4f368 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:12:40.307957 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-1bd1ab5e-5337-4155-b0a7-4221f6d4f368 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:12:40.308375 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-1bd1ab5e-5337-4155-b0a7-4221f6d4f368 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:12:40.318279 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-efbd7df4-0fbb-43fb-b92d-df0398128475 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Calling method '>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:12:40.318987 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-efbd7df4-0fbb-43fb-b92d-df0398128475 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] [instance: 26bd475b-3495-4669-9985-d4a7dedb4bbf] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:12:40.325646 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-efbd7df4-0fbb-43fb-b92d-df0398128475 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:12:40.326122 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-efbd7df4-0fbb-43fb-b92d-df0398128475 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:12:40.326557 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-efbd7df4-0fbb-43fb-b92d-df0398128475 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:12:40.327299 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-efbd7df4-0fbb-43fb-b92d-df0398128475 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:12:40.327746 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-efbd7df4-0fbb-43fb-b92d-df0398128475 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:12:40.328163 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-efbd7df4-0fbb-43fb-b92d-df0398128475 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:12:40.503677 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-1bd1ab5e-5337-4155-b0a7-4221f6d4f368 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8569afc405f24a0993a023c818a0c272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f85144e13e254365a86aa785093c8575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:12:40.516505 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-1bd1ab5e-5337-4155-b0a7-4221f6d4f368 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c61fd5-2f2a-4cd9-a439-00943de4dda6" status: 200 len: 1318 microversion: 2.1 time: 0.221784 Oct 13 13:12:40.520174 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-efbd7df4-0fbb-43fb-b92d-df0398128475 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:12:40.527694 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 187/399] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:12:40 2022] GET /compute/v2.1/servers/c8c61fd5-2f2a-4cd9-a439-00943de4dda6 => generated 1318 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:12:40.532175 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-efbd7df4-0fbb-43fb-b92d-df0398128475 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:12:40.533869 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-efbd7df4-0fbb-43fb-b92d-df0398128475 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:12:40.536077 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-efbd7df4-0fbb-43fb-b92d-df0398128475 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] 10.222.0.23 "GET /compute/v2.1/servers/26bd475b-3495-4669-9985-d4a7dedb4bbf" status: 200 len: 1722 microversion: 2.20 time: 0.221787 Oct 13 13:12:40.536237 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 213/400] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 13:12:40 2022] GET /compute/v2.1/servers/26bd475b-3495-4669-9985-d4a7dedb4bbf => generated 1722 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 13 13:12:40.540702 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-d9adaaa6-afb4-42ff-95bd-427da830bd8a tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Calling method '>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:12:40.541323 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-d9adaaa6-afb4-42ff-95bd-427da830bd8a tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] [instance: b4ba0fd3-eb17-4e05-acaa-5570c1e364d7] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:12:40.547338 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-d9adaaa6-afb4-42ff-95bd-427da830bd8a tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:12:40.547880 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-d9adaaa6-afb4-42ff-95bd-427da830bd8a tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:12:40.548323 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-d9adaaa6-afb4-42ff-95bd-427da830bd8a tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:12:40.549013 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-d9adaaa6-afb4-42ff-95bd-427da830bd8a tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:12:40.549464 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-d9adaaa6-afb4-42ff-95bd-427da830bd8a tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:12:40.549879 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-d9adaaa6-afb4-42ff-95bd-427da830bd8a tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:12:40.552195 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-9a1ecb4a-5a56-4c81-98b1-50a805f002c9 tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Calling method '>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:12:40.552862 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-9a1ecb4a-5a56-4c81-98b1-50a805f002c9 tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] [instance: 59e81a58-9400-4cea-aa38-b24b394e33d7] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:12:40.560209 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-9a1ecb4a-5a56-4c81-98b1-50a805f002c9 tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:12:40.560909 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-9a1ecb4a-5a56-4c81-98b1-50a805f002c9 tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:12:40.561528 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-9a1ecb4a-5a56-4c81-98b1-50a805f002c9 tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:12:40.562412 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-9a1ecb4a-5a56-4c81-98b1-50a805f002c9 tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:12:40.563727 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-9a1ecb4a-5a56-4c81-98b1-50a805f002c9 tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:12:40.564642 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-9a1ecb4a-5a56-4c81-98b1-50a805f002c9 tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:12:40.778002 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-d9adaaa6-afb4-42ff-95bd-427da830bd8a tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '454203f47b434cca952a1cef56de559f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7312d0ac9248f2bfbece5611913ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:12:40.782071 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-9a1ecb4a-5a56-4c81-98b1-50a805f002c9 tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d89667e52b24295ba619203c02c7bd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed5038c799342d48edc980983f1d996', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:12:40.785757 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-d9adaaa6-afb4-42ff-95bd-427da830bd8a tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] 10.222.0.23 "GET /compute/v2.1/servers/b4ba0fd3-eb17-4e05-acaa-5570c1e364d7" status: 200 len: 1371 microversion: 2.1 time: 0.256985 Oct 13 13:12:40.786313 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 188/401] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:12:40 2022] GET /compute/v2.1/servers/b4ba0fd3-eb17-4e05-acaa-5570c1e364d7 => generated 1371 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:12:40.789880 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-9a1ecb4a-5a56-4c81-98b1-50a805f002c9 tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] 10.222.0.23 "GET /compute/v2.1/servers/59e81a58-9400-4cea-aa38-b24b394e33d7" status: 200 len: 1357 microversion: 2.1 time: 0.249423 Oct 13 13:12:40.790441 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 214/402] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:12:40 2022] GET /compute/v2.1/servers/59e81a58-9400-4cea-aa38-b24b394e33d7 => generated 1357 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:12:41.540924 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-0c06aa54-7fc8-4fba-9835-f1d49a2debd4 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Calling method '>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:12:41.541529 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-0c06aa54-7fc8-4fba-9835-f1d49a2debd4 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] [instance: c8c61fd5-2f2a-4cd9-a439-00943de4dda6] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:12:41.547990 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-0c06aa54-7fc8-4fba-9835-f1d49a2debd4 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:12:41.548472 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-0c06aa54-7fc8-4fba-9835-f1d49a2debd4 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:12:41.548905 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-0c06aa54-7fc8-4fba-9835-f1d49a2debd4 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:12:41.549578 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-0c06aa54-7fc8-4fba-9835-f1d49a2debd4 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:12:41.550533 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-0c06aa54-7fc8-4fba-9835-f1d49a2debd4 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:12:41.551242 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-0c06aa54-7fc8-4fba-9835-f1d49a2debd4 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:12:41.569723 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-be5de8ee-eacc-4eca-b74e-ba59242a8a33 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Calling method '>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:12:41.570995 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-be5de8ee-eacc-4eca-b74e-ba59242a8a33 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] [instance: 26bd475b-3495-4669-9985-d4a7dedb4bbf] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:12:41.581437 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-be5de8ee-eacc-4eca-b74e-ba59242a8a33 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:12:41.582505 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-be5de8ee-eacc-4eca-b74e-ba59242a8a33 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:12:41.582951 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-be5de8ee-eacc-4eca-b74e-ba59242a8a33 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:12:41.583691 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-be5de8ee-eacc-4eca-b74e-ba59242a8a33 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:12:41.584124 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-be5de8ee-eacc-4eca-b74e-ba59242a8a33 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:12:41.584744 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-be5de8ee-eacc-4eca-b74e-ba59242a8a33 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:12:41.774751 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-0c06aa54-7fc8-4fba-9835-f1d49a2debd4 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8569afc405f24a0993a023c818a0c272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f85144e13e254365a86aa785093c8575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:12:41.785976 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-0c06aa54-7fc8-4fba-9835-f1d49a2debd4 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c61fd5-2f2a-4cd9-a439-00943de4dda6" status: 200 len: 1318 microversion: 2.1 time: 0.248636 Oct 13 13:12:41.787803 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-be5de8ee-eacc-4eca-b74e-ba59242a8a33 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:12:41.792631 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 189/403] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:12:41 2022] GET /compute/v2.1/servers/c8c61fd5-2f2a-4cd9-a439-00943de4dda6 => generated 1318 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:12:41.798684 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-be5de8ee-eacc-4eca-b74e-ba59242a8a33 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:12:41.801391 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-be5de8ee-eacc-4eca-b74e-ba59242a8a33 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:12:41.802793 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-be5de8ee-eacc-4eca-b74e-ba59242a8a33 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] 10.222.0.23 "GET /compute/v2.1/servers/26bd475b-3495-4669-9985-d4a7dedb4bbf" status: 200 len: 1725 microversion: 2.20 time: 0.238523 Oct 13 13:12:41.808463 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-47c2e582-f0a5-47a6-a9d2-fae6039b4948 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Calling method '>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:12:41.808739 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 215/404] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 13:12:41 2022] GET /compute/v2.1/servers/26bd475b-3495-4669-9985-d4a7dedb4bbf => generated 1725 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 13:12:41.809136 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-47c2e582-f0a5-47a6-a9d2-fae6039b4948 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] [instance: b4ba0fd3-eb17-4e05-acaa-5570c1e364d7] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:12:41.815323 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-47c2e582-f0a5-47a6-a9d2-fae6039b4948 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:12:41.815840 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-47c2e582-f0a5-47a6-a9d2-fae6039b4948 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:12:41.816466 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-47c2e582-f0a5-47a6-a9d2-fae6039b4948 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:12:41.817161 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-47c2e582-f0a5-47a6-a9d2-fae6039b4948 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:12:41.817615 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-47c2e582-f0a5-47a6-a9d2-fae6039b4948 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:12:41.818041 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-47c2e582-f0a5-47a6-a9d2-fae6039b4948 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:12:41.828412 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-17115011-9b9b-42e2-8b53-e975b98bd711 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ff067956-f298-4976-ae50-a3a9f77d18f4"}} {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 13:12:41.831860 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-17115011-9b9b-42e2-8b53-e975b98bd711 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] [instance: 26bd475b-3495-4669-9985-d4a7dedb4bbf] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:12:41.838615 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-17115011-9b9b-42e2-8b53-e975b98bd711 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:12:41.839124 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-17115011-9b9b-42e2-8b53-e975b98bd711 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:12:41.839560 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-17115011-9b9b-42e2-8b53-e975b98bd711 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:12:41.840303 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-17115011-9b9b-42e2-8b53-e975b98bd711 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:12:41.840795 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-17115011-9b9b-42e2-8b53-e975b98bd711 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:12:41.841290 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-17115011-9b9b-42e2-8b53-e975b98bd711 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:12:41.962529 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-47c2e582-f0a5-47a6-a9d2-fae6039b4948 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '454203f47b434cca952a1cef56de559f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7312d0ac9248f2bfbece5611913ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:12:41.970545 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-47c2e582-f0a5-47a6-a9d2-fae6039b4948 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] 10.222.0.23 "GET /compute/v2.1/servers/b4ba0fd3-eb17-4e05-acaa-5570c1e364d7" status: 200 len: 1371 microversion: 2.1 time: 0.166118 Oct 13 13:12:41.983505 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 190/405] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:12:41 2022] GET /compute/v2.1/servers/b4ba0fd3-eb17-4e05-acaa-5570c1e364d7 => generated 1371 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 13:12:41.992574 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-edcbfb2e-12be-471d-b9c4-0519c23882c3 tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Calling method '>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:12:41.993349 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-edcbfb2e-12be-471d-b9c4-0519c23882c3 tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] [instance: 59e81a58-9400-4cea-aa38-b24b394e33d7] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:12:41.999699 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-edcbfb2e-12be-471d-b9c4-0519c23882c3 tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:12:42.000305 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-edcbfb2e-12be-471d-b9c4-0519c23882c3 tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:12:42.000850 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-edcbfb2e-12be-471d-b9c4-0519c23882c3 tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:12:42.001640 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-edcbfb2e-12be-471d-b9c4-0519c23882c3 tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:12:42.002213 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-edcbfb2e-12be-471d-b9c4-0519c23882c3 tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:12:42.002738 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-edcbfb2e-12be-471d-b9c4-0519c23882c3 tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:12:42.149575 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-edcbfb2e-12be-471d-b9c4-0519c23882c3 tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d89667e52b24295ba619203c02c7bd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed5038c799342d48edc980983f1d996', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:12:42.162862 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-edcbfb2e-12be-471d-b9c4-0519c23882c3 tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] 10.222.0.23 "GET /compute/v2.1/servers/59e81a58-9400-4cea-aa38-b24b394e33d7" status: 200 len: 1357 microversion: 2.1 time: 0.178154 Oct 13 13:12:42.163701 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 191/406] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:12:41 2022] GET /compute/v2.1/servers/59e81a58-9400-4cea-aa38-b24b394e33d7 => generated 1357 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:12:42.177118 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-17115011-9b9b-42e2-8b53-e975b98bd711 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] 10.222.0.23 "POST /compute/v2.1/servers/26bd475b-3495-4669-9985-d4a7dedb4bbf/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.352407 Oct 13 13:12:42.178954 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 216/407] 10.222.0.23 () {62 vars in 1364 bytes} [Thu Oct 13 13:12:41 2022] POST /compute/v2.1/servers/26bd475b-3495-4669-9985-d4a7dedb4bbf/os-volume_attachments => generated 188 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 13 13:12:42.185852 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [req-afaa928c-9668-4f48-938a-c65b887e2c03 req-d1e603d7-85ba-45b6-a205-3a0bbf512217 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b4ba0fd3-eb17-4e05-acaa-5570c1e364d7", "name": "network-vif-plugged", "status": "completed", "tag": "feb1b7b8-f5e8-4310-8e6d-7eb1841b5c04"}]} {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 13:12:42.192339 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG dbcounter [-] [118815] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=118815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:12:42.196672 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [req-afaa928c-9668-4f48-938a-c65b887e2c03 req-d1e603d7-85ba-45b6-a205-3a0bbf512217 service nova] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:12:42.197329 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [req-afaa928c-9668-4f48-938a-c65b887e2c03 req-d1e603d7-85ba-45b6-a205-3a0bbf512217 service nova] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:12:42.197948 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [req-afaa928c-9668-4f48-938a-c65b887e2c03 req-d1e603d7-85ba-45b6-a205-3a0bbf512217 service nova] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:12:42.211706 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.compute.server_external_events [req-afaa928c-9668-4f48-938a-c65b887e2c03 req-d1e603d7-85ba-45b6-a205-3a0bbf512217 service nova] Creating event network-vif-plugged:feb1b7b8-f5e8-4310-8e6d-7eb1841b5c04 for instance b4ba0fd3-eb17-4e05-acaa-5570c1e364d7 on hv-cinder-82660 Oct 13 13:12:42.217122 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [req-afaa928c-9668-4f48-938a-c65b887e2c03 req-d1e603d7-85ba-45b6-a205-3a0bbf512217 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039518 Oct 13 13:12:42.218042 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 192/408] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 13:12:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 13:12:42.308370 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-63007fe4-118c-42de-80f2-6108096828f8 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 13:12:42.308957 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-63007fe4-118c-42de-80f2-6108096828f8 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] [instance: 26bd475b-3495-4669-9985-d4a7dedb4bbf] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:12:42.315661 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-63007fe4-118c-42de-80f2-6108096828f8 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:12:42.316139 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-63007fe4-118c-42de-80f2-6108096828f8 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:12:42.316569 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-63007fe4-118c-42de-80f2-6108096828f8 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:12:42.317249 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-63007fe4-118c-42de-80f2-6108096828f8 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:12:42.317693 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-63007fe4-118c-42de-80f2-6108096828f8 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:12:42.318114 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-63007fe4-118c-42de-80f2-6108096828f8 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:12:42.359971 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-63007fe4-118c-42de-80f2-6108096828f8 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] [instance: 26bd475b-3495-4669-9985-d4a7dedb4bbf] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=118814) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 13 13:12:42.426991 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-63007fe4-118c-42de-80f2-6108096828f8 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] 10.222.0.23 "POST /compute/v2.1/servers/26bd475b-3495-4669-9985-d4a7dedb4bbf/action" status: 202 len: 0 microversion: 2.20 time: 0.122434 Oct 13 13:12:42.427654 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 217/409] 10.222.0.23 () {62 vars in 1319 bytes} [Thu Oct 13 13:12:42 2022] POST /compute/v2.1/servers/26bd475b-3495-4669-9985-d4a7dedb4bbf/action => generated 0 bytes in 124 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 13 13:12:42.436180 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-f658cabb-4f4a-476c-9934-ec860b6e36cc tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Calling method '>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:12:42.436881 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-f658cabb-4f4a-476c-9934-ec860b6e36cc tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] [instance: 26bd475b-3495-4669-9985-d4a7dedb4bbf] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:12:42.442942 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-f658cabb-4f4a-476c-9934-ec860b6e36cc tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:12:42.443413 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-f658cabb-4f4a-476c-9934-ec860b6e36cc tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:12:42.443858 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-f658cabb-4f4a-476c-9934-ec860b6e36cc tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:12:42.444556 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-f658cabb-4f4a-476c-9934-ec860b6e36cc tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:12:42.445014 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-f658cabb-4f4a-476c-9934-ec860b6e36cc tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:12:42.445439 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-f658cabb-4f4a-476c-9934-ec860b6e36cc tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:12:42.580037 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-f658cabb-4f4a-476c-9934-ec860b6e36cc tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:12:42.589594 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-f658cabb-4f4a-476c-9934-ec860b6e36cc tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:12:42.591031 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-f658cabb-4f4a-476c-9934-ec860b6e36cc tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:12:42.592196 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-f658cabb-4f4a-476c-9934-ec860b6e36cc tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] 10.222.0.23 "GET /compute/v2.1/servers/26bd475b-3495-4669-9985-d4a7dedb4bbf" status: 200 len: 1811 microversion: 2.20 time: 0.160222 Oct 13 13:12:42.592730 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 193/410] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 13:12:42 2022] GET /compute/v2.1/servers/26bd475b-3495-4669-9985-d4a7dedb4bbf => generated 1811 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 13:12:42.811289 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-e44b71f1-c7df-4e09-a3a3-eacd30e0c19e tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Calling method '>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:12:42.811905 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-e44b71f1-c7df-4e09-a3a3-eacd30e0c19e tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] [instance: c8c61fd5-2f2a-4cd9-a439-00943de4dda6] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:12:42.818434 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-e44b71f1-c7df-4e09-a3a3-eacd30e0c19e tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:12:42.818917 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-e44b71f1-c7df-4e09-a3a3-eacd30e0c19e tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:12:42.819377 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-e44b71f1-c7df-4e09-a3a3-eacd30e0c19e tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:12:42.820059 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-e44b71f1-c7df-4e09-a3a3-eacd30e0c19e tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:12:42.820536 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-e44b71f1-c7df-4e09-a3a3-eacd30e0c19e tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:12:42.822081 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-e44b71f1-c7df-4e09-a3a3-eacd30e0c19e tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:12:42.983492 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-e44b71f1-c7df-4e09-a3a3-eacd30e0c19e tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8569afc405f24a0993a023c818a0c272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f85144e13e254365a86aa785093c8575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:12:42.995734 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-e44b71f1-c7df-4e09-a3a3-eacd30e0c19e tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c61fd5-2f2a-4cd9-a439-00943de4dda6" status: 200 len: 1318 microversion: 2.1 time: 0.188685 Oct 13 13:12:42.996324 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 218/411] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:12:42 2022] GET /compute/v2.1/servers/c8c61fd5-2f2a-4cd9-a439-00943de4dda6 => generated 1318 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:12:42.998825 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-990b65a1-8470-4927-b686-6ffa7f7d8a8a tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Calling method '>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:12:42.999463 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-990b65a1-8470-4927-b686-6ffa7f7d8a8a tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] [instance: b4ba0fd3-eb17-4e05-acaa-5570c1e364d7] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:12:43.010598 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-990b65a1-8470-4927-b686-6ffa7f7d8a8a tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:12:43.011698 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-990b65a1-8470-4927-b686-6ffa7f7d8a8a tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:12:43.013554 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-990b65a1-8470-4927-b686-6ffa7f7d8a8a tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:12:43.015143 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-990b65a1-8470-4927-b686-6ffa7f7d8a8a tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:12:43.017093 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-990b65a1-8470-4927-b686-6ffa7f7d8a8a tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:12:43.019201 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-990b65a1-8470-4927-b686-6ffa7f7d8a8a tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:12:43.158044 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-990b65a1-8470-4927-b686-6ffa7f7d8a8a tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '454203f47b434cca952a1cef56de559f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7312d0ac9248f2bfbece5611913ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:12:43.165987 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-990b65a1-8470-4927-b686-6ffa7f7d8a8a tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] 10.222.0.23 "GET /compute/v2.1/servers/b4ba0fd3-eb17-4e05-acaa-5570c1e364d7" status: 200 len: 1371 microversion: 2.1 time: 0.171974 Oct 13 13:12:43.166688 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 194/412] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:12:42 2022] GET /compute/v2.1/servers/b4ba0fd3-eb17-4e05-acaa-5570c1e364d7 => generated 1371 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 13:12:43.188722 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-d6343cd7-3536-49a9-85e6-c73c74077447 tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Calling method '>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:12:43.189665 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-d6343cd7-3536-49a9-85e6-c73c74077447 tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] [instance: 59e81a58-9400-4cea-aa38-b24b394e33d7] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:12:43.197012 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-d6343cd7-3536-49a9-85e6-c73c74077447 tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:12:43.197442 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-d6343cd7-3536-49a9-85e6-c73c74077447 tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:12:43.197911 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-d6343cd7-3536-49a9-85e6-c73c74077447 tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:12:43.198610 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-d6343cd7-3536-49a9-85e6-c73c74077447 tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:12:43.199126 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-d6343cd7-3536-49a9-85e6-c73c74077447 tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:12:43.199577 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-d6343cd7-3536-49a9-85e6-c73c74077447 tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:12:43.327854 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-d6343cd7-3536-49a9-85e6-c73c74077447 tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d89667e52b24295ba619203c02c7bd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed5038c799342d48edc980983f1d996', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:12:43.337262 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-d6343cd7-3536-49a9-85e6-c73c74077447 tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] 10.222.0.23 "GET /compute/v2.1/servers/59e81a58-9400-4cea-aa38-b24b394e33d7" status: 200 len: 1357 microversion: 2.1 time: 0.152363 Oct 13 13:12:43.337947 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 219/413] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:12:43 2022] GET /compute/v2.1/servers/59e81a58-9400-4cea-aa38-b24b394e33d7 => generated 1357 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:12:43.617781 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-9fb2c338-a710-488d-a2e5-c97a0a50f00b tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Calling method '>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:12:43.618387 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-9fb2c338-a710-488d-a2e5-c97a0a50f00b tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] [instance: 26bd475b-3495-4669-9985-d4a7dedb4bbf] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:12:43.624660 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-9fb2c338-a710-488d-a2e5-c97a0a50f00b tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:12:43.625142 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-9fb2c338-a710-488d-a2e5-c97a0a50f00b tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:12:43.625575 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-9fb2c338-a710-488d-a2e5-c97a0a50f00b tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:12:43.626259 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-9fb2c338-a710-488d-a2e5-c97a0a50f00b tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:12:43.626713 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-9fb2c338-a710-488d-a2e5-c97a0a50f00b tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:12:43.627231 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-9fb2c338-a710-488d-a2e5-c97a0a50f00b tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:12:43.759343 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-9fb2c338-a710-488d-a2e5-c97a0a50f00b tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:12:43.768006 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-9fb2c338-a710-488d-a2e5-c97a0a50f00b tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:12:43.769452 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-9fb2c338-a710-488d-a2e5-c97a0a50f00b tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:12:43.770603 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-9fb2c338-a710-488d-a2e5-c97a0a50f00b tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] 10.222.0.23 "GET /compute/v2.1/servers/26bd475b-3495-4669-9985-d4a7dedb4bbf" status: 200 len: 1753 microversion: 2.20 time: 0.156619 Oct 13 13:12:43.771172 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 195/414] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 13:12:43 2022] GET /compute/v2.1/servers/26bd475b-3495-4669-9985-d4a7dedb4bbf => generated 1753 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 13:12:44.019551 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-86d59bf9-5e9d-413a-8046-d59f61cd32a1 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Calling method '>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:12:44.020238 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-86d59bf9-5e9d-413a-8046-d59f61cd32a1 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] [instance: c8c61fd5-2f2a-4cd9-a439-00943de4dda6] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:12:44.026644 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-86d59bf9-5e9d-413a-8046-d59f61cd32a1 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:12:44.027161 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-86d59bf9-5e9d-413a-8046-d59f61cd32a1 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:12:44.027599 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-86d59bf9-5e9d-413a-8046-d59f61cd32a1 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:12:44.028302 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-86d59bf9-5e9d-413a-8046-d59f61cd32a1 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:12:44.028744 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-86d59bf9-5e9d-413a-8046-d59f61cd32a1 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:12:44.029158 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-86d59bf9-5e9d-413a-8046-d59f61cd32a1 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:12:44.162637 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-86d59bf9-5e9d-413a-8046-d59f61cd32a1 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8569afc405f24a0993a023c818a0c272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f85144e13e254365a86aa785093c8575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:12:44.170334 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-86d59bf9-5e9d-413a-8046-d59f61cd32a1 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c61fd5-2f2a-4cd9-a439-00943de4dda6" status: 200 len: 1318 microversion: 2.1 time: 0.154685 Oct 13 13:12:44.170898 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 220/415] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:12:44 2022] GET /compute/v2.1/servers/c8c61fd5-2f2a-4cd9-a439-00943de4dda6 => generated 1318 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:12:44.189857 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-f92c4f8f-fa88-47ee-b698-4ad5dd6909d4 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Calling method '>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:12:44.190523 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-f92c4f8f-fa88-47ee-b698-4ad5dd6909d4 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] [instance: b4ba0fd3-eb17-4e05-acaa-5570c1e364d7] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:12:44.196487 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-f92c4f8f-fa88-47ee-b698-4ad5dd6909d4 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:12:44.196969 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-f92c4f8f-fa88-47ee-b698-4ad5dd6909d4 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:12:44.197408 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-f92c4f8f-fa88-47ee-b698-4ad5dd6909d4 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:12:44.198110 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-f92c4f8f-fa88-47ee-b698-4ad5dd6909d4 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:12:44.198566 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-f92c4f8f-fa88-47ee-b698-4ad5dd6909d4 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:12:44.198988 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-f92c4f8f-fa88-47ee-b698-4ad5dd6909d4 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:12:44.336252 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-f92c4f8f-fa88-47ee-b698-4ad5dd6909d4 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '454203f47b434cca952a1cef56de559f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7312d0ac9248f2bfbece5611913ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:12:44.343959 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-f92c4f8f-fa88-47ee-b698-4ad5dd6909d4 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] 10.222.0.23 "GET /compute/v2.1/servers/b4ba0fd3-eb17-4e05-acaa-5570c1e364d7" status: 200 len: 1371 microversion: 2.1 time: 0.157969 Oct 13 13:12:44.344594 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 196/416] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:12:44 2022] GET /compute/v2.1/servers/b4ba0fd3-eb17-4e05-acaa-5570c1e364d7 => generated 1371 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:12:44.360675 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-e5d4e9e2-c234-41cf-b289-df434d7c60d7 tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Calling method '>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:12:44.361218 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-e5d4e9e2-c234-41cf-b289-df434d7c60d7 tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] [instance: 59e81a58-9400-4cea-aa38-b24b394e33d7] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:12:44.367667 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-e5d4e9e2-c234-41cf-b289-df434d7c60d7 tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:12:44.368150 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-e5d4e9e2-c234-41cf-b289-df434d7c60d7 tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:12:44.368577 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-e5d4e9e2-c234-41cf-b289-df434d7c60d7 tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:12:44.369274 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-e5d4e9e2-c234-41cf-b289-df434d7c60d7 tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:12:44.369698 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-e5d4e9e2-c234-41cf-b289-df434d7c60d7 tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:12:44.370116 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-e5d4e9e2-c234-41cf-b289-df434d7c60d7 tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:12:44.495961 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-e5d4e9e2-c234-41cf-b289-df434d7c60d7 tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d89667e52b24295ba619203c02c7bd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed5038c799342d48edc980983f1d996', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:12:44.503909 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-e5d4e9e2-c234-41cf-b289-df434d7c60d7 tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] 10.222.0.23 "GET /compute/v2.1/servers/59e81a58-9400-4cea-aa38-b24b394e33d7" status: 200 len: 1357 microversion: 2.1 time: 0.147189 Oct 13 13:12:44.504468 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 221/417] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:12:44 2022] GET /compute/v2.1/servers/59e81a58-9400-4cea-aa38-b24b394e33d7 => generated 1357 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:12:44.795298 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-509827ca-7167-4ce7-aed2-d9e25acb19b0 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Calling method '>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:12:44.795877 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-509827ca-7167-4ce7-aed2-d9e25acb19b0 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] [instance: 26bd475b-3495-4669-9985-d4a7dedb4bbf] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:12:44.805340 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-509827ca-7167-4ce7-aed2-d9e25acb19b0 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:12:44.805830 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-509827ca-7167-4ce7-aed2-d9e25acb19b0 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:12:44.806261 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-509827ca-7167-4ce7-aed2-d9e25acb19b0 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:12:44.806948 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-509827ca-7167-4ce7-aed2-d9e25acb19b0 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:12:44.807435 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-509827ca-7167-4ce7-aed2-d9e25acb19b0 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:12:44.807847 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-509827ca-7167-4ce7-aed2-d9e25acb19b0 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:12:44.993985 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-509827ca-7167-4ce7-aed2-d9e25acb19b0 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:12:45.006856 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-509827ca-7167-4ce7-aed2-d9e25acb19b0 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:12:45.008892 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-509827ca-7167-4ce7-aed2-d9e25acb19b0 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:12:45.010286 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-509827ca-7167-4ce7-aed2-d9e25acb19b0 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] 10.222.0.23 "GET /compute/v2.1/servers/26bd475b-3495-4669-9985-d4a7dedb4bbf" status: 200 len: 1753 microversion: 2.20 time: 0.218801 Oct 13 13:12:45.010841 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 197/418] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 13:12:44 2022] GET /compute/v2.1/servers/26bd475b-3495-4669-9985-d4a7dedb4bbf => generated 1753 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 13:12:45.194120 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-30d4ceec-5713-4a66-932c-943bbb9c6163 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Calling method '>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:12:45.194881 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-30d4ceec-5713-4a66-932c-943bbb9c6163 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] [instance: c8c61fd5-2f2a-4cd9-a439-00943de4dda6] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:12:45.201569 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-30d4ceec-5713-4a66-932c-943bbb9c6163 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:12:45.202059 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-30d4ceec-5713-4a66-932c-943bbb9c6163 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:12:45.202500 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-30d4ceec-5713-4a66-932c-943bbb9c6163 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:12:45.203229 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-30d4ceec-5713-4a66-932c-943bbb9c6163 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:12:45.203680 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-30d4ceec-5713-4a66-932c-943bbb9c6163 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:12:45.204235 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-30d4ceec-5713-4a66-932c-943bbb9c6163 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:12:45.332530 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-30d4ceec-5713-4a66-932c-943bbb9c6163 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8569afc405f24a0993a023c818a0c272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f85144e13e254365a86aa785093c8575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:12:45.340166 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-30d4ceec-5713-4a66-932c-943bbb9c6163 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c61fd5-2f2a-4cd9-a439-00943de4dda6" status: 200 len: 1318 microversion: 2.1 time: 0.150537 Oct 13 13:12:45.340721 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 222/419] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:12:45 2022] GET /compute/v2.1/servers/c8c61fd5-2f2a-4cd9-a439-00943de4dda6 => generated 1318 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:12:45.367572 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-7b37b82f-b492-492f-8667-b202ded57e08 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Calling method '>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:12:45.368173 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-7b37b82f-b492-492f-8667-b202ded57e08 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] [instance: b4ba0fd3-eb17-4e05-acaa-5570c1e364d7] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:12:45.373949 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-7b37b82f-b492-492f-8667-b202ded57e08 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:12:45.374431 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-7b37b82f-b492-492f-8667-b202ded57e08 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:12:45.374864 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-7b37b82f-b492-492f-8667-b202ded57e08 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:12:45.375571 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-7b37b82f-b492-492f-8667-b202ded57e08 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:12:45.376021 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-7b37b82f-b492-492f-8667-b202ded57e08 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:12:45.376434 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-7b37b82f-b492-492f-8667-b202ded57e08 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:12:45.500649 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-7b37b82f-b492-492f-8667-b202ded57e08 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '454203f47b434cca952a1cef56de559f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7312d0ac9248f2bfbece5611913ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:12:45.508889 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-7b37b82f-b492-492f-8667-b202ded57e08 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] 10.222.0.23 "GET /compute/v2.1/servers/b4ba0fd3-eb17-4e05-acaa-5570c1e364d7" status: 200 len: 1566 microversion: 2.1 time: 0.145065 Oct 13 13:12:45.509445 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 198/420] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:12:45 2022] GET /compute/v2.1/servers/b4ba0fd3-eb17-4e05-acaa-5570c1e364d7 => generated 1566 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:12:45.526826 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-a20f5d10-2e63-41d4-b39e-15c2f3807f8b tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Calling method '>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:12:45.527583 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-a20f5d10-2e63-41d4-b39e-15c2f3807f8b tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] [instance: 59e81a58-9400-4cea-aa38-b24b394e33d7] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:12:45.530456 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-c01c6dc5-04a9-470c-9b2e-1800b150b5c8 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Calling method '>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:12:45.530942 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-c01c6dc5-04a9-470c-9b2e-1800b150b5c8 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] [instance: b4ba0fd3-eb17-4e05-acaa-5570c1e364d7] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:12:45.533707 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-a20f5d10-2e63-41d4-b39e-15c2f3807f8b tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:12:45.534707 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-a20f5d10-2e63-41d4-b39e-15c2f3807f8b tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:12:45.535187 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-a20f5d10-2e63-41d4-b39e-15c2f3807f8b tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:12:45.535891 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-a20f5d10-2e63-41d4-b39e-15c2f3807f8b tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:12:45.536343 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-a20f5d10-2e63-41d4-b39e-15c2f3807f8b tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:12:45.536769 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-a20f5d10-2e63-41d4-b39e-15c2f3807f8b tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:12:45.537656 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-c01c6dc5-04a9-470c-9b2e-1800b150b5c8 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:12:45.538198 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-c01c6dc5-04a9-470c-9b2e-1800b150b5c8 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:12:45.538693 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-c01c6dc5-04a9-470c-9b2e-1800b150b5c8 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:12:45.539410 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-c01c6dc5-04a9-470c-9b2e-1800b150b5c8 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:12:45.539858 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-c01c6dc5-04a9-470c-9b2e-1800b150b5c8 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:12:45.540275 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-c01c6dc5-04a9-470c-9b2e-1800b150b5c8 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:12:45.650396 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-c01c6dc5-04a9-470c-9b2e-1800b150b5c8 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] 10.222.0.23 "GET /compute/v2.1/servers/b4ba0fd3-eb17-4e05-acaa-5570c1e364d7/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.123502 Oct 13 13:12:45.651076 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 199/421] 10.222.0.23 () {58 vars in 1275 bytes} [Thu Oct 13 13:12:45 2022] GET /compute/v2.1/servers/b4ba0fd3-eb17-4e05-acaa-5570c1e364d7/os-interface => generated 285 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 13 13:12:45.711462 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-a20f5d10-2e63-41d4-b39e-15c2f3807f8b tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d89667e52b24295ba619203c02c7bd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed5038c799342d48edc980983f1d996', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:12:45.719099 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-a20f5d10-2e63-41d4-b39e-15c2f3807f8b tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] 10.222.0.23 "GET /compute/v2.1/servers/59e81a58-9400-4cea-aa38-b24b394e33d7" status: 200 len: 1357 microversion: 2.1 time: 0.196054 Oct 13 13:12:45.719668 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 223/422] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:12:45 2022] GET /compute/v2.1/servers/59e81a58-9400-4cea-aa38-b24b394e33d7 => generated 1357 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 13:12:46.038684 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-7c20c955-223e-4314-9d3e-64eccac532fa tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Calling method '>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:12:46.039354 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-7c20c955-223e-4314-9d3e-64eccac532fa tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] [instance: 26bd475b-3495-4669-9985-d4a7dedb4bbf] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:12:46.045219 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-7c20c955-223e-4314-9d3e-64eccac532fa tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:12:46.045703 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-7c20c955-223e-4314-9d3e-64eccac532fa tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:12:46.046139 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-7c20c955-223e-4314-9d3e-64eccac532fa tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:12:46.046819 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-7c20c955-223e-4314-9d3e-64eccac532fa tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:12:46.047298 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-7c20c955-223e-4314-9d3e-64eccac532fa tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:12:46.047718 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-7c20c955-223e-4314-9d3e-64eccac532fa tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:12:46.181274 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-7c20c955-223e-4314-9d3e-64eccac532fa tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:12:46.189966 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-7c20c955-223e-4314-9d3e-64eccac532fa tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:12:46.191527 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-7c20c955-223e-4314-9d3e-64eccac532fa tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:12:46.192686 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-7c20c955-223e-4314-9d3e-64eccac532fa tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] 10.222.0.23 "GET /compute/v2.1/servers/26bd475b-3495-4669-9985-d4a7dedb4bbf" status: 200 len: 1809 microversion: 2.20 time: 0.158883 Oct 13 13:12:46.193229 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 200/423] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 13:12:46 2022] GET /compute/v2.1/servers/26bd475b-3495-4669-9985-d4a7dedb4bbf => generated 1809 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 13:12:46.361662 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-04ddf7bb-6de8-4b9d-a50f-91997de061c1 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Calling method '>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:12:46.362270 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-04ddf7bb-6de8-4b9d-a50f-91997de061c1 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] [instance: c8c61fd5-2f2a-4cd9-a439-00943de4dda6] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:12:46.375678 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-04ddf7bb-6de8-4b9d-a50f-91997de061c1 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:12:46.376166 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-04ddf7bb-6de8-4b9d-a50f-91997de061c1 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:12:46.376588 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-04ddf7bb-6de8-4b9d-a50f-91997de061c1 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:12:46.377347 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-04ddf7bb-6de8-4b9d-a50f-91997de061c1 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:12:46.377795 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-04ddf7bb-6de8-4b9d-a50f-91997de061c1 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:12:46.378712 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-04ddf7bb-6de8-4b9d-a50f-91997de061c1 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:12:46.395292 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [req-e63ef027-0280-4fa9-91cc-55c36f191da4 req-c35748a2-5bad-4365-9655-a237bfc104b9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "59e81a58-9400-4cea-aa38-b24b394e33d7", "name": "network-vif-plugged", "status": "completed", "tag": "5e82a763-989b-4ba3-b2d2-7ad17b260a77"}]} {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 13:12:46.411266 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [req-e63ef027-0280-4fa9-91cc-55c36f191da4 req-c35748a2-5bad-4365-9655-a237bfc104b9 service nova] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:12:46.411749 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [req-e63ef027-0280-4fa9-91cc-55c36f191da4 req-c35748a2-5bad-4365-9655-a237bfc104b9 service nova] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:12:46.412178 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [req-e63ef027-0280-4fa9-91cc-55c36f191da4 req-c35748a2-5bad-4365-9655-a237bfc104b9 service nova] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:12:46.427289 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.compute.server_external_events [req-e63ef027-0280-4fa9-91cc-55c36f191da4 req-c35748a2-5bad-4365-9655-a237bfc104b9 service nova] Creating event network-vif-plugged:5e82a763-989b-4ba3-b2d2-7ad17b260a77 for instance 59e81a58-9400-4cea-aa38-b24b394e33d7 on hv-cinder-82660 Oct 13 13:12:46.441672 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [req-e63ef027-0280-4fa9-91cc-55c36f191da4 req-c35748a2-5bad-4365-9655-a237bfc104b9 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049744 Oct 13 13:12:46.444207 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 201/424] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 13:12:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 13 13:12:46.604108 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-04ddf7bb-6de8-4b9d-a50f-91997de061c1 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8569afc405f24a0993a023c818a0c272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f85144e13e254365a86aa785093c8575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:12:46.614692 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-04ddf7bb-6de8-4b9d-a50f-91997de061c1 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c61fd5-2f2a-4cd9-a439-00943de4dda6" status: 200 len: 1318 microversion: 2.1 time: 0.256267 Oct 13 13:12:46.615344 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 224/425] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:12:46 2022] GET /compute/v2.1/servers/c8c61fd5-2f2a-4cd9-a439-00943de4dda6 => generated 1318 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:12:46.744266 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-fb80fd85-a316-4ba2-ac95-c12f53501eb3 tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Calling method '>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:12:46.744962 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-fb80fd85-a316-4ba2-ac95-c12f53501eb3 tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] [instance: 59e81a58-9400-4cea-aa38-b24b394e33d7] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:12:46.751804 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-fb80fd85-a316-4ba2-ac95-c12f53501eb3 tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:12:46.752293 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-fb80fd85-a316-4ba2-ac95-c12f53501eb3 tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:12:46.752730 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-fb80fd85-a316-4ba2-ac95-c12f53501eb3 tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:12:46.753464 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-fb80fd85-a316-4ba2-ac95-c12f53501eb3 tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:12:46.753917 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-fb80fd85-a316-4ba2-ac95-c12f53501eb3 tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:12:46.754341 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-fb80fd85-a316-4ba2-ac95-c12f53501eb3 tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:12:46.770737 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG dbcounter [-] [118815] Writing DB stats nova_cell1:SELECT=100 {{(pid=118815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:12:46.890873 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-fb80fd85-a316-4ba2-ac95-c12f53501eb3 tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d89667e52b24295ba619203c02c7bd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed5038c799342d48edc980983f1d996', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:12:46.899832 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-fb80fd85-a316-4ba2-ac95-c12f53501eb3 tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] 10.222.0.23 "GET /compute/v2.1/servers/59e81a58-9400-4cea-aa38-b24b394e33d7" status: 200 len: 1357 microversion: 2.1 time: 0.160329 Oct 13 13:12:46.900577 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 202/426] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:12:46 2022] GET /compute/v2.1/servers/59e81a58-9400-4cea-aa38-b24b394e33d7 => generated 1357 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:12:47.218005 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-ec29824e-71c4-4f8b-9da4-58982e590dcd tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Calling method '>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:12:47.218535 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-ec29824e-71c4-4f8b-9da4-58982e590dcd tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] [instance: 26bd475b-3495-4669-9985-d4a7dedb4bbf] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:12:47.224383 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-ec29824e-71c4-4f8b-9da4-58982e590dcd tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:12:47.224857 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-ec29824e-71c4-4f8b-9da4-58982e590dcd tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:12:47.225290 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-ec29824e-71c4-4f8b-9da4-58982e590dcd tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:12:47.225968 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-ec29824e-71c4-4f8b-9da4-58982e590dcd tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:12:47.226413 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-ec29824e-71c4-4f8b-9da4-58982e590dcd tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:12:47.226835 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-ec29824e-71c4-4f8b-9da4-58982e590dcd tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:12:47.247227 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG dbcounter [-] [118814] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=118814) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:12:47.365786 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-ec29824e-71c4-4f8b-9da4-58982e590dcd tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:12:47.377744 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-ec29824e-71c4-4f8b-9da4-58982e590dcd tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:12:47.379875 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-ec29824e-71c4-4f8b-9da4-58982e590dcd tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:12:47.381033 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-ec29824e-71c4-4f8b-9da4-58982e590dcd tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] 10.222.0.23 "GET /compute/v2.1/servers/26bd475b-3495-4669-9985-d4a7dedb4bbf" status: 200 len: 1809 microversion: 2.20 time: 0.167211 Oct 13 13:12:47.381580 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 225/427] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 13:12:47 2022] GET /compute/v2.1/servers/26bd475b-3495-4669-9985-d4a7dedb4bbf => generated 1809 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 13:12:47.443892 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [req-aee6a3dc-c519-4de2-ad0b-83d856bf67e4 req-4bae5c4c-79a7-4bf1-8c00-2a57ac85e084 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b4ba0fd3-eb17-4e05-acaa-5570c1e364d7", "tag": "feb1b7b8-f5e8-4310-8e6d-7eb1841b5c04"}]} {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 13:12:47.453265 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [req-aee6a3dc-c519-4de2-ad0b-83d856bf67e4 req-4bae5c4c-79a7-4bf1-8c00-2a57ac85e084 service nova] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:12:47.453748 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [req-aee6a3dc-c519-4de2-ad0b-83d856bf67e4 req-4bae5c4c-79a7-4bf1-8c00-2a57ac85e084 service nova] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:12:47.454180 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [req-aee6a3dc-c519-4de2-ad0b-83d856bf67e4 req-4bae5c4c-79a7-4bf1-8c00-2a57ac85e084 service nova] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:12:47.465826 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.compute.server_external_events [req-aee6a3dc-c519-4de2-ad0b-83d856bf67e4 req-4bae5c4c-79a7-4bf1-8c00-2a57ac85e084 service nova] Creating event network-changed:feb1b7b8-f5e8-4310-8e6d-7eb1841b5c04 for instance b4ba0fd3-eb17-4e05-acaa-5570c1e364d7 on hv-cinder-82660 Oct 13 13:12:47.470887 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [req-aee6a3dc-c519-4de2-ad0b-83d856bf67e4 req-4bae5c4c-79a7-4bf1-8c00-2a57ac85e084 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031214 Oct 13 13:12:47.471463 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 203/428] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 13:12:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 13:12:47.638496 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-e8eab9da-48ff-4168-a707-ae92c9f9cff8 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Calling method '>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:12:47.639316 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-e8eab9da-48ff-4168-a707-ae92c9f9cff8 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] [instance: c8c61fd5-2f2a-4cd9-a439-00943de4dda6] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:12:47.649087 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-e8eab9da-48ff-4168-a707-ae92c9f9cff8 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:12:47.649744 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-e8eab9da-48ff-4168-a707-ae92c9f9cff8 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:12:47.650285 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-e8eab9da-48ff-4168-a707-ae92c9f9cff8 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:12:47.651090 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-e8eab9da-48ff-4168-a707-ae92c9f9cff8 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:12:47.651734 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-e8eab9da-48ff-4168-a707-ae92c9f9cff8 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:12:47.652370 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-e8eab9da-48ff-4168-a707-ae92c9f9cff8 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:12:47.802544 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-e8eab9da-48ff-4168-a707-ae92c9f9cff8 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8569afc405f24a0993a023c818a0c272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f85144e13e254365a86aa785093c8575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:12:47.822360 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-e8eab9da-48ff-4168-a707-ae92c9f9cff8 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c61fd5-2f2a-4cd9-a439-00943de4dda6" status: 200 len: 1318 microversion: 2.1 time: 0.188090 Oct 13 13:12:47.835101 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 226/429] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:12:47 2022] GET /compute/v2.1/servers/c8c61fd5-2f2a-4cd9-a439-00943de4dda6 => generated 1318 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:12:47.926643 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-3210712a-992f-423b-a4b5-0d2eb64b98d5 tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Calling method '>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:12:47.927738 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-3210712a-992f-423b-a4b5-0d2eb64b98d5 tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] [instance: 59e81a58-9400-4cea-aa38-b24b394e33d7] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:12:47.940823 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-3210712a-992f-423b-a4b5-0d2eb64b98d5 tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:12:47.941466 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-3210712a-992f-423b-a4b5-0d2eb64b98d5 tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:12:47.942217 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-3210712a-992f-423b-a4b5-0d2eb64b98d5 tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:12:47.942996 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-3210712a-992f-423b-a4b5-0d2eb64b98d5 tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:12:47.943573 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-3210712a-992f-423b-a4b5-0d2eb64b98d5 tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:12:47.944086 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-3210712a-992f-423b-a4b5-0d2eb64b98d5 tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:12:48.142465 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-3210712a-992f-423b-a4b5-0d2eb64b98d5 tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d89667e52b24295ba619203c02c7bd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed5038c799342d48edc980983f1d996', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:12:48.152577 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-3210712a-992f-423b-a4b5-0d2eb64b98d5 tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] 10.222.0.23 "GET /compute/v2.1/servers/59e81a58-9400-4cea-aa38-b24b394e33d7" status: 200 len: 1357 microversion: 2.1 time: 0.231754 Oct 13 13:12:48.153776 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 204/430] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:12:47 2022] GET /compute/v2.1/servers/59e81a58-9400-4cea-aa38-b24b394e33d7 => generated 1357 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:12:48.405799 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-72a6cc99-8bf1-4187-a8d2-bf9c2e23de55 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Calling method '>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:12:48.406451 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-72a6cc99-8bf1-4187-a8d2-bf9c2e23de55 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] [instance: 26bd475b-3495-4669-9985-d4a7dedb4bbf] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:12:48.419032 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-72a6cc99-8bf1-4187-a8d2-bf9c2e23de55 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:12:48.419691 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-72a6cc99-8bf1-4187-a8d2-bf9c2e23de55 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:12:48.420375 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-72a6cc99-8bf1-4187-a8d2-bf9c2e23de55 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:12:48.421184 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-72a6cc99-8bf1-4187-a8d2-bf9c2e23de55 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:12:48.421737 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-72a6cc99-8bf1-4187-a8d2-bf9c2e23de55 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:12:48.422401 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-72a6cc99-8bf1-4187-a8d2-bf9c2e23de55 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:12:48.513452 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [req-fc9d5ce9-9936-4808-82ae-5a0ba7b6968d req-3f82abf2-d8b2-4d03-b47b-33ff0462b805 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c8c61fd5-2f2a-4cd9-a439-00943de4dda6", "name": "network-vif-plugged", "status": "completed", "tag": "47c8bf5c-a500-440a-a247-090d3dbe386b"}]} {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 13:12:48.523961 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [req-fc9d5ce9-9936-4808-82ae-5a0ba7b6968d req-3f82abf2-d8b2-4d03-b47b-33ff0462b805 service nova] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:12:48.524729 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [req-fc9d5ce9-9936-4808-82ae-5a0ba7b6968d req-3f82abf2-d8b2-4d03-b47b-33ff0462b805 service nova] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:12:48.525312 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [req-fc9d5ce9-9936-4808-82ae-5a0ba7b6968d req-3f82abf2-d8b2-4d03-b47b-33ff0462b805 service nova] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:12:48.540360 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.compute.server_external_events [req-fc9d5ce9-9936-4808-82ae-5a0ba7b6968d req-3f82abf2-d8b2-4d03-b47b-33ff0462b805 service nova] Creating event network-vif-plugged:47c8bf5c-a500-440a-a247-090d3dbe386b for instance c8c61fd5-2f2a-4cd9-a439-00943de4dda6 on hv-cinder-82660 Oct 13 13:12:48.546061 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [req-fc9d5ce9-9936-4808-82ae-5a0ba7b6968d req-3f82abf2-d8b2-4d03-b47b-33ff0462b805 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036124 Oct 13 13:12:48.551544 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 205/431] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 13:12:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 13:12:48.638988 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-72a6cc99-8bf1-4187-a8d2-bf9c2e23de55 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:12:48.651710 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-72a6cc99-8bf1-4187-a8d2-bf9c2e23de55 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:12:48.653529 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-72a6cc99-8bf1-4187-a8d2-bf9c2e23de55 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:12:48.655203 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-72a6cc99-8bf1-4187-a8d2-bf9c2e23de55 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] 10.222.0.23 "GET /compute/v2.1/servers/26bd475b-3495-4669-9985-d4a7dedb4bbf" status: 200 len: 1809 microversion: 2.20 time: 0.253160 Oct 13 13:12:48.656607 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 227/432] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 13:12:48 2022] GET /compute/v2.1/servers/26bd475b-3495-4669-9985-d4a7dedb4bbf => generated 1809 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 13:12:48.846369 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-0585524f-221d-4177-8820-4719197ec693 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Calling method '>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:12:48.848004 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-0585524f-221d-4177-8820-4719197ec693 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] [instance: c8c61fd5-2f2a-4cd9-a439-00943de4dda6] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:12:48.854866 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-0585524f-221d-4177-8820-4719197ec693 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:12:48.855698 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-0585524f-221d-4177-8820-4719197ec693 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:12:48.856355 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-0585524f-221d-4177-8820-4719197ec693 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:12:48.857291 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-0585524f-221d-4177-8820-4719197ec693 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:12:48.857960 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-0585524f-221d-4177-8820-4719197ec693 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:12:48.858637 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-0585524f-221d-4177-8820-4719197ec693 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:12:49.024283 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-0585524f-221d-4177-8820-4719197ec693 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8569afc405f24a0993a023c818a0c272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f85144e13e254365a86aa785093c8575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:12:49.035855 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-0585524f-221d-4177-8820-4719197ec693 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c61fd5-2f2a-4cd9-a439-00943de4dda6" status: 200 len: 1318 microversion: 2.1 time: 0.192012 Oct 13 13:12:49.037043 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 206/433] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:12:48 2022] GET /compute/v2.1/servers/c8c61fd5-2f2a-4cd9-a439-00943de4dda6 => generated 1318 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:12:49.181802 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-de98872b-eba8-467c-8fd3-07ba7c58a02c tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Calling method '>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:12:49.182334 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-de98872b-eba8-467c-8fd3-07ba7c58a02c tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] [instance: 59e81a58-9400-4cea-aa38-b24b394e33d7] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:12:49.188348 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-de98872b-eba8-467c-8fd3-07ba7c58a02c tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:12:49.188828 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-de98872b-eba8-467c-8fd3-07ba7c58a02c tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:12:49.189447 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-de98872b-eba8-467c-8fd3-07ba7c58a02c tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:12:49.190142 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-de98872b-eba8-467c-8fd3-07ba7c58a02c tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:12:49.190658 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-de98872b-eba8-467c-8fd3-07ba7c58a02c tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:12:49.191100 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-de98872b-eba8-467c-8fd3-07ba7c58a02c tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:12:49.348319 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-de98872b-eba8-467c-8fd3-07ba7c58a02c tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d89667e52b24295ba619203c02c7bd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed5038c799342d48edc980983f1d996', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:12:49.356550 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-de98872b-eba8-467c-8fd3-07ba7c58a02c tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] 10.222.0.23 "GET /compute/v2.1/servers/59e81a58-9400-4cea-aa38-b24b394e33d7" status: 200 len: 1357 microversion: 2.1 time: 0.178898 Oct 13 13:12:49.371160 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 228/434] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:12:49 2022] GET /compute/v2.1/servers/59e81a58-9400-4cea-aa38-b24b394e33d7 => generated 1357 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:12:49.681586 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-a00543f3-a02f-40de-8a6a-1a4e163b4193 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Calling method '>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:12:49.682184 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-a00543f3-a02f-40de-8a6a-1a4e163b4193 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] [instance: 26bd475b-3495-4669-9985-d4a7dedb4bbf] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:12:49.688581 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-a00543f3-a02f-40de-8a6a-1a4e163b4193 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:12:49.689067 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-a00543f3-a02f-40de-8a6a-1a4e163b4193 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:12:49.689511 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-a00543f3-a02f-40de-8a6a-1a4e163b4193 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:12:49.690220 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-a00543f3-a02f-40de-8a6a-1a4e163b4193 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:12:49.690682 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-a00543f3-a02f-40de-8a6a-1a4e163b4193 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:12:49.691137 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-a00543f3-a02f-40de-8a6a-1a4e163b4193 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:12:49.844759 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-a00543f3-a02f-40de-8a6a-1a4e163b4193 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:12:49.858304 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-a00543f3-a02f-40de-8a6a-1a4e163b4193 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:12:49.860462 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-a00543f3-a02f-40de-8a6a-1a4e163b4193 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:12:49.861661 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-a00543f3-a02f-40de-8a6a-1a4e163b4193 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] 10.222.0.23 "GET /compute/v2.1/servers/26bd475b-3495-4669-9985-d4a7dedb4bbf" status: 200 len: 1809 microversion: 2.20 time: 0.183975 Oct 13 13:12:49.862273 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 207/435] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 13:12:49 2022] GET /compute/v2.1/servers/26bd475b-3495-4669-9985-d4a7dedb4bbf => generated 1809 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 13:12:50.060639 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-bd1caecb-15d3-4440-b196-8806153921c0 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Calling method '>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:12:50.061985 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-bd1caecb-15d3-4440-b196-8806153921c0 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] [instance: c8c61fd5-2f2a-4cd9-a439-00943de4dda6] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:12:50.069645 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-bd1caecb-15d3-4440-b196-8806153921c0 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:12:50.070450 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-bd1caecb-15d3-4440-b196-8806153921c0 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:12:50.071114 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-bd1caecb-15d3-4440-b196-8806153921c0 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:12:50.072350 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-bd1caecb-15d3-4440-b196-8806153921c0 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:12:50.073150 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-bd1caecb-15d3-4440-b196-8806153921c0 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:12:50.073784 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-bd1caecb-15d3-4440-b196-8806153921c0 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:12:50.256658 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-bd1caecb-15d3-4440-b196-8806153921c0 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8569afc405f24a0993a023c818a0c272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f85144e13e254365a86aa785093c8575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:12:50.268162 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-bd1caecb-15d3-4440-b196-8806153921c0 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c61fd5-2f2a-4cd9-a439-00943de4dda6" status: 200 len: 1318 microversion: 2.1 time: 0.211799 Oct 13 13:12:50.268700 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 229/436] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:12:50 2022] GET /compute/v2.1/servers/c8c61fd5-2f2a-4cd9-a439-00943de4dda6 => generated 1318 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:12:50.379811 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-a43ef389-e9c7-4113-80e5-3b4fe959e30c tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Calling method '>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:12:50.380522 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-a43ef389-e9c7-4113-80e5-3b4fe959e30c tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] [instance: 59e81a58-9400-4cea-aa38-b24b394e33d7] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:12:50.387082 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-a43ef389-e9c7-4113-80e5-3b4fe959e30c tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:12:50.387583 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-a43ef389-e9c7-4113-80e5-3b4fe959e30c tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:12:50.388016 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-a43ef389-e9c7-4113-80e5-3b4fe959e30c tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:12:50.388710 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-a43ef389-e9c7-4113-80e5-3b4fe959e30c tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:12:50.389162 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-a43ef389-e9c7-4113-80e5-3b4fe959e30c tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:12:50.389575 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-a43ef389-e9c7-4113-80e5-3b4fe959e30c tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:12:50.528118 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-a43ef389-e9c7-4113-80e5-3b4fe959e30c tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d89667e52b24295ba619203c02c7bd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed5038c799342d48edc980983f1d996', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:12:50.536908 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-a43ef389-e9c7-4113-80e5-3b4fe959e30c tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] 10.222.0.23 "GET /compute/v2.1/servers/59e81a58-9400-4cea-aa38-b24b394e33d7" status: 200 len: 1357 microversion: 2.1 time: 0.161091 Oct 13 13:12:50.537488 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 208/437] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:12:50 2022] GET /compute/v2.1/servers/59e81a58-9400-4cea-aa38-b24b394e33d7 => generated 1357 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 13:12:50.888593 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-47e3e78f-49db-4962-b400-1e3ea952423c tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Calling method '>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:12:50.889198 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-47e3e78f-49db-4962-b400-1e3ea952423c tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] [instance: 26bd475b-3495-4669-9985-d4a7dedb4bbf] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:12:50.897178 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-47e3e78f-49db-4962-b400-1e3ea952423c tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:12:50.897695 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-47e3e78f-49db-4962-b400-1e3ea952423c tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:12:50.898183 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-47e3e78f-49db-4962-b400-1e3ea952423c tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:12:50.898861 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-47e3e78f-49db-4962-b400-1e3ea952423c tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:12:50.899348 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-47e3e78f-49db-4962-b400-1e3ea952423c tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:12:50.899780 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-47e3e78f-49db-4962-b400-1e3ea952423c tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:12:51.057960 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-47e3e78f-49db-4962-b400-1e3ea952423c tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:12:51.067496 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-47e3e78f-49db-4962-b400-1e3ea952423c tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:12:51.069032 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-47e3e78f-49db-4962-b400-1e3ea952423c tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:12:51.070290 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-47e3e78f-49db-4962-b400-1e3ea952423c tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] 10.222.0.23 "GET /compute/v2.1/servers/26bd475b-3495-4669-9985-d4a7dedb4bbf" status: 200 len: 1809 microversion: 2.20 time: 0.185619 Oct 13 13:12:51.070848 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 230/438] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 13:12:50 2022] GET /compute/v2.1/servers/26bd475b-3495-4669-9985-d4a7dedb4bbf => generated 1809 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 13:12:51.290185 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-477ccdce-1e50-49d3-bc98-4a165d94bbf1 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Calling method '>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:12:51.291289 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-477ccdce-1e50-49d3-bc98-4a165d94bbf1 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] [instance: c8c61fd5-2f2a-4cd9-a439-00943de4dda6] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:12:51.298094 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-477ccdce-1e50-49d3-bc98-4a165d94bbf1 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:12:51.298586 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-477ccdce-1e50-49d3-bc98-4a165d94bbf1 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:12:51.299027 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-477ccdce-1e50-49d3-bc98-4a165d94bbf1 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:12:51.300294 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-477ccdce-1e50-49d3-bc98-4a165d94bbf1 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:12:51.301368 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-477ccdce-1e50-49d3-bc98-4a165d94bbf1 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:12:51.301860 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-477ccdce-1e50-49d3-bc98-4a165d94bbf1 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:12:51.460844 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-477ccdce-1e50-49d3-bc98-4a165d94bbf1 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8569afc405f24a0993a023c818a0c272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f85144e13e254365a86aa785093c8575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:12:51.469663 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-477ccdce-1e50-49d3-bc98-4a165d94bbf1 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c61fd5-2f2a-4cd9-a439-00943de4dda6" status: 200 len: 1318 microversion: 2.1 time: 0.183740 Oct 13 13:12:51.470237 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 209/439] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:12:51 2022] GET /compute/v2.1/servers/c8c61fd5-2f2a-4cd9-a439-00943de4dda6 => generated 1318 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:12:51.561119 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-be863752-5d21-4e8f-8b3b-b4b58536d8ec tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Calling method '>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:12:51.563101 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-be863752-5d21-4e8f-8b3b-b4b58536d8ec tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] [instance: 59e81a58-9400-4cea-aa38-b24b394e33d7] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:12:51.570674 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-be863752-5d21-4e8f-8b3b-b4b58536d8ec tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:12:51.571293 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-be863752-5d21-4e8f-8b3b-b4b58536d8ec tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:12:51.571799 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-be863752-5d21-4e8f-8b3b-b4b58536d8ec tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:12:51.572892 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-be863752-5d21-4e8f-8b3b-b4b58536d8ec tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:12:51.573423 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-be863752-5d21-4e8f-8b3b-b4b58536d8ec tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:12:51.573939 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-be863752-5d21-4e8f-8b3b-b4b58536d8ec tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:12:51.715258 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-be863752-5d21-4e8f-8b3b-b4b58536d8ec tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d89667e52b24295ba619203c02c7bd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed5038c799342d48edc980983f1d996', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:12:51.724017 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-be863752-5d21-4e8f-8b3b-b4b58536d8ec tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] 10.222.0.23 "GET /compute/v2.1/servers/59e81a58-9400-4cea-aa38-b24b394e33d7" status: 200 len: 1357 microversion: 2.1 time: 0.167771 Oct 13 13:12:51.724593 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 231/440] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:12:51 2022] GET /compute/v2.1/servers/59e81a58-9400-4cea-aa38-b24b394e33d7 => generated 1357 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:12:52.100588 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-b0d22306-2fbe-4e8e-a6fa-57648a596f9e tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Calling method '>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:12:52.101254 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-b0d22306-2fbe-4e8e-a6fa-57648a596f9e tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] [instance: 26bd475b-3495-4669-9985-d4a7dedb4bbf] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:12:52.108911 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-b0d22306-2fbe-4e8e-a6fa-57648a596f9e tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:12:52.109453 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-b0d22306-2fbe-4e8e-a6fa-57648a596f9e tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:12:52.109912 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-b0d22306-2fbe-4e8e-a6fa-57648a596f9e tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:12:52.110936 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-b0d22306-2fbe-4e8e-a6fa-57648a596f9e tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:12:52.111410 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-b0d22306-2fbe-4e8e-a6fa-57648a596f9e tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:12:52.111830 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-b0d22306-2fbe-4e8e-a6fa-57648a596f9e tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:12:52.256663 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-b0d22306-2fbe-4e8e-a6fa-57648a596f9e tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:12:52.265725 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-b0d22306-2fbe-4e8e-a6fa-57648a596f9e tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:12:52.267215 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-b0d22306-2fbe-4e8e-a6fa-57648a596f9e tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:12:52.269072 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-b0d22306-2fbe-4e8e-a6fa-57648a596f9e tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] 10.222.0.23 "GET /compute/v2.1/servers/26bd475b-3495-4669-9985-d4a7dedb4bbf" status: 200 len: 1809 microversion: 2.20 time: 0.174492 Oct 13 13:12:52.269977 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 210/441] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 13:12:52 2022] GET /compute/v2.1/servers/26bd475b-3495-4669-9985-d4a7dedb4bbf => generated 1809 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 13:12:52.492779 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-11e02c7d-c23a-4e74-9881-cf9b7eb805db tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Calling method '>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:12:52.493343 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-11e02c7d-c23a-4e74-9881-cf9b7eb805db tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] [instance: c8c61fd5-2f2a-4cd9-a439-00943de4dda6] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:12:52.501780 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-11e02c7d-c23a-4e74-9881-cf9b7eb805db tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:12:52.502268 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-11e02c7d-c23a-4e74-9881-cf9b7eb805db tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:12:52.503240 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-11e02c7d-c23a-4e74-9881-cf9b7eb805db tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:12:52.503944 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-11e02c7d-c23a-4e74-9881-cf9b7eb805db tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:12:52.504391 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-11e02c7d-c23a-4e74-9881-cf9b7eb805db tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:12:52.504806 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-11e02c7d-c23a-4e74-9881-cf9b7eb805db tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:12:52.660665 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-11e02c7d-c23a-4e74-9881-cf9b7eb805db tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8569afc405f24a0993a023c818a0c272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f85144e13e254365a86aa785093c8575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:12:52.668781 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-11e02c7d-c23a-4e74-9881-cf9b7eb805db tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c61fd5-2f2a-4cd9-a439-00943de4dda6" status: 200 len: 1318 microversion: 2.1 time: 0.179988 Oct 13 13:12:52.683523 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 232/442] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:12:52 2022] GET /compute/v2.1/servers/c8c61fd5-2f2a-4cd9-a439-00943de4dda6 => generated 1318 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:12:52.748042 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-e30bc077-7da8-462d-a6dd-0c79d51532ef tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Calling method '>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:12:52.748042 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-e30bc077-7da8-462d-a6dd-0c79d51532ef tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] [instance: 59e81a58-9400-4cea-aa38-b24b394e33d7] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:12:52.754867 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-e30bc077-7da8-462d-a6dd-0c79d51532ef tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:12:52.755406 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-e30bc077-7da8-462d-a6dd-0c79d51532ef tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:12:52.755845 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-e30bc077-7da8-462d-a6dd-0c79d51532ef tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:12:52.756730 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-e30bc077-7da8-462d-a6dd-0c79d51532ef tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:12:52.757743 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-e30bc077-7da8-462d-a6dd-0c79d51532ef tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:12:52.758175 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-e30bc077-7da8-462d-a6dd-0c79d51532ef tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:12:52.954354 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-e30bc077-7da8-462d-a6dd-0c79d51532ef tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d89667e52b24295ba619203c02c7bd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed5038c799342d48edc980983f1d996', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:12:52.963642 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-e30bc077-7da8-462d-a6dd-0c79d51532ef tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] 10.222.0.23 "GET /compute/v2.1/servers/59e81a58-9400-4cea-aa38-b24b394e33d7" status: 200 len: 1357 microversion: 2.1 time: 0.220692 Oct 13 13:12:52.964223 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 211/443] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:12:52 2022] GET /compute/v2.1/servers/59e81a58-9400-4cea-aa38-b24b394e33d7 => generated 1357 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:12:53.295499 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-764b7a82-03da-4508-83a7-11f04c8f9114 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Calling method '>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:12:53.296100 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-764b7a82-03da-4508-83a7-11f04c8f9114 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] [instance: 26bd475b-3495-4669-9985-d4a7dedb4bbf] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:12:53.302346 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-764b7a82-03da-4508-83a7-11f04c8f9114 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:12:53.302824 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-764b7a82-03da-4508-83a7-11f04c8f9114 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:12:53.303309 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-764b7a82-03da-4508-83a7-11f04c8f9114 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:12:53.304002 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-764b7a82-03da-4508-83a7-11f04c8f9114 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:12:53.304448 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-764b7a82-03da-4508-83a7-11f04c8f9114 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:12:53.304866 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-764b7a82-03da-4508-83a7-11f04c8f9114 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:12:53.452617 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-764b7a82-03da-4508-83a7-11f04c8f9114 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:12:53.466530 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-764b7a82-03da-4508-83a7-11f04c8f9114 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:12:53.468277 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-764b7a82-03da-4508-83a7-11f04c8f9114 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:12:53.469572 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-764b7a82-03da-4508-83a7-11f04c8f9114 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] 10.222.0.23 "GET /compute/v2.1/servers/26bd475b-3495-4669-9985-d4a7dedb4bbf" status: 200 len: 1809 microversion: 2.20 time: 0.178240 Oct 13 13:12:53.470394 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 233/444] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 13:12:53 2022] GET /compute/v2.1/servers/26bd475b-3495-4669-9985-d4a7dedb4bbf => generated 1809 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 13:12:53.694951 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-65c840a3-d9e5-44c7-80f0-c05885c41b15 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Calling method '>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:12:53.696355 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-65c840a3-d9e5-44c7-80f0-c05885c41b15 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] [instance: c8c61fd5-2f2a-4cd9-a439-00943de4dda6] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:12:53.705423 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-65c840a3-d9e5-44c7-80f0-c05885c41b15 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:12:53.706134 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-65c840a3-d9e5-44c7-80f0-c05885c41b15 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:12:53.706576 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-65c840a3-d9e5-44c7-80f0-c05885c41b15 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:12:53.707315 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-65c840a3-d9e5-44c7-80f0-c05885c41b15 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:12:53.707787 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-65c840a3-d9e5-44c7-80f0-c05885c41b15 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:12:53.708195 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-65c840a3-d9e5-44c7-80f0-c05885c41b15 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:12:53.842057 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-65c840a3-d9e5-44c7-80f0-c05885c41b15 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8569afc405f24a0993a023c818a0c272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f85144e13e254365a86aa785093c8575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:12:53.850676 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-65c840a3-d9e5-44c7-80f0-c05885c41b15 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c61fd5-2f2a-4cd9-a439-00943de4dda6" status: 200 len: 1318 microversion: 2.1 time: 0.160783 Oct 13 13:12:53.852391 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 212/445] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:12:53 2022] GET /compute/v2.1/servers/c8c61fd5-2f2a-4cd9-a439-00943de4dda6 => generated 1318 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:12:53.988502 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-049efca1-517f-4cdb-9551-ad48f53f47f4 tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Calling method '>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:12:53.989091 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-049efca1-517f-4cdb-9551-ad48f53f47f4 tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] [instance: 59e81a58-9400-4cea-aa38-b24b394e33d7] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:12:53.995748 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-049efca1-517f-4cdb-9551-ad48f53f47f4 tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:12:53.996227 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-049efca1-517f-4cdb-9551-ad48f53f47f4 tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:12:53.996657 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-049efca1-517f-4cdb-9551-ad48f53f47f4 tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:12:53.997348 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-049efca1-517f-4cdb-9551-ad48f53f47f4 tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:12:53.997800 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-049efca1-517f-4cdb-9551-ad48f53f47f4 tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:12:53.998217 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-049efca1-517f-4cdb-9551-ad48f53f47f4 tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:12:54.164806 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-049efca1-517f-4cdb-9551-ad48f53f47f4 tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d89667e52b24295ba619203c02c7bd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed5038c799342d48edc980983f1d996', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:12:54.172699 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-049efca1-517f-4cdb-9551-ad48f53f47f4 tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] 10.222.0.23 "GET /compute/v2.1/servers/59e81a58-9400-4cea-aa38-b24b394e33d7" status: 200 len: 1357 microversion: 2.1 time: 0.188708 Oct 13 13:12:54.173524 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 234/446] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:12:53 2022] GET /compute/v2.1/servers/59e81a58-9400-4cea-aa38-b24b394e33d7 => generated 1357 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:12:54.499165 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-9a4bc517-9626-4a19-8d6d-f097a0a1a997 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Calling method '>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:12:54.500024 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-9a4bc517-9626-4a19-8d6d-f097a0a1a997 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] [instance: 26bd475b-3495-4669-9985-d4a7dedb4bbf] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:12:54.507088 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-9a4bc517-9626-4a19-8d6d-f097a0a1a997 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:12:54.507652 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-9a4bc517-9626-4a19-8d6d-f097a0a1a997 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:12:54.508104 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-9a4bc517-9626-4a19-8d6d-f097a0a1a997 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:12:54.508852 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-9a4bc517-9626-4a19-8d6d-f097a0a1a997 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:12:54.509308 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-9a4bc517-9626-4a19-8d6d-f097a0a1a997 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:12:54.509982 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-9a4bc517-9626-4a19-8d6d-f097a0a1a997 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:12:54.655989 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-9a4bc517-9626-4a19-8d6d-f097a0a1a997 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:12:54.665248 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-9a4bc517-9626-4a19-8d6d-f097a0a1a997 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:12:54.666754 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-9a4bc517-9626-4a19-8d6d-f097a0a1a997 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:12:54.668035 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-9a4bc517-9626-4a19-8d6d-f097a0a1a997 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] 10.222.0.23 "GET /compute/v2.1/servers/26bd475b-3495-4669-9985-d4a7dedb4bbf" status: 200 len: 1809 microversion: 2.20 time: 0.172922 Oct 13 13:12:54.668592 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 213/447] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 13:12:54 2022] GET /compute/v2.1/servers/26bd475b-3495-4669-9985-d4a7dedb4bbf => generated 1809 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 13:12:54.873764 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-accc6348-3e99-4a57-8083-604fa4e35355 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Calling method '>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:12:54.874856 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-accc6348-3e99-4a57-8083-604fa4e35355 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] [instance: c8c61fd5-2f2a-4cd9-a439-00943de4dda6] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:12:54.882215 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-accc6348-3e99-4a57-8083-604fa4e35355 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:12:54.895705 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-accc6348-3e99-4a57-8083-604fa4e35355 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:12:54.896158 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-accc6348-3e99-4a57-8083-604fa4e35355 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:12:54.896932 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-accc6348-3e99-4a57-8083-604fa4e35355 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:12:54.897380 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-accc6348-3e99-4a57-8083-604fa4e35355 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:12:54.897834 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-accc6348-3e99-4a57-8083-604fa4e35355 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:12:55.053113 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-accc6348-3e99-4a57-8083-604fa4e35355 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8569afc405f24a0993a023c818a0c272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f85144e13e254365a86aa785093c8575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:12:55.065949 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-accc6348-3e99-4a57-8083-604fa4e35355 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c61fd5-2f2a-4cd9-a439-00943de4dda6" status: 200 len: 1318 microversion: 2.1 time: 0.194428 Oct 13 13:12:55.067325 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 235/448] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:12:54 2022] GET /compute/v2.1/servers/c8c61fd5-2f2a-4cd9-a439-00943de4dda6 => generated 1318 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:12:55.196826 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-6e45533e-3719-4dc9-86a0-2d72a06e178c tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Calling method '>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:12:55.197385 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-6e45533e-3719-4dc9-86a0-2d72a06e178c tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] [instance: 59e81a58-9400-4cea-aa38-b24b394e33d7] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:12:55.203739 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-6e45533e-3719-4dc9-86a0-2d72a06e178c tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:12:55.204222 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-6e45533e-3719-4dc9-86a0-2d72a06e178c tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:12:55.204660 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-6e45533e-3719-4dc9-86a0-2d72a06e178c tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:12:55.205350 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-6e45533e-3719-4dc9-86a0-2d72a06e178c tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:12:55.205833 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-6e45533e-3719-4dc9-86a0-2d72a06e178c tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:12:55.206261 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-6e45533e-3719-4dc9-86a0-2d72a06e178c tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:12:55.344180 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-6e45533e-3719-4dc9-86a0-2d72a06e178c tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d89667e52b24295ba619203c02c7bd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed5038c799342d48edc980983f1d996', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:12:55.352424 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-6e45533e-3719-4dc9-86a0-2d72a06e178c tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] 10.222.0.23 "GET /compute/v2.1/servers/59e81a58-9400-4cea-aa38-b24b394e33d7" status: 200 len: 1357 microversion: 2.1 time: 0.159640 Oct 13 13:12:55.352984 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 214/449] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:12:55 2022] GET /compute/v2.1/servers/59e81a58-9400-4cea-aa38-b24b394e33d7 => generated 1357 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:12:55.693730 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-d70f93c3-b427-4be7-9b39-2f6f02b38a97 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Calling method '>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:12:55.694365 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-d70f93c3-b427-4be7-9b39-2f6f02b38a97 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] [instance: 26bd475b-3495-4669-9985-d4a7dedb4bbf] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:12:55.700461 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-d70f93c3-b427-4be7-9b39-2f6f02b38a97 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:12:55.700940 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-d70f93c3-b427-4be7-9b39-2f6f02b38a97 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:12:55.701372 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-d70f93c3-b427-4be7-9b39-2f6f02b38a97 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:12:55.702054 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-d70f93c3-b427-4be7-9b39-2f6f02b38a97 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:12:55.702505 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-d70f93c3-b427-4be7-9b39-2f6f02b38a97 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:12:55.702920 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-d70f93c3-b427-4be7-9b39-2f6f02b38a97 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:12:55.840057 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-d70f93c3-b427-4be7-9b39-2f6f02b38a97 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:12:55.849196 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-d70f93c3-b427-4be7-9b39-2f6f02b38a97 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:12:55.850941 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-d70f93c3-b427-4be7-9b39-2f6f02b38a97 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:12:55.853923 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-d70f93c3-b427-4be7-9b39-2f6f02b38a97 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] 10.222.0.23 "GET /compute/v2.1/servers/26bd475b-3495-4669-9985-d4a7dedb4bbf" status: 200 len: 1809 microversion: 2.20 time: 0.163610 Oct 13 13:12:55.854898 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 236/450] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 13:12:55 2022] GET /compute/v2.1/servers/26bd475b-3495-4669-9985-d4a7dedb4bbf => generated 1809 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 13:12:56.089625 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-28c5d7d2-4e02-4cda-95e5-435a6c602358 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Calling method '>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:12:56.090237 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-28c5d7d2-4e02-4cda-95e5-435a6c602358 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] [instance: c8c61fd5-2f2a-4cd9-a439-00943de4dda6] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:12:56.096254 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-28c5d7d2-4e02-4cda-95e5-435a6c602358 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:12:56.096890 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-28c5d7d2-4e02-4cda-95e5-435a6c602358 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:12:56.097333 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-28c5d7d2-4e02-4cda-95e5-435a6c602358 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:12:56.098026 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-28c5d7d2-4e02-4cda-95e5-435a6c602358 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:12:56.098488 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-28c5d7d2-4e02-4cda-95e5-435a6c602358 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:12:56.098915 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-28c5d7d2-4e02-4cda-95e5-435a6c602358 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:12:56.224778 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-28c5d7d2-4e02-4cda-95e5-435a6c602358 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8569afc405f24a0993a023c818a0c272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f85144e13e254365a86aa785093c8575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:12:56.232472 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-28c5d7d2-4e02-4cda-95e5-435a6c602358 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c61fd5-2f2a-4cd9-a439-00943de4dda6" status: 200 len: 1318 microversion: 2.1 time: 0.146718 Oct 13 13:12:56.233036 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 215/451] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:12:56 2022] GET /compute/v2.1/servers/c8c61fd5-2f2a-4cd9-a439-00943de4dda6 => generated 1318 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:12:56.375803 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-14a93a5b-a92e-42e9-ad4e-5d42b88c8dd2 tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Calling method '>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:12:56.376653 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-14a93a5b-a92e-42e9-ad4e-5d42b88c8dd2 tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] [instance: 59e81a58-9400-4cea-aa38-b24b394e33d7] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:12:56.384383 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-14a93a5b-a92e-42e9-ad4e-5d42b88c8dd2 tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:12:56.384988 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-14a93a5b-a92e-42e9-ad4e-5d42b88c8dd2 tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:12:56.385619 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-14a93a5b-a92e-42e9-ad4e-5d42b88c8dd2 tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:12:56.386454 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-14a93a5b-a92e-42e9-ad4e-5d42b88c8dd2 tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:12:56.387095 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-14a93a5b-a92e-42e9-ad4e-5d42b88c8dd2 tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:12:56.387522 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-14a93a5b-a92e-42e9-ad4e-5d42b88c8dd2 tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:12:56.518373 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-14a93a5b-a92e-42e9-ad4e-5d42b88c8dd2 tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d89667e52b24295ba619203c02c7bd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed5038c799342d48edc980983f1d996', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:12:56.526019 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-14a93a5b-a92e-42e9-ad4e-5d42b88c8dd2 tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] 10.222.0.23 "GET /compute/v2.1/servers/59e81a58-9400-4cea-aa38-b24b394e33d7" status: 200 len: 1357 microversion: 2.1 time: 0.154185 Oct 13 13:12:56.526625 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 237/452] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:12:56 2022] GET /compute/v2.1/servers/59e81a58-9400-4cea-aa38-b24b394e33d7 => generated 1357 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:12:56.880533 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-b3d972df-94f7-4a73-b330-49a33f9490b6 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Calling method '>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:12:56.881144 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-b3d972df-94f7-4a73-b330-49a33f9490b6 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] [instance: 26bd475b-3495-4669-9985-d4a7dedb4bbf] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:12:56.887100 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-b3d972df-94f7-4a73-b330-49a33f9490b6 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:12:56.887587 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-b3d972df-94f7-4a73-b330-49a33f9490b6 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:12:56.888035 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-b3d972df-94f7-4a73-b330-49a33f9490b6 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:12:56.889057 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-b3d972df-94f7-4a73-b330-49a33f9490b6 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:12:56.889144 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-b3d972df-94f7-4a73-b330-49a33f9490b6 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:12:56.889560 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-b3d972df-94f7-4a73-b330-49a33f9490b6 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:12:57.035538 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-b3d972df-94f7-4a73-b330-49a33f9490b6 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:12:57.044178 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-b3d972df-94f7-4a73-b330-49a33f9490b6 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:12:57.045630 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-b3d972df-94f7-4a73-b330-49a33f9490b6 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:12:57.046781 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-b3d972df-94f7-4a73-b330-49a33f9490b6 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] 10.222.0.23 "GET /compute/v2.1/servers/26bd475b-3495-4669-9985-d4a7dedb4bbf" status: 200 len: 1809 microversion: 2.20 time: 0.170343 Oct 13 13:12:57.047379 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 216/453] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 13:12:56 2022] GET /compute/v2.1/servers/26bd475b-3495-4669-9985-d4a7dedb4bbf => generated 1809 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 13:12:57.255023 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-6b5a2a51-5e29-4fcb-ad31-092ae31467a8 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Calling method '>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:12:57.255668 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-6b5a2a51-5e29-4fcb-ad31-092ae31467a8 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] [instance: c8c61fd5-2f2a-4cd9-a439-00943de4dda6] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:12:57.261571 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-6b5a2a51-5e29-4fcb-ad31-092ae31467a8 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:12:57.262021 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-6b5a2a51-5e29-4fcb-ad31-092ae31467a8 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:12:57.262454 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-6b5a2a51-5e29-4fcb-ad31-092ae31467a8 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:12:57.263160 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-6b5a2a51-5e29-4fcb-ad31-092ae31467a8 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:12:57.263690 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-6b5a2a51-5e29-4fcb-ad31-092ae31467a8 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:12:57.264112 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-6b5a2a51-5e29-4fcb-ad31-092ae31467a8 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:12:57.389871 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-6b5a2a51-5e29-4fcb-ad31-092ae31467a8 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8569afc405f24a0993a023c818a0c272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f85144e13e254365a86aa785093c8575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:12:57.397979 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-6b5a2a51-5e29-4fcb-ad31-092ae31467a8 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c61fd5-2f2a-4cd9-a439-00943de4dda6" status: 200 len: 1318 microversion: 2.1 time: 0.146922 Oct 13 13:12:57.398540 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 238/454] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:12:57 2022] GET /compute/v2.1/servers/c8c61fd5-2f2a-4cd9-a439-00943de4dda6 => generated 1318 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:12:57.548621 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-3183fb6b-41e2-4517-a487-b7ea99220a3a tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Calling method '>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:12:57.549247 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-3183fb6b-41e2-4517-a487-b7ea99220a3a tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] [instance: 59e81a58-9400-4cea-aa38-b24b394e33d7] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:12:57.555857 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-3183fb6b-41e2-4517-a487-b7ea99220a3a tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:12:57.556332 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-3183fb6b-41e2-4517-a487-b7ea99220a3a tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:12:57.556764 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-3183fb6b-41e2-4517-a487-b7ea99220a3a tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:12:57.557439 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-3183fb6b-41e2-4517-a487-b7ea99220a3a tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:12:57.557885 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-3183fb6b-41e2-4517-a487-b7ea99220a3a tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:12:57.558302 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-3183fb6b-41e2-4517-a487-b7ea99220a3a tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:12:57.685663 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-3183fb6b-41e2-4517-a487-b7ea99220a3a tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d89667e52b24295ba619203c02c7bd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed5038c799342d48edc980983f1d996', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:12:57.693911 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-3183fb6b-41e2-4517-a487-b7ea99220a3a tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] 10.222.0.23 "GET /compute/v2.1/servers/59e81a58-9400-4cea-aa38-b24b394e33d7" status: 200 len: 1547 microversion: 2.1 time: 0.149213 Oct 13 13:12:57.694473 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 217/455] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:12:57 2022] GET /compute/v2.1/servers/59e81a58-9400-4cea-aa38-b24b394e33d7 => generated 1547 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:12:57.716557 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-d406e44c-3565-4513-958b-ac556e80c73b tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Calling method '>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:12:57.717217 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-d406e44c-3565-4513-958b-ac556e80c73b tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] [instance: 59e81a58-9400-4cea-aa38-b24b394e33d7] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:12:57.723371 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-d406e44c-3565-4513-958b-ac556e80c73b tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:12:57.723848 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-d406e44c-3565-4513-958b-ac556e80c73b tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:12:57.724281 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-d406e44c-3565-4513-958b-ac556e80c73b tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:12:57.724960 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-d406e44c-3565-4513-958b-ac556e80c73b tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:12:57.725408 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-d406e44c-3565-4513-958b-ac556e80c73b tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:12:57.725826 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-d406e44c-3565-4513-958b-ac556e80c73b tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:12:57.860159 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-d406e44c-3565-4513-958b-ac556e80c73b tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d89667e52b24295ba619203c02c7bd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed5038c799342d48edc980983f1d996', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:12:57.868987 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-d406e44c-3565-4513-958b-ac556e80c73b tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] 10.222.0.23 "GET /compute/v2.1/servers/59e81a58-9400-4cea-aa38-b24b394e33d7" status: 200 len: 1547 microversion: 2.1 time: 0.156486 Oct 13 13:12:57.869693 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 239/456] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:12:57 2022] GET /compute/v2.1/servers/59e81a58-9400-4cea-aa38-b24b394e33d7 => generated 1547 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:12:57.890984 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-7c0316ef-b5ee-4148-85bb-0e5b0c161c52 tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Calling method '>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:12:57.895917 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-7c0316ef-b5ee-4148-85bb-0e5b0c161c52 tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '7d89667e52b24295ba619203c02c7bd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed5038c799342d48edc980983f1d996', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:12:57.896686 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-7c0316ef-b5ee-4148-85bb-0e5b0c161c52 tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Searching by: {'deleted': False, 'project_id': '3ed5038c799342d48edc980983f1d996'} {{(pid=118815) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 13 13:12:57.903576 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-7c0316ef-b5ee-4148-85bb-0e5b0c161c52 tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:12:57.904146 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-7c0316ef-b5ee-4148-85bb-0e5b0c161c52 tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:12:57.904875 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-7c0316ef-b5ee-4148-85bb-0e5b0c161c52 tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:12:57.905605 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-7c0316ef-b5ee-4148-85bb-0e5b0c161c52 tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:12:57.906062 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-7c0316ef-b5ee-4148-85bb-0e5b0c161c52 tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:12:57.906485 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-7c0316ef-b5ee-4148-85bb-0e5b0c161c52 tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:12:57.997248 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.multi_cell_list [None req-7c0316ef-b5ee-4148-85bb-0e5b0c161c52 tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=118815) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 13 13:12:58.072780 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-60e12330-e620-4825-81c0-3f4f30d38a0c tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Calling method '>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:12:58.073714 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-60e12330-e620-4825-81c0-3f4f30d38a0c tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] [instance: 26bd475b-3495-4669-9985-d4a7dedb4bbf] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:12:58.079958 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-60e12330-e620-4825-81c0-3f4f30d38a0c tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:12:58.080438 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-60e12330-e620-4825-81c0-3f4f30d38a0c tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:12:58.080898 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-60e12330-e620-4825-81c0-3f4f30d38a0c tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:12:58.081582 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-60e12330-e620-4825-81c0-3f4f30d38a0c tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:12:58.082029 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-60e12330-e620-4825-81c0-3f4f30d38a0c tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:12:58.082450 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-60e12330-e620-4825-81c0-3f4f30d38a0c tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:12:58.091765 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-7c0316ef-b5ee-4148-85bb-0e5b0c161c52 tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] 10.222.0.23 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.204411 Oct 13 13:12:58.092356 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 218/457] 10.222.0.23 () {58 vars in 1125 bytes} [Thu Oct 13 13:12:57 2022] GET /compute/v2.1/servers => generated 343 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 13:12:58.104368 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-a58aee0b-32b1-45d9-a6a8-a2d9803ec6ca tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Calling method '>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:12:58.104930 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-a58aee0b-32b1-45d9-a6a8-a2d9803ec6ca tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] [instance: 59e81a58-9400-4cea-aa38-b24b394e33d7] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:12:58.111101 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-a58aee0b-32b1-45d9-a6a8-a2d9803ec6ca tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:12:58.111605 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-a58aee0b-32b1-45d9-a6a8-a2d9803ec6ca tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:12:58.112561 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-a58aee0b-32b1-45d9-a6a8-a2d9803ec6ca tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:12:58.113263 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-a58aee0b-32b1-45d9-a6a8-a2d9803ec6ca tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:12:58.113715 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-a58aee0b-32b1-45d9-a6a8-a2d9803ec6ca tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:12:58.114165 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-a58aee0b-32b1-45d9-a6a8-a2d9803ec6ca tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:12:58.298738 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-60e12330-e620-4825-81c0-3f4f30d38a0c tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:12:58.308182 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-60e12330-e620-4825-81c0-3f4f30d38a0c tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:12:58.309837 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-60e12330-e620-4825-81c0-3f4f30d38a0c tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:12:58.311214 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-60e12330-e620-4825-81c0-3f4f30d38a0c tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] 10.222.0.23 "GET /compute/v2.1/servers/26bd475b-3495-4669-9985-d4a7dedb4bbf" status: 200 len: 1809 microversion: 2.20 time: 0.242241 Oct 13 13:12:58.311772 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 240/458] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 13:12:58 2022] GET /compute/v2.1/servers/26bd475b-3495-4669-9985-d4a7dedb4bbf => generated 1809 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 13 13:12:58.313634 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-a58aee0b-32b1-45d9-a6a8-a2d9803ec6ca tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d89667e52b24295ba619203c02c7bd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed5038c799342d48edc980983f1d996', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:12:58.321716 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-a58aee0b-32b1-45d9-a6a8-a2d9803ec6ca tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] 10.222.0.23 "GET /compute/v2.1/servers/59e81a58-9400-4cea-aa38-b24b394e33d7" status: 200 len: 1547 microversion: 2.1 time: 0.221691 Oct 13 13:12:58.322355 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 219/459] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:12:58 2022] GET /compute/v2.1/servers/59e81a58-9400-4cea-aa38-b24b394e33d7 => generated 1547 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:12:58.421036 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-6863c4b1-35c5-4036-a3ad-4088196be1e2 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Calling method '>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:12:58.421657 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-6863c4b1-35c5-4036-a3ad-4088196be1e2 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] [instance: c8c61fd5-2f2a-4cd9-a439-00943de4dda6] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:12:58.428840 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-6863c4b1-35c5-4036-a3ad-4088196be1e2 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:12:58.429330 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-6863c4b1-35c5-4036-a3ad-4088196be1e2 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:12:58.429769 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-6863c4b1-35c5-4036-a3ad-4088196be1e2 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:12:58.430467 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-6863c4b1-35c5-4036-a3ad-4088196be1e2 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:12:58.430926 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-6863c4b1-35c5-4036-a3ad-4088196be1e2 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:12:58.431385 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-6863c4b1-35c5-4036-a3ad-4088196be1e2 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:12:58.563440 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-6863c4b1-35c5-4036-a3ad-4088196be1e2 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8569afc405f24a0993a023c818a0c272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f85144e13e254365a86aa785093c8575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:12:58.572269 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-6863c4b1-35c5-4036-a3ad-4088196be1e2 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c61fd5-2f2a-4cd9-a439-00943de4dda6" status: 200 len: 1318 microversion: 2.1 time: 0.155024 Oct 13 13:12:58.573061 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 241/460] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:12:58 2022] GET /compute/v2.1/servers/c8c61fd5-2f2a-4cd9-a439-00943de4dda6 => generated 1318 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:12:59.339334 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-01bed412-3c57-48bd-b53b-af743addda35 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Calling method '>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:12:59.340172 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-01bed412-3c57-48bd-b53b-af743addda35 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] [instance: 26bd475b-3495-4669-9985-d4a7dedb4bbf] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:12:59.347137 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-01bed412-3c57-48bd-b53b-af743addda35 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:12:59.347623 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-01bed412-3c57-48bd-b53b-af743addda35 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:12:59.348061 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-01bed412-3c57-48bd-b53b-af743addda35 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:12:59.348748 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-01bed412-3c57-48bd-b53b-af743addda35 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:12:59.349193 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-01bed412-3c57-48bd-b53b-af743addda35 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:12:59.349609 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-01bed412-3c57-48bd-b53b-af743addda35 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:12:59.352366 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG dbcounter [-] [118815] Writing DB stats nova_cell1:SELECT=100 {{(pid=118815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:12:59.481997 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-01bed412-3c57-48bd-b53b-af743addda35 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:12:59.491322 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-01bed412-3c57-48bd-b53b-af743addda35 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:12:59.492749 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-01bed412-3c57-48bd-b53b-af743addda35 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:12:59.493881 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-01bed412-3c57-48bd-b53b-af743addda35 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] 10.222.0.23 "GET /compute/v2.1/servers/26bd475b-3495-4669-9985-d4a7dedb4bbf" status: 200 len: 1809 microversion: 2.20 time: 0.161379 Oct 13 13:12:59.494432 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 220/461] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 13:12:59 2022] GET /compute/v2.1/servers/26bd475b-3495-4669-9985-d4a7dedb4bbf => generated 1809 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 13:12:59.594664 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-10cdd09b-d37e-4dcc-b837-16879ce05213 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Calling method '>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:12:59.595424 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-10cdd09b-d37e-4dcc-b837-16879ce05213 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] [instance: c8c61fd5-2f2a-4cd9-a439-00943de4dda6] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:12:59.601875 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-10cdd09b-d37e-4dcc-b837-16879ce05213 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:12:59.602351 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-10cdd09b-d37e-4dcc-b837-16879ce05213 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:12:59.602780 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-10cdd09b-d37e-4dcc-b837-16879ce05213 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:12:59.603480 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-10cdd09b-d37e-4dcc-b837-16879ce05213 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:12:59.603928 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-10cdd09b-d37e-4dcc-b837-16879ce05213 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:12:59.604346 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-10cdd09b-d37e-4dcc-b837-16879ce05213 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:12:59.608259 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG dbcounter [-] [118814] Writing DB stats nova_cell1:SELECT=100 {{(pid=118814) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:12:59.731831 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-10cdd09b-d37e-4dcc-b837-16879ce05213 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8569afc405f24a0993a023c818a0c272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f85144e13e254365a86aa785093c8575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:12:59.740183 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-10cdd09b-d37e-4dcc-b837-16879ce05213 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c61fd5-2f2a-4cd9-a439-00943de4dda6" status: 200 len: 1507 microversion: 2.1 time: 0.148985 Oct 13 13:12:59.740738 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 242/462] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:12:59 2022] GET /compute/v2.1/servers/c8c61fd5-2f2a-4cd9-a439-00943de4dda6 => generated 1507 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:12:59.761750 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-681012d4-aa8f-4bd9-8fa2-2e6905e76469 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b5305ded-7dd5-4455-bcd6-409d587a59e0", "device": "/dev/sdb"}} {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 13:12:59.764639 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-681012d4-aa8f-4bd9-8fa2-2e6905e76469 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] [instance: c8c61fd5-2f2a-4cd9-a439-00943de4dda6] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:12:59.772244 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-681012d4-aa8f-4bd9-8fa2-2e6905e76469 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:12:59.772723 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-681012d4-aa8f-4bd9-8fa2-2e6905e76469 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:12:59.773159 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-681012d4-aa8f-4bd9-8fa2-2e6905e76469 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:12:59.773844 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-681012d4-aa8f-4bd9-8fa2-2e6905e76469 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:12:59.774295 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-681012d4-aa8f-4bd9-8fa2-2e6905e76469 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:12:59.774712 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-681012d4-aa8f-4bd9-8fa2-2e6905e76469 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:12:59.867194 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-4d0c72e0-df5f-44ae-b131-f82461f27c89 tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d6ae42f7-e4b4-4261-9527-4bd288cf7bf8"}} {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 13:12:59.869885 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-4d0c72e0-df5f-44ae-b131-f82461f27c89 tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] [instance: 59e81a58-9400-4cea-aa38-b24b394e33d7] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:12:59.876480 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-4d0c72e0-df5f-44ae-b131-f82461f27c89 tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:12:59.876953 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-4d0c72e0-df5f-44ae-b131-f82461f27c89 tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:12:59.877634 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-4d0c72e0-df5f-44ae-b131-f82461f27c89 tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:12:59.878521 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-4d0c72e0-df5f-44ae-b131-f82461f27c89 tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:12:59.879153 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-4d0c72e0-df5f-44ae-b131-f82461f27c89 tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:12:59.879750 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-4d0c72e0-df5f-44ae-b131-f82461f27c89 tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:13:00.073173 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-681012d4-aa8f-4bd9-8fa2-2e6905e76469 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] 10.222.0.23 "POST /compute/v2.1/servers/c8c61fd5-2f2a-4cd9-a439-00943de4dda6/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.315076 Oct 13 13:13:00.073880 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 221/463] 10.222.0.23 () {60 vars in 1323 bytes} [Thu Oct 13 13:12:59 2022] POST /compute/v2.1/servers/c8c61fd5-2f2a-4cd9-a439-00943de4dda6/os-volume_attachments => generated 194 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 13:13:00.168718 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-4d0c72e0-df5f-44ae-b131-f82461f27c89 tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] 10.222.0.23 "POST /compute/v2.1/servers/59e81a58-9400-4cea-aa38-b24b394e33d7/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.302358 Oct 13 13:13:00.168718 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 243/464] 10.222.0.23 () {60 vars in 1323 bytes} [Thu Oct 13 13:12:59 2022] POST /compute/v2.1/servers/59e81a58-9400-4cea-aa38-b24b394e33d7/os-volume_attachments => generated 194 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 13 13:13:00.521857 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-61b2aa21-a4c2-43f2-9fe4-5f311bcb04e2 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Calling method '>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:13:00.521857 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-61b2aa21-a4c2-43f2-9fe4-5f311bcb04e2 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] [instance: 26bd475b-3495-4669-9985-d4a7dedb4bbf] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:13:00.527764 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-61b2aa21-a4c2-43f2-9fe4-5f311bcb04e2 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:13:00.528243 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-61b2aa21-a4c2-43f2-9fe4-5f311bcb04e2 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:13:00.528704 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-61b2aa21-a4c2-43f2-9fe4-5f311bcb04e2 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:13:00.529394 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-61b2aa21-a4c2-43f2-9fe4-5f311bcb04e2 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:13:00.529851 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-61b2aa21-a4c2-43f2-9fe4-5f311bcb04e2 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:13:00.530269 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-61b2aa21-a4c2-43f2-9fe4-5f311bcb04e2 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:13:00.668137 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-61b2aa21-a4c2-43f2-9fe4-5f311bcb04e2 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:13:00.677082 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-61b2aa21-a4c2-43f2-9fe4-5f311bcb04e2 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:13:00.678504 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-61b2aa21-a4c2-43f2-9fe4-5f311bcb04e2 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:13:00.679684 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-61b2aa21-a4c2-43f2-9fe4-5f311bcb04e2 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] 10.222.0.23 "GET /compute/v2.1/servers/26bd475b-3495-4669-9985-d4a7dedb4bbf" status: 200 len: 1809 microversion: 2.20 time: 0.164337 Oct 13 13:13:00.680231 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 222/465] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 13:13:00 2022] GET /compute/v2.1/servers/26bd475b-3495-4669-9985-d4a7dedb4bbf => generated 1809 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 13:13:01.706880 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-f28fe660-0923-493d-870a-fd6cdd2e7932 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Calling method '>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:13:01.707639 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-f28fe660-0923-493d-870a-fd6cdd2e7932 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] [instance: 26bd475b-3495-4669-9985-d4a7dedb4bbf] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:13:01.714523 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-f28fe660-0923-493d-870a-fd6cdd2e7932 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:13:01.715026 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-f28fe660-0923-493d-870a-fd6cdd2e7932 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:13:01.715475 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-f28fe660-0923-493d-870a-fd6cdd2e7932 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:13:01.716559 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-f28fe660-0923-493d-870a-fd6cdd2e7932 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:13:01.717020 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-f28fe660-0923-493d-870a-fd6cdd2e7932 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:13:01.717449 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-f28fe660-0923-493d-870a-fd6cdd2e7932 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:13:01.852220 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-f28fe660-0923-493d-870a-fd6cdd2e7932 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:13:01.860947 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-f28fe660-0923-493d-870a-fd6cdd2e7932 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:13:01.862933 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-f28fe660-0923-493d-870a-fd6cdd2e7932 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:13:01.864138 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-f28fe660-0923-493d-870a-fd6cdd2e7932 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] 10.222.0.23 "GET /compute/v2.1/servers/26bd475b-3495-4669-9985-d4a7dedb4bbf" status: 200 len: 1809 microversion: 2.20 time: 0.162016 Oct 13 13:13:01.864657 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 244/466] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 13:13:01 2022] GET /compute/v2.1/servers/26bd475b-3495-4669-9985-d4a7dedb4bbf => generated 1809 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 13:13:02.897413 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-fe25d508-04b9-4324-b909-97680628a0db tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Calling method '>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:13:02.898015 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-fe25d508-04b9-4324-b909-97680628a0db tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] [instance: 26bd475b-3495-4669-9985-d4a7dedb4bbf] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:13:02.904526 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-fe25d508-04b9-4324-b909-97680628a0db tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:13:02.905008 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-fe25d508-04b9-4324-b909-97680628a0db tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:13:02.905444 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-fe25d508-04b9-4324-b909-97680628a0db tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:13:02.906179 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-fe25d508-04b9-4324-b909-97680628a0db tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:13:02.906622 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-fe25d508-04b9-4324-b909-97680628a0db tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:13:02.907048 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-fe25d508-04b9-4324-b909-97680628a0db tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:13:03.036680 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-fe25d508-04b9-4324-b909-97680628a0db tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:13:03.045241 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-fe25d508-04b9-4324-b909-97680628a0db tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:13:03.046664 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-fe25d508-04b9-4324-b909-97680628a0db tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:13:03.047847 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-fe25d508-04b9-4324-b909-97680628a0db tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] 10.222.0.23 "GET /compute/v2.1/servers/26bd475b-3495-4669-9985-d4a7dedb4bbf" status: 200 len: 1809 microversion: 2.20 time: 0.154908 Oct 13 13:13:03.048401 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 223/467] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 13:13:02 2022] GET /compute/v2.1/servers/26bd475b-3495-4669-9985-d4a7dedb4bbf => generated 1809 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 13:13:04.073431 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-c9c76f6b-dc4e-408d-a5ca-09a2db3670e3 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Calling method '>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:13:04.074042 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-c9c76f6b-dc4e-408d-a5ca-09a2db3670e3 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] [instance: 26bd475b-3495-4669-9985-d4a7dedb4bbf] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:13:04.080527 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-c9c76f6b-dc4e-408d-a5ca-09a2db3670e3 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:13:04.081006 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-c9c76f6b-dc4e-408d-a5ca-09a2db3670e3 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:13:04.081443 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-c9c76f6b-dc4e-408d-a5ca-09a2db3670e3 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:13:04.082127 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-c9c76f6b-dc4e-408d-a5ca-09a2db3670e3 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:13:04.082579 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-c9c76f6b-dc4e-408d-a5ca-09a2db3670e3 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:13:04.083001 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-c9c76f6b-dc4e-408d-a5ca-09a2db3670e3 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:13:04.213168 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-c9c76f6b-dc4e-408d-a5ca-09a2db3670e3 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:13:04.221790 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-c9c76f6b-dc4e-408d-a5ca-09a2db3670e3 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:13:04.223307 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-c9c76f6b-dc4e-408d-a5ca-09a2db3670e3 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:13:04.224455 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-c9c76f6b-dc4e-408d-a5ca-09a2db3670e3 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] 10.222.0.23 "GET /compute/v2.1/servers/26bd475b-3495-4669-9985-d4a7dedb4bbf" status: 200 len: 1809 microversion: 2.20 time: 0.154948 Oct 13 13:13:04.225183 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 245/468] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 13:13:04 2022] GET /compute/v2.1/servers/26bd475b-3495-4669-9985-d4a7dedb4bbf => generated 1809 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 13:13:04.769340 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-c71b39fb-7b82-49c1-9955-f9574d56179d tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Calling method '>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:13:04.769822 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-c71b39fb-7b82-49c1-9955-f9574d56179d tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] [instance: e125ab44-9111-4260-909d-95d57b7861a7] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:13:04.776239 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-c71b39fb-7b82-49c1-9955-f9574d56179d tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:13:04.776712 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-c71b39fb-7b82-49c1-9955-f9574d56179d tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:13:04.777144 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-c71b39fb-7b82-49c1-9955-f9574d56179d tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:13:04.777821 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-c71b39fb-7b82-49c1-9955-f9574d56179d tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:13:04.778269 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-c71b39fb-7b82-49c1-9955-f9574d56179d tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:13:04.778688 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-c71b39fb-7b82-49c1-9955-f9574d56179d tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:13:04.905678 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.objects.instance [None req-c71b39fb-7b82-49c1-9955-f9574d56179d tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lazy-loading 'services' on Instance uuid e125ab44-9111-4260-909d-95d57b7861a7 {{(pid=118815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 13 13:13:05.015284 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-c71b39fb-7b82-49c1-9955-f9574d56179d tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] 10.222.0.23 "DELETE /compute/v2.1/servers/e125ab44-9111-4260-909d-95d57b7861a7/os-volume_attachments/56964fc7-faa8-4a52-bb6c-a0c3a8f69965" status: 202 len: 0 microversion: 2.1 time: 0.250057 Oct 13 13:13:05.016260 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 224/469] 10.222.0.23 () {58 vars in 1416 bytes} [Thu Oct 13 13:13:04 2022] DELETE /compute/v2.1/servers/e125ab44-9111-4260-909d-95d57b7861a7/os-volume_attachments/56964fc7-faa8-4a52-bb6c-a0c3a8f69965 => generated 0 bytes in 252 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 13 13:13:05.249731 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-48254c4a-cdc0-47f0-a84c-adfb959bce7b tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Calling method '>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:13:05.250300 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-48254c4a-cdc0-47f0-a84c-adfb959bce7b tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] [instance: 26bd475b-3495-4669-9985-d4a7dedb4bbf] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:13:05.257236 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-48254c4a-cdc0-47f0-a84c-adfb959bce7b tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:13:05.257716 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-48254c4a-cdc0-47f0-a84c-adfb959bce7b tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:13:05.258151 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-48254c4a-cdc0-47f0-a84c-adfb959bce7b tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:13:05.258838 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-48254c4a-cdc0-47f0-a84c-adfb959bce7b tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:13:05.259316 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-48254c4a-cdc0-47f0-a84c-adfb959bce7b tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:13:05.259771 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-48254c4a-cdc0-47f0-a84c-adfb959bce7b tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:13:05.386434 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-48254c4a-cdc0-47f0-a84c-adfb959bce7b tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:13:05.395045 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-48254c4a-cdc0-47f0-a84c-adfb959bce7b tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:13:05.396521 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-48254c4a-cdc0-47f0-a84c-adfb959bce7b tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:13:05.397679 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-48254c4a-cdc0-47f0-a84c-adfb959bce7b tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] 10.222.0.23 "GET /compute/v2.1/servers/26bd475b-3495-4669-9985-d4a7dedb4bbf" status: 200 len: 1809 microversion: 2.20 time: 0.151891 Oct 13 13:13:05.398227 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 246/470] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 13:13:05 2022] GET /compute/v2.1/servers/26bd475b-3495-4669-9985-d4a7dedb4bbf => generated 1809 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 13:13:06.423664 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-6b6d57be-bebf-4a9d-8e43-038e0709c13d tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Calling method '>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:13:06.424393 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-6b6d57be-bebf-4a9d-8e43-038e0709c13d tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] [instance: 26bd475b-3495-4669-9985-d4a7dedb4bbf] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:13:06.431412 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-6b6d57be-bebf-4a9d-8e43-038e0709c13d tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:13:06.431898 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-6b6d57be-bebf-4a9d-8e43-038e0709c13d tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:13:06.432337 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-6b6d57be-bebf-4a9d-8e43-038e0709c13d tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:13:06.433033 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-6b6d57be-bebf-4a9d-8e43-038e0709c13d tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:13:06.433484 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-6b6d57be-bebf-4a9d-8e43-038e0709c13d tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:13:06.433907 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-6b6d57be-bebf-4a9d-8e43-038e0709c13d tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:13:06.571010 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-6b6d57be-bebf-4a9d-8e43-038e0709c13d tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:13:06.580061 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-6b6d57be-bebf-4a9d-8e43-038e0709c13d tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:13:06.582298 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-6b6d57be-bebf-4a9d-8e43-038e0709c13d tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:13:06.583548 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-6b6d57be-bebf-4a9d-8e43-038e0709c13d tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] 10.222.0.23 "GET /compute/v2.1/servers/26bd475b-3495-4669-9985-d4a7dedb4bbf" status: 200 len: 1809 microversion: 2.20 time: 0.164385 Oct 13 13:13:06.584122 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 225/471] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 13:13:06 2022] GET /compute/v2.1/servers/26bd475b-3495-4669-9985-d4a7dedb4bbf => generated 1809 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 13:13:07.609576 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-91f62023-929d-401c-8135-17e94f3a1366 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Calling method '>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:13:07.610287 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-91f62023-929d-401c-8135-17e94f3a1366 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] [instance: 26bd475b-3495-4669-9985-d4a7dedb4bbf] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:13:07.619801 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-91f62023-929d-401c-8135-17e94f3a1366 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:13:07.620531 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-91f62023-929d-401c-8135-17e94f3a1366 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:13:07.621040 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-91f62023-929d-401c-8135-17e94f3a1366 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:13:07.621815 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-91f62023-929d-401c-8135-17e94f3a1366 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:13:07.622337 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-91f62023-929d-401c-8135-17e94f3a1366 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:13:07.622832 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-91f62023-929d-401c-8135-17e94f3a1366 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:13:07.755024 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-91f62023-929d-401c-8135-17e94f3a1366 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:13:07.763747 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-91f62023-929d-401c-8135-17e94f3a1366 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:13:07.765235 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-91f62023-929d-401c-8135-17e94f3a1366 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:13:07.766383 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-91f62023-929d-401c-8135-17e94f3a1366 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] 10.222.0.23 "GET /compute/v2.1/servers/26bd475b-3495-4669-9985-d4a7dedb4bbf" status: 200 len: 1809 microversion: 2.20 time: 0.160895 Oct 13 13:13:07.766943 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 247/472] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 13:13:07 2022] GET /compute/v2.1/servers/26bd475b-3495-4669-9985-d4a7dedb4bbf => generated 1809 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 13:13:08.792552 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-4d994c17-5cf4-47e8-8e4b-a387163ebe4f tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Calling method '>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:13:08.793162 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-4d994c17-5cf4-47e8-8e4b-a387163ebe4f tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] [instance: 26bd475b-3495-4669-9985-d4a7dedb4bbf] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:13:08.795589 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG dbcounter [-] [118815] Writing DB stats nova_cell0:SELECT=2 {{(pid=118815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:13:08.801210 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-4d994c17-5cf4-47e8-8e4b-a387163ebe4f tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:13:08.801685 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-4d994c17-5cf4-47e8-8e4b-a387163ebe4f tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:13:08.802122 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-4d994c17-5cf4-47e8-8e4b-a387163ebe4f tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:13:08.802807 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-4d994c17-5cf4-47e8-8e4b-a387163ebe4f tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:13:08.803296 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-4d994c17-5cf4-47e8-8e4b-a387163ebe4f tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:13:08.803723 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-4d994c17-5cf4-47e8-8e4b-a387163ebe4f tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:13:08.937266 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-4d994c17-5cf4-47e8-8e4b-a387163ebe4f tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:13:08.946389 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-4d994c17-5cf4-47e8-8e4b-a387163ebe4f tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:13:08.947867 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-4d994c17-5cf4-47e8-8e4b-a387163ebe4f tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:13:08.948997 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-4d994c17-5cf4-47e8-8e4b-a387163ebe4f tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] 10.222.0.23 "GET /compute/v2.1/servers/26bd475b-3495-4669-9985-d4a7dedb4bbf" status: 200 len: 1809 microversion: 2.20 time: 0.160369 Oct 13 13:13:08.949550 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 226/473] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 13:13:08 2022] GET /compute/v2.1/servers/26bd475b-3495-4669-9985-d4a7dedb4bbf => generated 1809 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 13:13:09.975624 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-a11b0276-a0bb-4efa-9998-e8e9854e4f40 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Calling method '>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:13:09.976816 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-a11b0276-a0bb-4efa-9998-e8e9854e4f40 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] [instance: 26bd475b-3495-4669-9985-d4a7dedb4bbf] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:13:09.979547 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG dbcounter [-] [118814] Writing DB stats nova_api:SELECT=82,nova_api:UPDATE=1 {{(pid=118814) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:13:09.985025 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-a11b0276-a0bb-4efa-9998-e8e9854e4f40 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:13:09.985522 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-a11b0276-a0bb-4efa-9998-e8e9854e4f40 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:13:09.985964 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-a11b0276-a0bb-4efa-9998-e8e9854e4f40 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:13:09.986896 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-a11b0276-a0bb-4efa-9998-e8e9854e4f40 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:13:09.987403 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-a11b0276-a0bb-4efa-9998-e8e9854e4f40 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:13:09.987834 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-a11b0276-a0bb-4efa-9998-e8e9854e4f40 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:13:10.056533 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [req-aec418d4-8339-4b85-bb4e-49e1d4c50ba7 req-46d0b171-e18c-4ab1-9673-a5143227f707 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "26bd475b-3495-4669-9985-d4a7dedb4bbf", "name": "network-vif-plugged", "status": "completed", "tag": "bd0eddba-ab0b-4c35-805b-853067734898"}]} {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 13:13:10.074525 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [req-aec418d4-8339-4b85-bb4e-49e1d4c50ba7 req-46d0b171-e18c-4ab1-9673-a5143227f707 service nova] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:13:10.075013 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [req-aec418d4-8339-4b85-bb4e-49e1d4c50ba7 req-46d0b171-e18c-4ab1-9673-a5143227f707 service nova] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:13:10.075471 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [req-aec418d4-8339-4b85-bb4e-49e1d4c50ba7 req-46d0b171-e18c-4ab1-9673-a5143227f707 service nova] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:13:10.087628 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.compute.server_external_events [req-aec418d4-8339-4b85-bb4e-49e1d4c50ba7 req-46d0b171-e18c-4ab1-9673-a5143227f707 service nova] Creating event network-vif-plugged:bd0eddba-ab0b-4c35-805b-853067734898 for instance 26bd475b-3495-4669-9985-d4a7dedb4bbf on hv-cinder-82660 Oct 13 13:13:10.092550 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [req-aec418d4-8339-4b85-bb4e-49e1d4c50ba7 req-46d0b171-e18c-4ab1-9673-a5143227f707 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039726 Oct 13 13:13:10.093420 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 227/474] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 13:13:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 13:13:10.121507 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-a11b0276-a0bb-4efa-9998-e8e9854e4f40 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:13:10.130301 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-a11b0276-a0bb-4efa-9998-e8e9854e4f40 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:13:10.131798 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-a11b0276-a0bb-4efa-9998-e8e9854e4f40 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:13:10.132953 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-a11b0276-a0bb-4efa-9998-e8e9854e4f40 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] 10.222.0.23 "GET /compute/v2.1/servers/26bd475b-3495-4669-9985-d4a7dedb4bbf" status: 200 len: 1809 microversion: 2.20 time: 0.162016 Oct 13 13:13:10.133507 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 248/475] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 13:13:09 2022] GET /compute/v2.1/servers/26bd475b-3495-4669-9985-d4a7dedb4bbf => generated 1809 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 13:13:11.159431 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-8cc7a806-c831-4489-af26-d4b577a12910 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Calling method '>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:13:11.160127 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-8cc7a806-c831-4489-af26-d4b577a12910 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] [instance: 26bd475b-3495-4669-9985-d4a7dedb4bbf] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:13:11.166669 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-8cc7a806-c831-4489-af26-d4b577a12910 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:13:11.167192 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-8cc7a806-c831-4489-af26-d4b577a12910 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:13:11.167641 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-8cc7a806-c831-4489-af26-d4b577a12910 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:13:11.168332 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-8cc7a806-c831-4489-af26-d4b577a12910 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:13:11.168789 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-8cc7a806-c831-4489-af26-d4b577a12910 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:13:11.169214 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-8cc7a806-c831-4489-af26-d4b577a12910 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:13:11.297674 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-8cc7a806-c831-4489-af26-d4b577a12910 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:13:11.308132 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-8cc7a806-c831-4489-af26-d4b577a12910 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:13:11.309596 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-8cc7a806-c831-4489-af26-d4b577a12910 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:13:11.310755 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-8cc7a806-c831-4489-af26-d4b577a12910 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] 10.222.0.23 "GET /compute/v2.1/servers/26bd475b-3495-4669-9985-d4a7dedb4bbf" status: 200 len: 1809 microversion: 2.20 time: 0.156137 Oct 13 13:13:11.311343 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 228/476] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 13:13:11 2022] GET /compute/v2.1/servers/26bd475b-3495-4669-9985-d4a7dedb4bbf => generated 1809 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 13:13:12.335826 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-011e7d7c-3154-450a-87cd-ead0e4c3e9ce tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Calling method '>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:13:12.336432 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-011e7d7c-3154-450a-87cd-ead0e4c3e9ce tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] [instance: 26bd475b-3495-4669-9985-d4a7dedb4bbf] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:13:12.343071 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-011e7d7c-3154-450a-87cd-ead0e4c3e9ce tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:13:12.343566 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-011e7d7c-3154-450a-87cd-ead0e4c3e9ce tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:13:12.344003 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-011e7d7c-3154-450a-87cd-ead0e4c3e9ce tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:13:12.344713 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-011e7d7c-3154-450a-87cd-ead0e4c3e9ce tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:13:12.345184 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-011e7d7c-3154-450a-87cd-ead0e4c3e9ce tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:13:12.345659 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-011e7d7c-3154-450a-87cd-ead0e4c3e9ce tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:13:12.476699 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-011e7d7c-3154-450a-87cd-ead0e4c3e9ce tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:13:12.485193 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-011e7d7c-3154-450a-87cd-ead0e4c3e9ce tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:13:12.487167 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-011e7d7c-3154-450a-87cd-ead0e4c3e9ce tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:13:12.488303 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-011e7d7c-3154-450a-87cd-ead0e4c3e9ce tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] 10.222.0.23 "GET /compute/v2.1/servers/26bd475b-3495-4669-9985-d4a7dedb4bbf" status: 200 len: 1809 microversion: 2.20 time: 0.156398 Oct 13 13:13:12.488842 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 249/477] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 13:13:12 2022] GET /compute/v2.1/servers/26bd475b-3495-4669-9985-d4a7dedb4bbf => generated 1809 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 13:13:13.514547 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-30d4a5b2-3d9e-4313-9036-5bfb6cc4b23b tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Calling method '>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:13:13.515259 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-30d4a5b2-3d9e-4313-9036-5bfb6cc4b23b tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] [instance: 26bd475b-3495-4669-9985-d4a7dedb4bbf] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:13:13.518353 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG dbcounter [-] [118815] Writing DB stats nova_api:SELECT=74 {{(pid=118815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:13:13.523640 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-30d4a5b2-3d9e-4313-9036-5bfb6cc4b23b tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:13:13.524137 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-30d4a5b2-3d9e-4313-9036-5bfb6cc4b23b tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:13:13.524535 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-30d4a5b2-3d9e-4313-9036-5bfb6cc4b23b tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:13:13.525221 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-30d4a5b2-3d9e-4313-9036-5bfb6cc4b23b tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:13:13.525666 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-30d4a5b2-3d9e-4313-9036-5bfb6cc4b23b tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:13:13.526083 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-30d4a5b2-3d9e-4313-9036-5bfb6cc4b23b tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:13:13.652701 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-30d4a5b2-3d9e-4313-9036-5bfb6cc4b23b tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:13:13.661306 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-30d4a5b2-3d9e-4313-9036-5bfb6cc4b23b tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:13:13.662762 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-30d4a5b2-3d9e-4313-9036-5bfb6cc4b23b tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:13:13.663945 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-30d4a5b2-3d9e-4313-9036-5bfb6cc4b23b tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] 10.222.0.23 "GET /compute/v2.1/servers/26bd475b-3495-4669-9985-d4a7dedb4bbf" status: 200 len: 1809 microversion: 2.20 time: 0.154156 Oct 13 13:13:13.664499 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 229/478] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 13:13:13 2022] GET /compute/v2.1/servers/26bd475b-3495-4669-9985-d4a7dedb4bbf => generated 1809 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 13:13:14.689666 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-94a4c4d6-18ae-4040-b16a-0a6d39d566b7 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Calling method '>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:13:14.690302 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-94a4c4d6-18ae-4040-b16a-0a6d39d566b7 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] [instance: 26bd475b-3495-4669-9985-d4a7dedb4bbf] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:13:14.696688 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-94a4c4d6-18ae-4040-b16a-0a6d39d566b7 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:13:14.697167 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-94a4c4d6-18ae-4040-b16a-0a6d39d566b7 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:13:14.697607 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-94a4c4d6-18ae-4040-b16a-0a6d39d566b7 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:13:14.698290 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-94a4c4d6-18ae-4040-b16a-0a6d39d566b7 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:13:14.698742 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-94a4c4d6-18ae-4040-b16a-0a6d39d566b7 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:13:14.699195 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-94a4c4d6-18ae-4040-b16a-0a6d39d566b7 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:13:14.827393 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-94a4c4d6-18ae-4040-b16a-0a6d39d566b7 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:13:14.836779 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-94a4c4d6-18ae-4040-b16a-0a6d39d566b7 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:13:14.838264 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-94a4c4d6-18ae-4040-b16a-0a6d39d566b7 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:13:14.839494 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-94a4c4d6-18ae-4040-b16a-0a6d39d566b7 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] 10.222.0.23 "GET /compute/v2.1/servers/26bd475b-3495-4669-9985-d4a7dedb4bbf" status: 200 len: 1809 microversion: 2.20 time: 0.153675 Oct 13 13:13:14.840040 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 250/479] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 13:13:14 2022] GET /compute/v2.1/servers/26bd475b-3495-4669-9985-d4a7dedb4bbf => generated 1809 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 13:13:15.865168 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-5237d719-edb3-4c51-9d7a-fed3774ba13d tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Calling method '>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:13:15.865747 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-5237d719-edb3-4c51-9d7a-fed3774ba13d tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] [instance: 26bd475b-3495-4669-9985-d4a7dedb4bbf] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:13:15.872255 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-5237d719-edb3-4c51-9d7a-fed3774ba13d tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:13:15.872825 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-5237d719-edb3-4c51-9d7a-fed3774ba13d tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:13:15.873208 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-5237d719-edb3-4c51-9d7a-fed3774ba13d tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:13:15.873905 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-5237d719-edb3-4c51-9d7a-fed3774ba13d tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:13:15.874339 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-5237d719-edb3-4c51-9d7a-fed3774ba13d tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:13:15.874766 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-5237d719-edb3-4c51-9d7a-fed3774ba13d tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:13:16.005809 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-5237d719-edb3-4c51-9d7a-fed3774ba13d tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:13:16.014280 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-5237d719-edb3-4c51-9d7a-fed3774ba13d tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:13:16.015802 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-5237d719-edb3-4c51-9d7a-fed3774ba13d tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:13:16.016955 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-5237d719-edb3-4c51-9d7a-fed3774ba13d tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] 10.222.0.23 "GET /compute/v2.1/servers/26bd475b-3495-4669-9985-d4a7dedb4bbf" status: 200 len: 1809 microversion: 2.20 time: 0.156128 Oct 13 13:13:16.018349 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 230/480] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 13:13:15 2022] GET /compute/v2.1/servers/26bd475b-3495-4669-9985-d4a7dedb4bbf => generated 1809 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 13:13:17.044246 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-82ccf0d3-6b8f-4801-88da-0e02eb1436b0 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Calling method '>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:13:17.044858 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-82ccf0d3-6b8f-4801-88da-0e02eb1436b0 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] [instance: 26bd475b-3495-4669-9985-d4a7dedb4bbf] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:13:17.050959 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-82ccf0d3-6b8f-4801-88da-0e02eb1436b0 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:13:17.051478 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-82ccf0d3-6b8f-4801-88da-0e02eb1436b0 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:13:17.051915 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-82ccf0d3-6b8f-4801-88da-0e02eb1436b0 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:13:17.052603 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-82ccf0d3-6b8f-4801-88da-0e02eb1436b0 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:13:17.053056 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-82ccf0d3-6b8f-4801-88da-0e02eb1436b0 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:13:17.053480 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-82ccf0d3-6b8f-4801-88da-0e02eb1436b0 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:13:17.182741 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-82ccf0d3-6b8f-4801-88da-0e02eb1436b0 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:13:17.191778 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-82ccf0d3-6b8f-4801-88da-0e02eb1436b0 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:13:17.193235 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-82ccf0d3-6b8f-4801-88da-0e02eb1436b0 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:13:17.194390 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-82ccf0d3-6b8f-4801-88da-0e02eb1436b0 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] 10.222.0.23 "GET /compute/v2.1/servers/26bd475b-3495-4669-9985-d4a7dedb4bbf" status: 200 len: 1796 microversion: 2.20 time: 0.154549 Oct 13 13:13:17.203113 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 251/481] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 13:13:17 2022] GET /compute/v2.1/servers/26bd475b-3495-4669-9985-d4a7dedb4bbf => generated 1796 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 13:13:17.275843 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-29361f3f-6320-478a-80c8-08304a616d3c tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Calling method '>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:13:17.277738 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-29361f3f-6320-478a-80c8-08304a616d3c tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] [instance: 59e81a58-9400-4cea-aa38-b24b394e33d7] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:13:17.280268 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 13 13:13:17.280420 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: Thu Oct 13 13:13:17 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/59e81a58-9400-4cea-aa38-b24b394e33d7 (ip 10.222.0.23) !!! Oct 13 13:13:17.294456 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-29361f3f-6320-478a-80c8-08304a616d3c tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:13:17.294938 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-29361f3f-6320-478a-80c8-08304a616d3c tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:13:17.298031 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-29361f3f-6320-478a-80c8-08304a616d3c tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:13:17.298031 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-29361f3f-6320-478a-80c8-08304a616d3c tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:13:17.298031 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-29361f3f-6320-478a-80c8-08304a616d3c tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:13:17.298031 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-29361f3f-6320-478a-80c8-08304a616d3c tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:13:17.427530 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-29361f3f-6320-478a-80c8-08304a616d3c tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d89667e52b24295ba619203c02c7bd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed5038c799342d48edc980983f1d996', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:13:17.435654 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-29361f3f-6320-478a-80c8-08304a616d3c tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] 10.222.0.23 "GET /compute/v2.1/servers/59e81a58-9400-4cea-aa38-b24b394e33d7" status: 200 len: 1593 microversion: 2.1 time: 0.164791 Oct 13 13:13:17.436228 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 231/482] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:13:17 2022] GET /compute/v2.1/servers/59e81a58-9400-4cea-aa38-b24b394e33d7 => generated 1593 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:13:17.794914 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-987ef879-e1bc-48ca-8d56-2e27e8a8acdb tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 13:13:17.802218 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-987ef879-e1bc-48ca-8d56-2e27e8a8acdb tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:13:17.802791 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-987ef879-e1bc-48ca-8d56-2e27e8a8acdb tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:13:17.803374 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-987ef879-e1bc-48ca-8d56-2e27e8a8acdb tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:13:17.862679 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-987ef879-e1bc-48ca-8d56-2e27e8a8acdb tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] [instance: e125ab44-9111-4260-909d-95d57b7861a7] Going to try to stop instance {{(pid=118814) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 13 13:13:17.906417 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-987ef879-e1bc-48ca-8d56-2e27e8a8acdb tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] 10.222.0.23 "POST /compute/v2.1/servers/e125ab44-9111-4260-909d-95d57b7861a7/action" status: 202 len: 0 microversion: 2.1 time: 0.115218 Oct 13 13:13:17.907424 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 252/483] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Oct 13 13:13:17 2022] POST /compute/v2.1/servers/e125ab44-9111-4260-909d-95d57b7861a7/action => generated 0 bytes in 117 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 13 13:13:17.922592 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-dce55368-186d-4a9c-bdb1-69ee48d48d28 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Calling method '>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:13:17.923468 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-dce55368-186d-4a9c-bdb1-69ee48d48d28 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] [instance: e125ab44-9111-4260-909d-95d57b7861a7] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:13:17.930466 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-dce55368-186d-4a9c-bdb1-69ee48d48d28 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:13:17.930951 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-dce55368-186d-4a9c-bdb1-69ee48d48d28 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:13:17.931702 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-dce55368-186d-4a9c-bdb1-69ee48d48d28 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:13:17.932396 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-dce55368-186d-4a9c-bdb1-69ee48d48d28 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:13:17.932918 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-dce55368-186d-4a9c-bdb1-69ee48d48d28 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:13:17.933251 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-dce55368-186d-4a9c-bdb1-69ee48d48d28 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:13:18.071141 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-dce55368-186d-4a9c-bdb1-69ee48d48d28 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e783caddcad473dbdd764919286e244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecd3d5d2a3a54a07ba64f1fea4846c40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:13:18.078936 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-dce55368-186d-4a9c-bdb1-69ee48d48d28 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] 10.222.0.23 "GET /compute/v2.1/servers/e125ab44-9111-4260-909d-95d57b7861a7" status: 200 len: 1678 microversion: 2.1 time: 0.166891 Oct 13 13:13:18.079596 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 232/484] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:13:17 2022] GET /compute/v2.1/servers/e125ab44-9111-4260-909d-95d57b7861a7 => generated 1678 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:13:19.102480 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-8d70144a-cd29-46ce-81cc-a230794c632e tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Calling method '>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:13:19.103262 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-8d70144a-cd29-46ce-81cc-a230794c632e tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] [instance: e125ab44-9111-4260-909d-95d57b7861a7] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:13:19.110183 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-8d70144a-cd29-46ce-81cc-a230794c632e tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:13:19.110673 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-8d70144a-cd29-46ce-81cc-a230794c632e tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:13:19.111643 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-8d70144a-cd29-46ce-81cc-a230794c632e tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:13:19.112351 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-8d70144a-cd29-46ce-81cc-a230794c632e tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:13:19.112806 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-8d70144a-cd29-46ce-81cc-a230794c632e tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:13:19.113228 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-8d70144a-cd29-46ce-81cc-a230794c632e tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:13:19.253920 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-8d70144a-cd29-46ce-81cc-a230794c632e tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e783caddcad473dbdd764919286e244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecd3d5d2a3a54a07ba64f1fea4846c40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:13:19.261639 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-8d70144a-cd29-46ce-81cc-a230794c632e tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] 10.222.0.23 "GET /compute/v2.1/servers/e125ab44-9111-4260-909d-95d57b7861a7" status: 200 len: 1678 microversion: 2.1 time: 0.163433 Oct 13 13:13:19.262197 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 253/485] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:13:19 2022] GET /compute/v2.1/servers/e125ab44-9111-4260-909d-95d57b7861a7 => generated 1678 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:13:19.350466 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [req-c3f6b590-6812-46c1-a583-aade66f40692 req-5f643007-cf36-47f8-92c9-504946c78982 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "59e81a58-9400-4cea-aa38-b24b394e33d7", "tag": "5e82a763-989b-4ba3-b2d2-7ad17b260a77"}]} {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 13:13:19.360513 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [req-c3f6b590-6812-46c1-a583-aade66f40692 req-5f643007-cf36-47f8-92c9-504946c78982 service nova] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:13:19.361588 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [req-c3f6b590-6812-46c1-a583-aade66f40692 req-5f643007-cf36-47f8-92c9-504946c78982 service nova] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:13:19.362031 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [req-c3f6b590-6812-46c1-a583-aade66f40692 req-5f643007-cf36-47f8-92c9-504946c78982 service nova] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:13:19.377008 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.compute.server_external_events [req-c3f6b590-6812-46c1-a583-aade66f40692 req-5f643007-cf36-47f8-92c9-504946c78982 service nova] Creating event network-changed:5e82a763-989b-4ba3-b2d2-7ad17b260a77 for instance 59e81a58-9400-4cea-aa38-b24b394e33d7 on hv-cinder-82660 Oct 13 13:13:19.381902 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [req-c3f6b590-6812-46c1-a583-aade66f40692 req-5f643007-cf36-47f8-92c9-504946c78982 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035209 Oct 13 13:13:19.382501 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 233/486] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 13:13:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 13:13:19.458180 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-20c6ae37-b745-4eac-9401-a4ed191d5737 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Calling method '>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:13:19.458957 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-20c6ae37-b745-4eac-9401-a4ed191d5737 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] [instance: c8c61fd5-2f2a-4cd9-a439-00943de4dda6] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:13:19.466223 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-20c6ae37-b745-4eac-9401-a4ed191d5737 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:13:19.466931 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-20c6ae37-b745-4eac-9401-a4ed191d5737 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:13:19.467653 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-20c6ae37-b745-4eac-9401-a4ed191d5737 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:13:19.468438 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-20c6ae37-b745-4eac-9401-a4ed191d5737 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:13:19.469010 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-20c6ae37-b745-4eac-9401-a4ed191d5737 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:13:19.469689 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-20c6ae37-b745-4eac-9401-a4ed191d5737 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:13:19.592216 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.objects.instance [None req-20c6ae37-b745-4eac-9401-a4ed191d5737 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Lazy-loading 'services' on Instance uuid c8c61fd5-2f2a-4cd9-a439-00943de4dda6 {{(pid=118814) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 13 13:13:19.693577 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-20c6ae37-b745-4eac-9401-a4ed191d5737 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] 10.222.0.23 "DELETE /compute/v2.1/servers/c8c61fd5-2f2a-4cd9-a439-00943de4dda6/os-volume_attachments/b5305ded-7dd5-4455-bcd6-409d587a59e0" status: 202 len: 0 microversion: 2.1 time: 0.239454 Oct 13 13:13:19.698210 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 254/487] 10.222.0.23 () {58 vars in 1416 bytes} [Thu Oct 13 13:13:19 2022] DELETE /compute/v2.1/servers/c8c61fd5-2f2a-4cd9-a439-00943de4dda6/os-volume_attachments/b5305ded-7dd5-4455-bcd6-409d587a59e0 => generated 0 bytes in 242 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 13 13:13:20.285815 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-1ec1e7df-339d-467b-9e93-a5fd9f51a0fc tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Calling method '>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:13:20.286506 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-1ec1e7df-339d-467b-9e93-a5fd9f51a0fc tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] [instance: e125ab44-9111-4260-909d-95d57b7861a7] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:13:20.292750 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-1ec1e7df-339d-467b-9e93-a5fd9f51a0fc tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:13:20.293434 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-1ec1e7df-339d-467b-9e93-a5fd9f51a0fc tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:13:20.293868 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-1ec1e7df-339d-467b-9e93-a5fd9f51a0fc tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:13:20.294726 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-1ec1e7df-339d-467b-9e93-a5fd9f51a0fc tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:13:20.295362 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-1ec1e7df-339d-467b-9e93-a5fd9f51a0fc tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:13:20.295930 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-1ec1e7df-339d-467b-9e93-a5fd9f51a0fc tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:13:20.486341 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-1ec1e7df-339d-467b-9e93-a5fd9f51a0fc tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e783caddcad473dbdd764919286e244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecd3d5d2a3a54a07ba64f1fea4846c40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:13:20.497130 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-1ec1e7df-339d-467b-9e93-a5fd9f51a0fc tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] 10.222.0.23 "GET /compute/v2.1/servers/e125ab44-9111-4260-909d-95d57b7861a7" status: 200 len: 1678 microversion: 2.1 time: 0.215799 Oct 13 13:13:20.498640 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 234/488] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:13:20 2022] GET /compute/v2.1/servers/e125ab44-9111-4260-909d-95d57b7861a7 => generated 1678 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:13:20.754256 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-2b48b369-490e-4fcf-8805-f8fa5670b1bd tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-180345211"}} {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 13:13:20.754866 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-2b48b369-490e-4fcf-8805-f8fa5670b1bd tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] [instance: 59e81a58-9400-4cea-aa38-b24b394e33d7] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:13:20.761710 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-2b48b369-490e-4fcf-8805-f8fa5670b1bd tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:13:20.762215 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-2b48b369-490e-4fcf-8805-f8fa5670b1bd tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:13:20.762642 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-2b48b369-490e-4fcf-8805-f8fa5670b1bd tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:13:20.763374 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-2b48b369-490e-4fcf-8805-f8fa5670b1bd tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:13:20.763823 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-2b48b369-490e-4fcf-8805-f8fa5670b1bd tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:13:20.764245 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-2b48b369-490e-4fcf-8805-f8fa5670b1bd tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:13:20.858949 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-dd10eca3-4a9d-4471-b755-c091a15d49f3 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Calling method '>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:13:20.859475 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-dd10eca3-4a9d-4471-b755-c091a15d49f3 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] [instance: c8c61fd5-2f2a-4cd9-a439-00943de4dda6] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:13:20.865340 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-dd10eca3-4a9d-4471-b755-c091a15d49f3 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:13:20.865824 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-dd10eca3-4a9d-4471-b755-c091a15d49f3 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:13:20.866259 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-dd10eca3-4a9d-4471-b755-c091a15d49f3 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:13:20.866948 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-dd10eca3-4a9d-4471-b755-c091a15d49f3 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:13:20.867437 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-dd10eca3-4a9d-4471-b755-c091a15d49f3 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:13:20.867864 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-dd10eca3-4a9d-4471-b755-c091a15d49f3 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:13:20.893148 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.network.security_group_api [None req-2b48b369-490e-4fcf-8805-f8fa5670b1bd tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Adding security group 3803a510-33fe-4754-8fcc-b9e1875f1efa to port 5e82a763-989b-4ba3-b2d2-7ad17b260a77 Oct 13 13:13:20.893295 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-dd10eca3-4a9d-4471-b755-c091a15d49f3 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] [instance: c8c61fd5-2f2a-4cd9-a439-00943de4dda6] Going to try to terminate instance {{(pid=118815) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 13 13:13:20.907791 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG dbcounter [-] [118815] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=118815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:13:20.972757 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-dd10eca3-4a9d-4471-b755-c091a15d49f3 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] 10.222.0.23 "DELETE /compute/v2.1/servers/c8c61fd5-2f2a-4cd9-a439-00943de4dda6" status: 204 len: 0 microversion: 2.1 time: 0.117115 Oct 13 13:13:20.973435 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 235/489] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Oct 13 13:13:20 2022] DELETE /compute/v2.1/servers/c8c61fd5-2f2a-4cd9-a439-00943de4dda6 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 13 13:13:20.984937 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-636032d7-d1d6-4ace-aa59-d7a6cea39601 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Calling method '>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:13:20.985753 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-636032d7-d1d6-4ace-aa59-d7a6cea39601 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] [instance: c8c61fd5-2f2a-4cd9-a439-00943de4dda6] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:13:20.992074 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-636032d7-d1d6-4ace-aa59-d7a6cea39601 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:13:20.992892 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-636032d7-d1d6-4ace-aa59-d7a6cea39601 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:13:20.993021 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-636032d7-d1d6-4ace-aa59-d7a6cea39601 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:13:20.993652 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-636032d7-d1d6-4ace-aa59-d7a6cea39601 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:13:20.994099 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-636032d7-d1d6-4ace-aa59-d7a6cea39601 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:13:20.994520 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-636032d7-d1d6-4ace-aa59-d7a6cea39601 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:13:21.227142 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-636032d7-d1d6-4ace-aa59-d7a6cea39601 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8569afc405f24a0993a023c818a0c272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f85144e13e254365a86aa785093c8575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:13:21.234728 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-636032d7-d1d6-4ace-aa59-d7a6cea39601 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c61fd5-2f2a-4cd9-a439-00943de4dda6" status: 200 len: 1513 microversion: 2.1 time: 0.256022 Oct 13 13:13:21.235334 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 236/490] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:13:20 2022] GET /compute/v2.1/servers/c8c61fd5-2f2a-4cd9-a439-00943de4dda6 => generated 1513 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 13:13:21.318004 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-2b48b369-490e-4fcf-8805-f8fa5670b1bd tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] 10.222.0.23 "POST /compute/v2.1/servers/59e81a58-9400-4cea-aa38-b24b394e33d7/action" status: 202 len: 0 microversion: 2.1 time: 0.568629 Oct 13 13:13:21.318606 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 255/491] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Oct 13 13:13:20 2022] POST /compute/v2.1/servers/59e81a58-9400-4cea-aa38-b24b394e33d7/action => generated 0 bytes in 570 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 13 13:13:21.326405 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [req-614edda0-cd40-4a52-a421-df3c2df0cbe6 req-78192c2a-294c-45c6-96e4-2a95a536af89 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "59e81a58-9400-4cea-aa38-b24b394e33d7", "tag": "5e82a763-989b-4ba3-b2d2-7ad17b260a77"}]} {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 13:13:21.337675 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-595de7aa-ce3d-4a81-b565-cbe16493b754 tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Calling method '>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:13:21.338521 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-595de7aa-ce3d-4a81-b565-cbe16493b754 tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] [instance: 59e81a58-9400-4cea-aa38-b24b394e33d7] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:13:21.347493 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [req-614edda0-cd40-4a52-a421-df3c2df0cbe6 req-78192c2a-294c-45c6-96e4-2a95a536af89 service nova] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:13:21.347905 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [req-614edda0-cd40-4a52-a421-df3c2df0cbe6 req-78192c2a-294c-45c6-96e4-2a95a536af89 service nova] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:13:21.348338 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [req-614edda0-cd40-4a52-a421-df3c2df0cbe6 req-78192c2a-294c-45c6-96e4-2a95a536af89 service nova] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:13:21.353097 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-595de7aa-ce3d-4a81-b565-cbe16493b754 tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:13:21.353534 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-595de7aa-ce3d-4a81-b565-cbe16493b754 tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:13:21.353975 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-595de7aa-ce3d-4a81-b565-cbe16493b754 tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:13:21.355092 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-595de7aa-ce3d-4a81-b565-cbe16493b754 tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:13:21.355209 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-595de7aa-ce3d-4a81-b565-cbe16493b754 tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:13:21.355565 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-595de7aa-ce3d-4a81-b565-cbe16493b754 tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:13:21.367664 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG dbcounter [-] [118814] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=118814) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:13:21.374420 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.compute.server_external_events [req-614edda0-cd40-4a52-a421-df3c2df0cbe6 req-78192c2a-294c-45c6-96e4-2a95a536af89 service nova] Creating event network-changed:5e82a763-989b-4ba3-b2d2-7ad17b260a77 for instance 59e81a58-9400-4cea-aa38-b24b394e33d7 on hv-cinder-82660 Oct 13 13:13:21.386998 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [req-614edda0-cd40-4a52-a421-df3c2df0cbe6 req-78192c2a-294c-45c6-96e4-2a95a536af89 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062637 Oct 13 13:13:21.388591 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 237/492] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 13:13:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 13:13:21.516917 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-595de7aa-ce3d-4a81-b565-cbe16493b754 tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d89667e52b24295ba619203c02c7bd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed5038c799342d48edc980983f1d996', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:13:21.522464 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-c9de8ee0-a189-4da9-926a-517eb67c1ecf tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Calling method '>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:13:21.523666 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-c9de8ee0-a189-4da9-926a-517eb67c1ecf tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] [instance: e125ab44-9111-4260-909d-95d57b7861a7] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:13:21.526452 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-595de7aa-ce3d-4a81-b565-cbe16493b754 tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] 10.222.0.23 "GET /compute/v2.1/servers/59e81a58-9400-4cea-aa38-b24b394e33d7" status: 200 len: 1757 microversion: 2.1 time: 0.192955 Oct 13 13:13:21.527238 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 256/493] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:13:21 2022] GET /compute/v2.1/servers/59e81a58-9400-4cea-aa38-b24b394e33d7 => generated 1757 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:13:21.530625 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-c9de8ee0-a189-4da9-926a-517eb67c1ecf tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:13:21.530789 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-c9de8ee0-a189-4da9-926a-517eb67c1ecf tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:13:21.531141 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-c9de8ee0-a189-4da9-926a-517eb67c1ecf tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:13:21.531847 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-c9de8ee0-a189-4da9-926a-517eb67c1ecf tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:13:21.532306 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-c9de8ee0-a189-4da9-926a-517eb67c1ecf tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:13:21.533569 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-c9de8ee0-a189-4da9-926a-517eb67c1ecf tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:13:21.671070 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-c9de8ee0-a189-4da9-926a-517eb67c1ecf tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e783caddcad473dbdd764919286e244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecd3d5d2a3a54a07ba64f1fea4846c40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:13:21.679986 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-c9de8ee0-a189-4da9-926a-517eb67c1ecf tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] 10.222.0.23 "GET /compute/v2.1/servers/e125ab44-9111-4260-909d-95d57b7861a7" status: 200 len: 1678 microversion: 2.1 time: 0.161749 Oct 13 13:13:21.680565 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 238/494] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:13:21 2022] GET /compute/v2.1/servers/e125ab44-9111-4260-909d-95d57b7861a7 => generated 1678 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 13:13:22.258623 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-12ce0e27-e9bd-41ba-9211-9ca62d5841ed tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Calling method '>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:13:22.259176 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-12ce0e27-e9bd-41ba-9211-9ca62d5841ed tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] [instance: c8c61fd5-2f2a-4cd9-a439-00943de4dda6] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:13:22.265508 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-12ce0e27-e9bd-41ba-9211-9ca62d5841ed tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:13:22.265982 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-12ce0e27-e9bd-41ba-9211-9ca62d5841ed tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:13:22.266412 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-12ce0e27-e9bd-41ba-9211-9ca62d5841ed tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:13:22.267148 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-12ce0e27-e9bd-41ba-9211-9ca62d5841ed tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:13:22.267595 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-12ce0e27-e9bd-41ba-9211-9ca62d5841ed tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:13:22.268013 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-12ce0e27-e9bd-41ba-9211-9ca62d5841ed tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:13:22.392791 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-12ce0e27-e9bd-41ba-9211-9ca62d5841ed tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8569afc405f24a0993a023c818a0c272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f85144e13e254365a86aa785093c8575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:13:22.400493 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-12ce0e27-e9bd-41ba-9211-9ca62d5841ed tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c61fd5-2f2a-4cd9-a439-00943de4dda6" status: 200 len: 1513 microversion: 2.1 time: 0.145801 Oct 13 13:13:22.401052 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 257/495] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:13:22 2022] GET /compute/v2.1/servers/c8c61fd5-2f2a-4cd9-a439-00943de4dda6 => generated 1513 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:13:22.702767 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-76ab1022-06cb-43d4-aa90-a5063f16c46d tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Calling method '>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:13:22.703409 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-76ab1022-06cb-43d4-aa90-a5063f16c46d tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] [instance: e125ab44-9111-4260-909d-95d57b7861a7] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:13:22.710229 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-76ab1022-06cb-43d4-aa90-a5063f16c46d tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:13:22.710712 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-76ab1022-06cb-43d4-aa90-a5063f16c46d tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:13:22.711177 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-76ab1022-06cb-43d4-aa90-a5063f16c46d tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:13:22.711858 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-76ab1022-06cb-43d4-aa90-a5063f16c46d tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:13:22.712313 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-76ab1022-06cb-43d4-aa90-a5063f16c46d tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:13:22.712738 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-76ab1022-06cb-43d4-aa90-a5063f16c46d tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:13:22.847468 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-76ab1022-06cb-43d4-aa90-a5063f16c46d tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e783caddcad473dbdd764919286e244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecd3d5d2a3a54a07ba64f1fea4846c40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:13:22.855510 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-76ab1022-06cb-43d4-aa90-a5063f16c46d tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] 10.222.0.23 "GET /compute/v2.1/servers/e125ab44-9111-4260-909d-95d57b7861a7" status: 200 len: 1678 microversion: 2.1 time: 0.156516 Oct 13 13:13:22.856073 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 239/496] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:13:22 2022] GET /compute/v2.1/servers/e125ab44-9111-4260-909d-95d57b7861a7 => generated 1678 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:13:23.424267 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-0942d6f9-a449-4b20-b888-16e111adc935 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Calling method '>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:13:23.425001 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-0942d6f9-a449-4b20-b888-16e111adc935 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] [instance: c8c61fd5-2f2a-4cd9-a439-00943de4dda6] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:13:23.431900 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-0942d6f9-a449-4b20-b888-16e111adc935 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:13:23.432347 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-0942d6f9-a449-4b20-b888-16e111adc935 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:13:23.432783 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-0942d6f9-a449-4b20-b888-16e111adc935 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:13:23.433479 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-0942d6f9-a449-4b20-b888-16e111adc935 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:13:23.433932 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-0942d6f9-a449-4b20-b888-16e111adc935 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:13:23.434353 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-0942d6f9-a449-4b20-b888-16e111adc935 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:13:23.562240 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-0942d6f9-a449-4b20-b888-16e111adc935 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8569afc405f24a0993a023c818a0c272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f85144e13e254365a86aa785093c8575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:13:23.570201 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-0942d6f9-a449-4b20-b888-16e111adc935 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c61fd5-2f2a-4cd9-a439-00943de4dda6" status: 200 len: 1513 microversion: 2.1 time: 0.150277 Oct 13 13:13:23.570761 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 258/497] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:13:23 2022] GET /compute/v2.1/servers/c8c61fd5-2f2a-4cd9-a439-00943de4dda6 => generated 1513 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:13:23.859793 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [req-2d2f1c1b-d347-481c-aca6-93678a4c6c98 req-3d0e3930-0d05-4515-8034-5c214b7a5280 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c8c61fd5-2f2a-4cd9-a439-00943de4dda6", "name": "network-vif-deleted", "tag": "47c8bf5c-a500-440a-a247-090d3dbe386b"}]} {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 13:13:23.870580 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [req-2d2f1c1b-d347-481c-aca6-93678a4c6c98 req-3d0e3930-0d05-4515-8034-5c214b7a5280 service nova] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:13:23.871077 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [req-2d2f1c1b-d347-481c-aca6-93678a4c6c98 req-3d0e3930-0d05-4515-8034-5c214b7a5280 service nova] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:13:23.871511 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [req-2d2f1c1b-d347-481c-aca6-93678a4c6c98 req-3d0e3930-0d05-4515-8034-5c214b7a5280 service nova] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:13:23.880153 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-2aae4999-c749-4552-b56f-abc7dac2f874 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Calling method '>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:13:23.881381 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-2aae4999-c749-4552-b56f-abc7dac2f874 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] [instance: e125ab44-9111-4260-909d-95d57b7861a7] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:13:23.882834 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.compute.server_external_events [req-2d2f1c1b-d347-481c-aca6-93678a4c6c98 req-3d0e3930-0d05-4515-8034-5c214b7a5280 service nova] Creating event network-vif-deleted:47c8bf5c-a500-440a-a247-090d3dbe386b for instance c8c61fd5-2f2a-4cd9-a439-00943de4dda6 on hv-cinder-82660 Oct 13 13:13:23.887663 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [req-2d2f1c1b-d347-481c-aca6-93678a4c6c98 req-3d0e3930-0d05-4515-8034-5c214b7a5280 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031572 Oct 13 13:13:23.888249 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 240/498] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 13:13:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 13:13:23.889401 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-2aae4999-c749-4552-b56f-abc7dac2f874 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:13:23.889886 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-2aae4999-c749-4552-b56f-abc7dac2f874 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:13:23.890322 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-2aae4999-c749-4552-b56f-abc7dac2f874 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:13:23.891017 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-2aae4999-c749-4552-b56f-abc7dac2f874 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:13:23.891553 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-2aae4999-c749-4552-b56f-abc7dac2f874 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:13:23.892603 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-2aae4999-c749-4552-b56f-abc7dac2f874 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:13:24.036692 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-2aae4999-c749-4552-b56f-abc7dac2f874 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e783caddcad473dbdd764919286e244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecd3d5d2a3a54a07ba64f1fea4846c40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:13:24.044910 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-2aae4999-c749-4552-b56f-abc7dac2f874 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] 10.222.0.23 "GET /compute/v2.1/servers/e125ab44-9111-4260-909d-95d57b7861a7" status: 200 len: 1678 microversion: 2.1 time: 0.169863 Oct 13 13:13:24.046223 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 259/499] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:13:23 2022] GET /compute/v2.1/servers/e125ab44-9111-4260-909d-95d57b7861a7 => generated 1678 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 13:13:24.593122 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-9fad9113-3d53-4db6-a6c3-7cc59f2c6ee2 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Calling method '>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:13:24.593809 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-9fad9113-3d53-4db6-a6c3-7cc59f2c6ee2 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] [instance: c8c61fd5-2f2a-4cd9-a439-00943de4dda6] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:13:24.600170 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-9fad9113-3d53-4db6-a6c3-7cc59f2c6ee2 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:13:24.600724 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-9fad9113-3d53-4db6-a6c3-7cc59f2c6ee2 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:13:24.601157 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-9fad9113-3d53-4db6-a6c3-7cc59f2c6ee2 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:13:24.601922 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-9fad9113-3d53-4db6-a6c3-7cc59f2c6ee2 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:13:24.602358 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-9fad9113-3d53-4db6-a6c3-7cc59f2c6ee2 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:13:24.602811 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-9fad9113-3d53-4db6-a6c3-7cc59f2c6ee2 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:13:24.637071 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-9fad9113-3d53-4db6-a6c3-7cc59f2c6ee2 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:13:24.637552 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-9fad9113-3d53-4db6-a6c3-7cc59f2c6ee2 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:13:24.638036 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-9fad9113-3d53-4db6-a6c3-7cc59f2c6ee2 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:13:24.638440 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.objects.instance [None req-9fad9113-3d53-4db6-a6c3-7cc59f2c6ee2 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Lazy-loading 'fault' on Instance uuid c8c61fd5-2f2a-4cd9-a439-00943de4dda6 {{(pid=118815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 13 13:13:24.680468 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-9fad9113-3d53-4db6-a6c3-7cc59f2c6ee2 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8569afc405f24a0993a023c818a0c272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f85144e13e254365a86aa785093c8575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:13:24.687695 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-9fad9113-3d53-4db6-a6c3-7cc59f2c6ee2 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c61fd5-2f2a-4cd9-a439-00943de4dda6" status: 200 len: 1308 microversion: 2.1 time: 0.098891 Oct 13 13:13:24.688249 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 241/500] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:13:24 2022] GET /compute/v2.1/servers/c8c61fd5-2f2a-4cd9-a439-00943de4dda6 => generated 1308 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:13:25.070353 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-f1ecd4d8-50cb-4512-98b0-5aa85e98eb82 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Calling method '>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:13:25.070971 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-f1ecd4d8-50cb-4512-98b0-5aa85e98eb82 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] [instance: e125ab44-9111-4260-909d-95d57b7861a7] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:13:25.077632 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-f1ecd4d8-50cb-4512-98b0-5aa85e98eb82 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:13:25.078119 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-f1ecd4d8-50cb-4512-98b0-5aa85e98eb82 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:13:25.078566 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-f1ecd4d8-50cb-4512-98b0-5aa85e98eb82 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:13:25.079345 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-f1ecd4d8-50cb-4512-98b0-5aa85e98eb82 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:13:25.079807 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-f1ecd4d8-50cb-4512-98b0-5aa85e98eb82 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:13:25.080239 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-f1ecd4d8-50cb-4512-98b0-5aa85e98eb82 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:13:25.207963 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-f1ecd4d8-50cb-4512-98b0-5aa85e98eb82 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e783caddcad473dbdd764919286e244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecd3d5d2a3a54a07ba64f1fea4846c40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:13:25.215668 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-f1ecd4d8-50cb-4512-98b0-5aa85e98eb82 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] 10.222.0.23 "GET /compute/v2.1/servers/e125ab44-9111-4260-909d-95d57b7861a7" status: 200 len: 1678 microversion: 2.1 time: 0.149225 Oct 13 13:13:25.216237 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 260/501] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:13:25 2022] GET /compute/v2.1/servers/e125ab44-9111-4260-909d-95d57b7861a7 => generated 1678 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:13:25.711577 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-eaea3b27-9e2a-4350-b904-9500c24da115 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Calling method '>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:13:25.712183 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-eaea3b27-9e2a-4350-b904-9500c24da115 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] [instance: c8c61fd5-2f2a-4cd9-a439-00943de4dda6] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:13:25.718540 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-eaea3b27-9e2a-4350-b904-9500c24da115 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:13:25.719025 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-eaea3b27-9e2a-4350-b904-9500c24da115 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:13:25.719542 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-eaea3b27-9e2a-4350-b904-9500c24da115 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:13:25.720831 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-eaea3b27-9e2a-4350-b904-9500c24da115 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:13:25.721286 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-eaea3b27-9e2a-4350-b904-9500c24da115 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:13:25.721710 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-eaea3b27-9e2a-4350-b904-9500c24da115 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:13:25.735440 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.wsgi [None req-eaea3b27-9e2a-4350-b904-9500c24da115 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] HTTP exception thrown: Instance c8c61fd5-2f2a-4cd9-a439-00943de4dda6 could not be found. Oct 13 13:13:25.737592 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-eaea3b27-9e2a-4350-b904-9500c24da115 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Request method failure captured: Oct 13 13:13:25.737592 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: request: GET /compute/v2.1/servers/c8c61fd5-2f2a-4cd9-a439-00943de4dda6 HTTP/1.1 Oct 13 13:13:25.737592 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: Accept: application/json Oct 13 13:13:25.737592 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: Accept-Encoding: identity Oct 13 13:13:25.737592 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: Connection: close Oct 13 13:13:25.737592 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: Content-Length: 0 Oct 13 13:13:25.737592 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: Content-Type: application/json Oct 13 13:13:25.737592 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: Host: 10.222.0.23 Oct 13 13:13:25.737592 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: Openstack-System-Scope: None Oct 13 13:13:25.737592 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: User-Agent: python-urllib3/1.26.12 Oct 13 13:13:25.737592 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Auth-Token: gAAAAABjSA5YP4eOQZTZUapLiAkyn5untQ_FRcQH_de5_rpv5hU-TjyKUAn-Z5Lh8S5A6q_ef7BVb-Lq4SU3xYP94lnCC7--lyO_lLga2RjvauicnahCtBZ_PK5DCHC5L_0FG9n_H0cxMMhPPuTF-WiOCDEL6KoOKBp0_kncIPb0uI92pYCX56I Oct 13 13:13:25.737592 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Domain-Id: None Oct 13 13:13:25.737592 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Domain-Name: None Oct 13 13:13:25.737592 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Identity-Status: Confirmed Oct 13 13:13:25.737592 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Is-Admin-Project: True Oct 13 13:13:25.737592 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Project-Domain-Id: default Oct 13 13:13:25.737592 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Project-Domain-Name: Default Oct 13 13:13:25.737592 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Project-Id: f85144e13e254365a86aa785093c8575 Oct 13 13:13:25.737592 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Project-Name: tempest-VolumesSnapshotTestJSON-81979141 Oct 13 13:13:25.737592 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Role: reader,member Oct 13 13:13:25.737592 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Roles: reader,member Oct 13 13:13:25.739146 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_f85144e13e254365a86aa785093c8575"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/f85144e13e254365a86aa785093c8575"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/f85144e13e254365a86aa785093c8575"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/f85144e13e254365a86aa785093c8575"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}] Oct 13 13:13:25.739146 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Tenant: tempest-VolumesSnapshotTestJSON-81979141 Oct 13 13:13:25.739146 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Tenant-Id: f85144e13e254365a86aa785093c8575 Oct 13 13:13:25.739146 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-81979141 Oct 13 13:13:25.739146 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-User: tempest-VolumesSnapshotTestJSON-81979141-project Oct 13 13:13:25.739146 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-User-Domain-Id: default Oct 13 13:13:25.739146 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-User-Domain-Name: Default Oct 13 13:13:25.739146 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-User-Id: 8569afc405f24a0993a023c818a0c272 Oct 13 13:13:25.739146 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-User-Name: tempest-VolumesSnapshotTestJSON-81979141-project Oct 13 13:13:25.739146 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: method: > Oct 13 13:13:25.739146 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: exception: Instance c8c61fd5-2f2a-4cd9-a439-00943de4dda6 could not be found. Oct 13 13:13:25.739146 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: action_args: {'id': 'c8c61fd5-2f2a-4cd9-a439-00943de4dda6'} Oct 13 13:13:25.740003 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 13:13:25.740003 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 13:13:25.740003 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 13 13:13:25.740003 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 13 13:13:25.740003 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 13 13:13:25.740003 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 13 13:13:25.740003 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 13 13:13:25.740003 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 13 13:13:25.740003 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 13 13:13:25.740003 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 13 13:13:25.740003 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c8c61fd5-2f2a-4cd9-a439-00943de4dda6 could not be found. Oct 13 13:13:25.740003 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi Oct 13 13:13:25.740003 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 13:13:25.740003 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi Oct 13 13:13:25.740003 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 13:13:25.740003 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 13:13:25.740003 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 13:13:25.740003 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 13:13:25.740003 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 13:13:25.740003 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 13:13:25.741423 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 13:13:25.741423 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 13 13:13:25.741423 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 13 13:13:25.741423 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 13 13:13:25.741423 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 13 13:13:25.741423 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 13 13:13:25.741423 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 13 13:13:25.741423 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c8c61fd5-2f2a-4cd9-a439-00943de4dda6 could not be found. Oct 13 13:13:25.741423 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi Oct 13 13:13:25.741423 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 13:13:25.741423 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi Oct 13 13:13:25.741423 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 13:13:25.741423 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 13:13:25.741423 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 13:13:25.741423 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 13:13:25.741423 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 13:13:25.741423 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c8c61fd5-2f2a-4cd9-a439-00943de4dda6 could not be found. Oct 13 13:13:25.741423 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi Oct 13 13:13:25.742720 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-eaea3b27-9e2a-4350-b904-9500c24da115 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] Returning 404 to user: Instance c8c61fd5-2f2a-4cd9-a439-00943de4dda6 could not be found. {{(pid=118815) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 13:13:25.742720 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-eaea3b27-9e2a-4350-b904-9500c24da115 tempest-VolumesSnapshotTestJSON-81979141 tempest-VolumesSnapshotTestJSON-81979141-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c61fd5-2f2a-4cd9-a439-00943de4dda6" status: 404 len: 111 microversion: 2.1 time: 0.031284 Oct 13 13:13:25.742720 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 242/502] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:13:25 2022] GET /compute/v2.1/servers/c8c61fd5-2f2a-4cd9-a439-00943de4dda6 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 13 13:13:26.239693 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-5db8028e-e773-4870-9dd9-6d3e90ee0c1a tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Calling method '>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:13:26.240228 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-5db8028e-e773-4870-9dd9-6d3e90ee0c1a tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] [instance: e125ab44-9111-4260-909d-95d57b7861a7] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:13:26.247022 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-5db8028e-e773-4870-9dd9-6d3e90ee0c1a tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:13:26.247532 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-5db8028e-e773-4870-9dd9-6d3e90ee0c1a tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:13:26.247970 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-5db8028e-e773-4870-9dd9-6d3e90ee0c1a tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:13:26.248976 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-5db8028e-e773-4870-9dd9-6d3e90ee0c1a tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:13:26.249429 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-5db8028e-e773-4870-9dd9-6d3e90ee0c1a tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:13:26.249940 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-5db8028e-e773-4870-9dd9-6d3e90ee0c1a tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:13:26.382183 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-5db8028e-e773-4870-9dd9-6d3e90ee0c1a tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e783caddcad473dbdd764919286e244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecd3d5d2a3a54a07ba64f1fea4846c40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:13:26.390433 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-5db8028e-e773-4870-9dd9-6d3e90ee0c1a tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] 10.222.0.23 "GET /compute/v2.1/servers/e125ab44-9111-4260-909d-95d57b7861a7" status: 200 len: 1678 microversion: 2.1 time: 0.155333 Oct 13 13:13:26.390993 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 261/503] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:13:26 2022] GET /compute/v2.1/servers/e125ab44-9111-4260-909d-95d57b7861a7 => generated 1678 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:13:27.414104 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-0a3545f4-6352-4866-947f-a63cc365754f tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Calling method '>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:13:27.414707 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-0a3545f4-6352-4866-947f-a63cc365754f tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] [instance: e125ab44-9111-4260-909d-95d57b7861a7] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:13:27.421393 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-0a3545f4-6352-4866-947f-a63cc365754f tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:13:27.421870 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-0a3545f4-6352-4866-947f-a63cc365754f tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:13:27.422307 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-0a3545f4-6352-4866-947f-a63cc365754f tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:13:27.423011 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-0a3545f4-6352-4866-947f-a63cc365754f tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:13:27.423492 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-0a3545f4-6352-4866-947f-a63cc365754f tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:13:27.423915 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-0a3545f4-6352-4866-947f-a63cc365754f tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:13:27.549096 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-0a3545f4-6352-4866-947f-a63cc365754f tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e783caddcad473dbdd764919286e244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecd3d5d2a3a54a07ba64f1fea4846c40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:13:27.557043 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-0a3545f4-6352-4866-947f-a63cc365754f tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] 10.222.0.23 "GET /compute/v2.1/servers/e125ab44-9111-4260-909d-95d57b7861a7" status: 200 len: 1678 microversion: 2.1 time: 0.146782 Oct 13 13:13:27.557589 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 243/504] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:13:27 2022] GET /compute/v2.1/servers/e125ab44-9111-4260-909d-95d57b7861a7 => generated 1678 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 13:13:28.580913 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-fbd06d75-3474-4843-8fb7-cfee2ad7a76c tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Calling method '>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:13:28.581513 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-fbd06d75-3474-4843-8fb7-cfee2ad7a76c tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] [instance: e125ab44-9111-4260-909d-95d57b7861a7] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:13:28.588410 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-fbd06d75-3474-4843-8fb7-cfee2ad7a76c tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:13:28.588888 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-fbd06d75-3474-4843-8fb7-cfee2ad7a76c tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:13:28.589315 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-fbd06d75-3474-4843-8fb7-cfee2ad7a76c tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:13:28.589994 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-fbd06d75-3474-4843-8fb7-cfee2ad7a76c tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:13:28.590439 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-fbd06d75-3474-4843-8fb7-cfee2ad7a76c tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:13:28.590859 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-fbd06d75-3474-4843-8fb7-cfee2ad7a76c tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:13:28.717836 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-fbd06d75-3474-4843-8fb7-cfee2ad7a76c tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e783caddcad473dbdd764919286e244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecd3d5d2a3a54a07ba64f1fea4846c40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:13:28.725487 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-fbd06d75-3474-4843-8fb7-cfee2ad7a76c tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] 10.222.0.23 "GET /compute/v2.1/servers/e125ab44-9111-4260-909d-95d57b7861a7" status: 200 len: 1678 microversion: 2.1 time: 0.148995 Oct 13 13:13:28.726043 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 262/505] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:13:28 2022] GET /compute/v2.1/servers/e125ab44-9111-4260-909d-95d57b7861a7 => generated 1678 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:13:29.748867 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-d02a9e49-f08b-4c5b-b949-34260286be74 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Calling method '>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:13:29.749473 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-d02a9e49-f08b-4c5b-b949-34260286be74 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] [instance: e125ab44-9111-4260-909d-95d57b7861a7] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:13:29.756417 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-d02a9e49-f08b-4c5b-b949-34260286be74 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:13:29.756891 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-d02a9e49-f08b-4c5b-b949-34260286be74 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:13:29.757329 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-d02a9e49-f08b-4c5b-b949-34260286be74 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:13:29.758006 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-d02a9e49-f08b-4c5b-b949-34260286be74 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:13:29.758447 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-d02a9e49-f08b-4c5b-b949-34260286be74 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:13:29.758867 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-d02a9e49-f08b-4c5b-b949-34260286be74 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:13:29.887231 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-d02a9e49-f08b-4c5b-b949-34260286be74 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e783caddcad473dbdd764919286e244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecd3d5d2a3a54a07ba64f1fea4846c40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:13:29.894883 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-d02a9e49-f08b-4c5b-b949-34260286be74 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] 10.222.0.23 "GET /compute/v2.1/servers/e125ab44-9111-4260-909d-95d57b7861a7" status: 200 len: 1678 microversion: 2.1 time: 0.149891 Oct 13 13:13:29.895467 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 244/506] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:13:29 2022] GET /compute/v2.1/servers/e125ab44-9111-4260-909d-95d57b7861a7 => generated 1678 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:13:30.918012 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-4bbee131-267b-44aa-b62f-5c480cead9b3 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Calling method '>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:13:30.918639 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-4bbee131-267b-44aa-b62f-5c480cead9b3 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] [instance: e125ab44-9111-4260-909d-95d57b7861a7] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:13:30.926071 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-4bbee131-267b-44aa-b62f-5c480cead9b3 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:13:30.926550 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-4bbee131-267b-44aa-b62f-5c480cead9b3 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:13:30.926982 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-4bbee131-267b-44aa-b62f-5c480cead9b3 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:13:30.927978 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-4bbee131-267b-44aa-b62f-5c480cead9b3 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:13:30.928428 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-4bbee131-267b-44aa-b62f-5c480cead9b3 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:13:30.928848 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-4bbee131-267b-44aa-b62f-5c480cead9b3 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:13:31.058143 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-4bbee131-267b-44aa-b62f-5c480cead9b3 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e783caddcad473dbdd764919286e244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecd3d5d2a3a54a07ba64f1fea4846c40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:13:31.065943 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-4bbee131-267b-44aa-b62f-5c480cead9b3 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] 10.222.0.23 "GET /compute/v2.1/servers/e125ab44-9111-4260-909d-95d57b7861a7" status: 200 len: 1678 microversion: 2.1 time: 0.151714 Oct 13 13:13:31.066699 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 263/507] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:13:30 2022] GET /compute/v2.1/servers/e125ab44-9111-4260-909d-95d57b7861a7 => generated 1678 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:13:32.089984 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-642f5bb1-3373-4726-a7ad-e61cffe41118 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Calling method '>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:13:32.090734 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-642f5bb1-3373-4726-a7ad-e61cffe41118 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] [instance: e125ab44-9111-4260-909d-95d57b7861a7] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:13:32.098119 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-642f5bb1-3373-4726-a7ad-e61cffe41118 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:13:32.098597 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-642f5bb1-3373-4726-a7ad-e61cffe41118 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:13:32.099152 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-642f5bb1-3373-4726-a7ad-e61cffe41118 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:13:32.100071 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-642f5bb1-3373-4726-a7ad-e61cffe41118 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:13:32.100524 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-642f5bb1-3373-4726-a7ad-e61cffe41118 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:13:32.100947 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-642f5bb1-3373-4726-a7ad-e61cffe41118 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:13:32.235085 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-642f5bb1-3373-4726-a7ad-e61cffe41118 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e783caddcad473dbdd764919286e244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecd3d5d2a3a54a07ba64f1fea4846c40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:13:32.243631 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-642f5bb1-3373-4726-a7ad-e61cffe41118 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] 10.222.0.23 "GET /compute/v2.1/servers/e125ab44-9111-4260-909d-95d57b7861a7" status: 200 len: 1678 microversion: 2.1 time: 0.157883 Oct 13 13:13:32.244188 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 245/508] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:13:32 2022] GET /compute/v2.1/servers/e125ab44-9111-4260-909d-95d57b7861a7 => generated 1678 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:13:33.274472 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-a8a60e31-dd42-4f8e-8632-bb13787584f7 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Calling method '>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:13:33.275173 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-a8a60e31-dd42-4f8e-8632-bb13787584f7 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] [instance: e125ab44-9111-4260-909d-95d57b7861a7] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:13:33.281751 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-a8a60e31-dd42-4f8e-8632-bb13787584f7 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:13:33.282239 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-a8a60e31-dd42-4f8e-8632-bb13787584f7 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:13:33.282685 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-a8a60e31-dd42-4f8e-8632-bb13787584f7 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:13:33.283463 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-a8a60e31-dd42-4f8e-8632-bb13787584f7 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:13:33.283976 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-a8a60e31-dd42-4f8e-8632-bb13787584f7 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:13:33.284441 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-a8a60e31-dd42-4f8e-8632-bb13787584f7 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:13:33.412168 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-a8a60e31-dd42-4f8e-8632-bb13787584f7 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e783caddcad473dbdd764919286e244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecd3d5d2a3a54a07ba64f1fea4846c40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:13:33.419804 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-a8a60e31-dd42-4f8e-8632-bb13787584f7 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] 10.222.0.23 "GET /compute/v2.1/servers/e125ab44-9111-4260-909d-95d57b7861a7" status: 200 len: 1678 microversion: 2.1 time: 0.149171 Oct 13 13:13:33.420364 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 264/509] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:13:33 2022] GET /compute/v2.1/servers/e125ab44-9111-4260-909d-95d57b7861a7 => generated 1678 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:13:34.450349 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-fccf3f25-0efa-47c7-81a2-bbff949cecec tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Calling method '>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:13:34.450349 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-fccf3f25-0efa-47c7-81a2-bbff949cecec tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] [instance: e125ab44-9111-4260-909d-95d57b7861a7] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:13:34.452850 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-fccf3f25-0efa-47c7-81a2-bbff949cecec tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:13:34.453454 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-fccf3f25-0efa-47c7-81a2-bbff949cecec tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:13:34.453955 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-fccf3f25-0efa-47c7-81a2-bbff949cecec tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:13:34.455245 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-fccf3f25-0efa-47c7-81a2-bbff949cecec tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:13:34.455245 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-fccf3f25-0efa-47c7-81a2-bbff949cecec tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:13:34.455667 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-fccf3f25-0efa-47c7-81a2-bbff949cecec tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:13:34.590726 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-fccf3f25-0efa-47c7-81a2-bbff949cecec tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e783caddcad473dbdd764919286e244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecd3d5d2a3a54a07ba64f1fea4846c40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:13:34.598966 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-fccf3f25-0efa-47c7-81a2-bbff949cecec tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] 10.222.0.23 "GET /compute/v2.1/servers/e125ab44-9111-4260-909d-95d57b7861a7" status: 200 len: 1655 microversion: 2.1 time: 0.159212 Oct 13 13:13:34.599560 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 246/510] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:13:34 2022] GET /compute/v2.1/servers/e125ab44-9111-4260-909d-95d57b7861a7 => generated 1655 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:13:34.621657 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-799d0b3a-e5c5-418f-829f-b585b5bb47b5 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 13:13:34.628102 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-799d0b3a-e5c5-418f-829f-b585b5bb47b5 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:13:34.628584 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-799d0b3a-e5c5-418f-829f-b585b5bb47b5 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:13:34.629021 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-799d0b3a-e5c5-418f-829f-b585b5bb47b5 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:13:34.651216 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-799d0b3a-e5c5-418f-829f-b585b5bb47b5 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] [instance: e125ab44-9111-4260-909d-95d57b7861a7] Going to try to start instance {{(pid=118814) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 13 13:13:34.691529 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-799d0b3a-e5c5-418f-829f-b585b5bb47b5 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] 10.222.0.23 "POST /compute/v2.1/servers/e125ab44-9111-4260-909d-95d57b7861a7/action" status: 202 len: 0 microversion: 2.1 time: 0.073606 Oct 13 13:13:34.692164 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 265/511] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Oct 13 13:13:34 2022] POST /compute/v2.1/servers/e125ab44-9111-4260-909d-95d57b7861a7/action => generated 0 bytes in 75 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 13 13:13:34.700273 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-f51d8372-21e5-4df4-acd5-7b01416c20d9 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Calling method '>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:13:34.700885 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-f51d8372-21e5-4df4-acd5-7b01416c20d9 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] [instance: e125ab44-9111-4260-909d-95d57b7861a7] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:13:34.707576 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-f51d8372-21e5-4df4-acd5-7b01416c20d9 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:13:34.708209 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-f51d8372-21e5-4df4-acd5-7b01416c20d9 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:13:34.708724 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-f51d8372-21e5-4df4-acd5-7b01416c20d9 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:13:34.709552 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-f51d8372-21e5-4df4-acd5-7b01416c20d9 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:13:34.710151 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-f51d8372-21e5-4df4-acd5-7b01416c20d9 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:13:34.710621 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-f51d8372-21e5-4df4-acd5-7b01416c20d9 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:13:34.817022 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-7db3230c-2106-4da3-bd0f-69ba6bafc51a tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "515371e1-4f2e-44c4-b36f-ac2cfdfced9b"}} {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 13:13:34.819650 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-7db3230c-2106-4da3-bd0f-69ba6bafc51a tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] [instance: b4ba0fd3-eb17-4e05-acaa-5570c1e364d7] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:13:34.825709 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-7db3230c-2106-4da3-bd0f-69ba6bafc51a tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:13:34.826188 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-7db3230c-2106-4da3-bd0f-69ba6bafc51a tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:13:34.826623 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-7db3230c-2106-4da3-bd0f-69ba6bafc51a tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:13:34.827356 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-7db3230c-2106-4da3-bd0f-69ba6bafc51a tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:13:34.827805 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-7db3230c-2106-4da3-bd0f-69ba6bafc51a tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:13:34.828232 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-7db3230c-2106-4da3-bd0f-69ba6bafc51a tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:13:34.840094 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-f51d8372-21e5-4df4-acd5-7b01416c20d9 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e783caddcad473dbdd764919286e244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecd3d5d2a3a54a07ba64f1fea4846c40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:13:34.847764 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-f51d8372-21e5-4df4-acd5-7b01416c20d9 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] 10.222.0.23 "GET /compute/v2.1/servers/e125ab44-9111-4260-909d-95d57b7861a7" status: 200 len: 1664 microversion: 2.1 time: 0.151296 Oct 13 13:13:34.848330 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 247/512] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:13:34 2022] GET /compute/v2.1/servers/e125ab44-9111-4260-909d-95d57b7861a7 => generated 1664 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 13:13:35.871709 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-fe27c072-3dc9-4a4f-9553-91d97eb068ab tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Calling method '>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:13:35.872373 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-fe27c072-3dc9-4a4f-9553-91d97eb068ab tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] [instance: e125ab44-9111-4260-909d-95d57b7861a7] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:13:35.878696 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-fe27c072-3dc9-4a4f-9553-91d97eb068ab tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:13:35.879211 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-fe27c072-3dc9-4a4f-9553-91d97eb068ab tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:13:35.879650 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-fe27c072-3dc9-4a4f-9553-91d97eb068ab tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:13:35.880332 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-fe27c072-3dc9-4a4f-9553-91d97eb068ab tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:13:35.880785 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-fe27c072-3dc9-4a4f-9553-91d97eb068ab tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:13:35.881206 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-fe27c072-3dc9-4a4f-9553-91d97eb068ab tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:13:36.006502 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-fe27c072-3dc9-4a4f-9553-91d97eb068ab tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e783caddcad473dbdd764919286e244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecd3d5d2a3a54a07ba64f1fea4846c40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:13:36.014195 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-fe27c072-3dc9-4a4f-9553-91d97eb068ab tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] 10.222.0.23 "GET /compute/v2.1/servers/e125ab44-9111-4260-909d-95d57b7861a7" status: 200 len: 1664 microversion: 2.1 time: 0.146371 Oct 13 13:13:36.014778 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 248/513] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:13:35 2022] GET /compute/v2.1/servers/e125ab44-9111-4260-909d-95d57b7861a7 => generated 1664 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 13:13:37.036984 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-404481ca-4620-4b89-948e-29bf2c8c3f1e tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Calling method '>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:13:37.037616 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-404481ca-4620-4b89-948e-29bf2c8c3f1e tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] [instance: e125ab44-9111-4260-909d-95d57b7861a7] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:13:37.043926 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-404481ca-4620-4b89-948e-29bf2c8c3f1e tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:13:37.044410 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-404481ca-4620-4b89-948e-29bf2c8c3f1e tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:13:37.044846 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-404481ca-4620-4b89-948e-29bf2c8c3f1e tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:13:37.045532 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-404481ca-4620-4b89-948e-29bf2c8c3f1e tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:13:37.046017 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-404481ca-4620-4b89-948e-29bf2c8c3f1e tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:13:37.046445 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-404481ca-4620-4b89-948e-29bf2c8c3f1e tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:13:37.177254 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-404481ca-4620-4b89-948e-29bf2c8c3f1e tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e783caddcad473dbdd764919286e244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecd3d5d2a3a54a07ba64f1fea4846c40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:13:37.184954 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-404481ca-4620-4b89-948e-29bf2c8c3f1e tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] 10.222.0.23 "GET /compute/v2.1/servers/e125ab44-9111-4260-909d-95d57b7861a7" status: 200 len: 1664 microversion: 2.1 time: 0.151685 Oct 13 13:13:37.185511 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 249/514] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:13:37 2022] GET /compute/v2.1/servers/e125ab44-9111-4260-909d-95d57b7861a7 => generated 1664 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 13:13:37.539911 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-7db3230c-2106-4da3-bd0f-69ba6bafc51a tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] 10.222.0.23 "POST /compute/v2.1/servers/b4ba0fd3-eb17-4e05-acaa-5570c1e364d7/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.727658 Oct 13 13:13:37.540946 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 266/515] 10.222.0.23 () {60 vars in 1323 bytes} [Thu Oct 13 13:13:34 2022] POST /compute/v2.1/servers/b4ba0fd3-eb17-4e05-acaa-5570c1e364d7/os-volume_attachments => generated 194 bytes in 2730 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 13 13:13:38.209275 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-c40f734c-637f-4664-818b-e57525a8b413 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Calling method '>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:13:38.209812 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-c40f734c-637f-4664-818b-e57525a8b413 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] [instance: e125ab44-9111-4260-909d-95d57b7861a7] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:13:38.216208 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-c40f734c-637f-4664-818b-e57525a8b413 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:13:38.216688 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-c40f734c-637f-4664-818b-e57525a8b413 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:13:38.217125 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-c40f734c-637f-4664-818b-e57525a8b413 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:13:38.217808 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-c40f734c-637f-4664-818b-e57525a8b413 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:13:38.218260 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-c40f734c-637f-4664-818b-e57525a8b413 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:13:38.218686 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-c40f734c-637f-4664-818b-e57525a8b413 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:13:38.346121 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-c40f734c-637f-4664-818b-e57525a8b413 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e783caddcad473dbdd764919286e244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecd3d5d2a3a54a07ba64f1fea4846c40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:13:38.353829 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-c40f734c-637f-4664-818b-e57525a8b413 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] 10.222.0.23 "GET /compute/v2.1/servers/e125ab44-9111-4260-909d-95d57b7861a7" status: 200 len: 1664 microversion: 2.1 time: 0.148384 Oct 13 13:13:38.354336 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 250/516] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:13:38 2022] GET /compute/v2.1/servers/e125ab44-9111-4260-909d-95d57b7861a7 => generated 1664 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:13:39.040226 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-086fec09-3166-4296-97db-4fbec3521e81 tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 13:13:39.042593 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-086fec09-3166-4296-97db-4fbec3521e81 tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] [instance: 59e81a58-9400-4cea-aa38-b24b394e33d7] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:13:39.049868 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-086fec09-3166-4296-97db-4fbec3521e81 tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:13:39.050624 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-086fec09-3166-4296-97db-4fbec3521e81 tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:13:39.051049 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-086fec09-3166-4296-97db-4fbec3521e81 tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:13:39.051856 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-086fec09-3166-4296-97db-4fbec3521e81 tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:13:39.052300 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-086fec09-3166-4296-97db-4fbec3521e81 tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:13:39.052720 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-086fec09-3166-4296-97db-4fbec3521e81 tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:13:39.122616 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-086fec09-3166-4296-97db-4fbec3521e81 tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] 10.222.0.23 "POST /compute/v2.1/servers/59e81a58-9400-4cea-aa38-b24b394e33d7/action" status: 202 len: 0 microversion: 2.1 time: 0.086473 Oct 13 13:13:39.126834 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 267/517] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Oct 13 13:13:39 2022] POST /compute/v2.1/servers/59e81a58-9400-4cea-aa38-b24b394e33d7/action => generated 0 bytes in 88 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 13 13:13:39.131990 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-ed7091de-28a5-49aa-8f5c-6c1e5297451f tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Calling method '>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:13:39.132664 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-ed7091de-28a5-49aa-8f5c-6c1e5297451f tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] [instance: 59e81a58-9400-4cea-aa38-b24b394e33d7] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:13:39.138514 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-ed7091de-28a5-49aa-8f5c-6c1e5297451f tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:13:39.139232 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-ed7091de-28a5-49aa-8f5c-6c1e5297451f tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:13:39.139696 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-ed7091de-28a5-49aa-8f5c-6c1e5297451f tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:13:39.140595 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-ed7091de-28a5-49aa-8f5c-6c1e5297451f tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:13:39.141053 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-ed7091de-28a5-49aa-8f5c-6c1e5297451f tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:13:39.141640 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-ed7091de-28a5-49aa-8f5c-6c1e5297451f tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:13:39.288998 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-ed7091de-28a5-49aa-8f5c-6c1e5297451f tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d89667e52b24295ba619203c02c7bd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed5038c799342d48edc980983f1d996', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:13:39.297172 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-ed7091de-28a5-49aa-8f5c-6c1e5297451f tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] 10.222.0.23 "GET /compute/v2.1/servers/59e81a58-9400-4cea-aa38-b24b394e33d7" status: 200 len: 1749 microversion: 2.1 time: 0.169026 Oct 13 13:13:39.298251 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 251/518] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:13:39 2022] GET /compute/v2.1/servers/59e81a58-9400-4cea-aa38-b24b394e33d7 => generated 1749 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 13:13:39.380348 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-e999689c-2c98-4d13-9c51-f8f7af064c5b tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Calling method '>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:13:39.381158 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-e999689c-2c98-4d13-9c51-f8f7af064c5b tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] [instance: e125ab44-9111-4260-909d-95d57b7861a7] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:13:39.387273 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-e999689c-2c98-4d13-9c51-f8f7af064c5b tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:13:39.387762 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-e999689c-2c98-4d13-9c51-f8f7af064c5b tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:13:39.388206 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-e999689c-2c98-4d13-9c51-f8f7af064c5b tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:13:39.388931 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-e999689c-2c98-4d13-9c51-f8f7af064c5b tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:13:39.389388 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-e999689c-2c98-4d13-9c51-f8f7af064c5b tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:13:39.389823 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-e999689c-2c98-4d13-9c51-f8f7af064c5b tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:13:39.520362 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-e999689c-2c98-4d13-9c51-f8f7af064c5b tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e783caddcad473dbdd764919286e244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecd3d5d2a3a54a07ba64f1fea4846c40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:13:39.527587 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-e999689c-2c98-4d13-9c51-f8f7af064c5b tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] 10.222.0.23 "GET /compute/v2.1/servers/e125ab44-9111-4260-909d-95d57b7861a7" status: 200 len: 1668 microversion: 2.1 time: 0.152956 Oct 13 13:13:39.528183 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 268/519] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:13:39 2022] GET /compute/v2.1/servers/e125ab44-9111-4260-909d-95d57b7861a7 => generated 1668 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:13:40.321874 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-b16fa102-5331-49cf-a76c-e2af11fccc54 tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Calling method '>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:13:40.322508 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-b16fa102-5331-49cf-a76c-e2af11fccc54 tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] [instance: 59e81a58-9400-4cea-aa38-b24b394e33d7] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:13:40.329748 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-b16fa102-5331-49cf-a76c-e2af11fccc54 tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:13:40.330271 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-b16fa102-5331-49cf-a76c-e2af11fccc54 tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:13:40.330708 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-b16fa102-5331-49cf-a76c-e2af11fccc54 tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:13:40.331490 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-b16fa102-5331-49cf-a76c-e2af11fccc54 tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:13:40.331942 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-b16fa102-5331-49cf-a76c-e2af11fccc54 tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:13:40.332363 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-b16fa102-5331-49cf-a76c-e2af11fccc54 tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:13:40.469792 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-b16fa102-5331-49cf-a76c-e2af11fccc54 tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d89667e52b24295ba619203c02c7bd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed5038c799342d48edc980983f1d996', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:13:40.472210 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG dbcounter [-] [118815] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:13:40.479928 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-b16fa102-5331-49cf-a76c-e2af11fccc54 tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] 10.222.0.23 "GET /compute/v2.1/servers/59e81a58-9400-4cea-aa38-b24b394e33d7" status: 200 len: 1754 microversion: 2.1 time: 0.162043 Oct 13 13:13:40.480506 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 252/520] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:13:40 2022] GET /compute/v2.1/servers/59e81a58-9400-4cea-aa38-b24b394e33d7 => generated 1754 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:13:41.503244 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-4bc1eae3-6b0f-4d91-8e7b-7a4771b06a62 tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Calling method '>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:13:41.503853 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-4bc1eae3-6b0f-4d91-8e7b-7a4771b06a62 tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] [instance: 59e81a58-9400-4cea-aa38-b24b394e33d7] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:13:41.506439 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG dbcounter [-] [118814] Writing DB stats nova_api:SELECT=42 {{(pid=118814) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:13:41.511890 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-4bc1eae3-6b0f-4d91-8e7b-7a4771b06a62 tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:13:41.512369 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-4bc1eae3-6b0f-4d91-8e7b-7a4771b06a62 tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:13:41.512801 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-4bc1eae3-6b0f-4d91-8e7b-7a4771b06a62 tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:13:41.513480 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-4bc1eae3-6b0f-4d91-8e7b-7a4771b06a62 tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:13:41.513926 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-4bc1eae3-6b0f-4d91-8e7b-7a4771b06a62 tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:13:41.514349 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-4bc1eae3-6b0f-4d91-8e7b-7a4771b06a62 tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:13:41.536003 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG dbcounter [-] [118814] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=118814) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:13:41.661776 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-4bc1eae3-6b0f-4d91-8e7b-7a4771b06a62 tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d89667e52b24295ba619203c02c7bd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed5038c799342d48edc980983f1d996', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:13:41.670195 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-4bc1eae3-6b0f-4d91-8e7b-7a4771b06a62 tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] 10.222.0.23 "GET /compute/v2.1/servers/59e81a58-9400-4cea-aa38-b24b394e33d7" status: 200 len: 1754 microversion: 2.1 time: 0.170802 Oct 13 13:13:41.670755 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 269/521] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:13:41 2022] GET /compute/v2.1/servers/59e81a58-9400-4cea-aa38-b24b394e33d7 => generated 1754 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:13:42.693833 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-2436c674-df16-4dd3-ba20-36ff201b5a96 tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Calling method '>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:13:42.694438 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-2436c674-df16-4dd3-ba20-36ff201b5a96 tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] [instance: 59e81a58-9400-4cea-aa38-b24b394e33d7] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:13:42.701527 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-2436c674-df16-4dd3-ba20-36ff201b5a96 tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:13:42.702002 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-2436c674-df16-4dd3-ba20-36ff201b5a96 tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:13:42.702430 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-2436c674-df16-4dd3-ba20-36ff201b5a96 tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:13:42.703129 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-2436c674-df16-4dd3-ba20-36ff201b5a96 tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:13:42.704202 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-2436c674-df16-4dd3-ba20-36ff201b5a96 tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:13:42.704624 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-2436c674-df16-4dd3-ba20-36ff201b5a96 tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:13:42.844093 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-2436c674-df16-4dd3-ba20-36ff201b5a96 tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d89667e52b24295ba619203c02c7bd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed5038c799342d48edc980983f1d996', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:13:42.852479 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-2436c674-df16-4dd3-ba20-36ff201b5a96 tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] 10.222.0.23 "GET /compute/v2.1/servers/59e81a58-9400-4cea-aa38-b24b394e33d7" status: 200 len: 1754 microversion: 2.1 time: 0.162818 Oct 13 13:13:42.853048 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 253/522] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:13:42 2022] GET /compute/v2.1/servers/59e81a58-9400-4cea-aa38-b24b394e33d7 => generated 1754 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:13:43.876445 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-c7b83766-e865-493e-8f04-015942651388 tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Calling method '>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:13:43.877048 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-c7b83766-e865-493e-8f04-015942651388 tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] [instance: 59e81a58-9400-4cea-aa38-b24b394e33d7] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:13:43.883496 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-c7b83766-e865-493e-8f04-015942651388 tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:13:43.883970 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-c7b83766-e865-493e-8f04-015942651388 tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:13:43.884401 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-c7b83766-e865-493e-8f04-015942651388 tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:13:43.885109 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-c7b83766-e865-493e-8f04-015942651388 tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:13:43.885550 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-c7b83766-e865-493e-8f04-015942651388 tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:13:43.885966 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-c7b83766-e865-493e-8f04-015942651388 tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:13:44.033257 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-c7b83766-e865-493e-8f04-015942651388 tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d89667e52b24295ba619203c02c7bd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed5038c799342d48edc980983f1d996', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:13:44.041635 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-c7b83766-e865-493e-8f04-015942651388 tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] 10.222.0.23 "GET /compute/v2.1/servers/59e81a58-9400-4cea-aa38-b24b394e33d7" status: 200 len: 1754 microversion: 2.1 time: 0.169100 Oct 13 13:13:44.042201 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 270/523] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:13:43 2022] GET /compute/v2.1/servers/59e81a58-9400-4cea-aa38-b24b394e33d7 => generated 1754 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:13:45.063987 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-282e75f4-be16-4cd6-ab1d-aa5ad1ecd5d2 tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Calling method '>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:13:45.064601 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-282e75f4-be16-4cd6-ab1d-aa5ad1ecd5d2 tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] [instance: 59e81a58-9400-4cea-aa38-b24b394e33d7] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:13:45.066912 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG dbcounter [-] [118815] Writing DB stats nova_api:SELECT=57,nova_api:UPDATE=1 {{(pid=118815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:13:45.072337 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-282e75f4-be16-4cd6-ab1d-aa5ad1ecd5d2 tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:13:45.072824 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-282e75f4-be16-4cd6-ab1d-aa5ad1ecd5d2 tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:13:45.073446 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-282e75f4-be16-4cd6-ab1d-aa5ad1ecd5d2 tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:13:45.074316 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-282e75f4-be16-4cd6-ab1d-aa5ad1ecd5d2 tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:13:45.074776 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-282e75f4-be16-4cd6-ab1d-aa5ad1ecd5d2 tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:13:45.075239 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-282e75f4-be16-4cd6-ab1d-aa5ad1ecd5d2 tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:13:45.088040 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-7bc3f4ce-198a-46b3-b133-dda2ac53258a tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 13:13:45.090368 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-7bc3f4ce-198a-46b3-b133-dda2ac53258a tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] [instance: b4ba0fd3-eb17-4e05-acaa-5570c1e364d7] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:13:45.097592 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-7bc3f4ce-198a-46b3-b133-dda2ac53258a tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:13:45.098076 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-7bc3f4ce-198a-46b3-b133-dda2ac53258a tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:13:45.098518 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-7bc3f4ce-198a-46b3-b133-dda2ac53258a tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:13:45.099233 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-7bc3f4ce-198a-46b3-b133-dda2ac53258a tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:13:45.099688 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-7bc3f4ce-198a-46b3-b133-dda2ac53258a tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:13:45.100114 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-7bc3f4ce-198a-46b3-b133-dda2ac53258a tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:13:45.123468 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.objects.instance [None req-7bc3f4ce-198a-46b3-b133-dda2ac53258a tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lazy-loading 'flavor' on Instance uuid b4ba0fd3-eb17-4e05-acaa-5570c1e364d7 {{(pid=118814) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 13 13:13:45.218420 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-282e75f4-be16-4cd6-ab1d-aa5ad1ecd5d2 tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d89667e52b24295ba619203c02c7bd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed5038c799342d48edc980983f1d996', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:13:45.227563 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-282e75f4-be16-4cd6-ab1d-aa5ad1ecd5d2 tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] 10.222.0.23 "GET /compute/v2.1/servers/59e81a58-9400-4cea-aa38-b24b394e33d7" status: 200 len: 1754 microversion: 2.1 time: 0.167227 Oct 13 13:13:45.228215 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 254/524] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:13:45 2022] GET /compute/v2.1/servers/59e81a58-9400-4cea-aa38-b24b394e33d7 => generated 1754 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:13:45.244693 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-7bc3f4ce-198a-46b3-b133-dda2ac53258a tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] 10.222.0.23 "POST /compute/v2.1/servers/b4ba0fd3-eb17-4e05-acaa-5570c1e364d7/action" status: 200 len: 32 microversion: 2.1 time: 0.160578 Oct 13 13:13:45.245283 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 271/525] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Oct 13 13:13:45 2022] POST /compute/v2.1/servers/b4ba0fd3-eb17-4e05-acaa-5570c1e364d7/action => generated 32 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 13 13:13:45.255229 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-26f19554-6a11-4884-94e7-fb0590ec4452 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Calling method '>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:13:45.255842 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-26f19554-6a11-4884-94e7-fb0590ec4452 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] [instance: b4ba0fd3-eb17-4e05-acaa-5570c1e364d7] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:13:45.261900 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-26f19554-6a11-4884-94e7-fb0590ec4452 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:13:45.262383 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-26f19554-6a11-4884-94e7-fb0590ec4452 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:13:45.262827 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-26f19554-6a11-4884-94e7-fb0590ec4452 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:13:45.263714 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-26f19554-6a11-4884-94e7-fb0590ec4452 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:13:45.264204 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-26f19554-6a11-4884-94e7-fb0590ec4452 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:13:45.264700 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-26f19554-6a11-4884-94e7-fb0590ec4452 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:13:45.398665 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-26f19554-6a11-4884-94e7-fb0590ec4452 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '454203f47b434cca952a1cef56de559f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7312d0ac9248f2bfbece5611913ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:13:45.406878 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-26f19554-6a11-4884-94e7-fb0590ec4452 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] 10.222.0.23 "GET /compute/v2.1/servers/b4ba0fd3-eb17-4e05-acaa-5570c1e364d7" status: 200 len: 1737 microversion: 2.1 time: 0.156153 Oct 13 13:13:45.408424 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 255/526] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:13:45 2022] GET /compute/v2.1/servers/b4ba0fd3-eb17-4e05-acaa-5570c1e364d7 => generated 1737 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:13:46.252408 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-01e2c095-f32f-4008-aee2-f97ccf6a34da tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Calling method '>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:13:46.253106 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-01e2c095-f32f-4008-aee2-f97ccf6a34da tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] [instance: 59e81a58-9400-4cea-aa38-b24b394e33d7] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:13:46.259700 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-01e2c095-f32f-4008-aee2-f97ccf6a34da tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:13:46.260181 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-01e2c095-f32f-4008-aee2-f97ccf6a34da tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:13:46.260618 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-01e2c095-f32f-4008-aee2-f97ccf6a34da tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:13:46.261308 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-01e2c095-f32f-4008-aee2-f97ccf6a34da tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:13:46.261759 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-01e2c095-f32f-4008-aee2-f97ccf6a34da tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:13:46.262182 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-01e2c095-f32f-4008-aee2-f97ccf6a34da tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:13:46.402182 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-01e2c095-f32f-4008-aee2-f97ccf6a34da tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d89667e52b24295ba619203c02c7bd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed5038c799342d48edc980983f1d996', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:13:46.410876 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-01e2c095-f32f-4008-aee2-f97ccf6a34da tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] 10.222.0.23 "GET /compute/v2.1/servers/59e81a58-9400-4cea-aa38-b24b394e33d7" status: 200 len: 1754 microversion: 2.1 time: 0.162770 Oct 13 13:13:46.411623 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 272/527] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:13:46 2022] GET /compute/v2.1/servers/59e81a58-9400-4cea-aa38-b24b394e33d7 => generated 1754 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:13:46.430199 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-12344f50-19dc-40ef-894f-c3c9e356e134 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Calling method '>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:13:46.430806 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-12344f50-19dc-40ef-894f-c3c9e356e134 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] [instance: b4ba0fd3-eb17-4e05-acaa-5570c1e364d7] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:13:46.436673 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-12344f50-19dc-40ef-894f-c3c9e356e134 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:13:46.437152 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-12344f50-19dc-40ef-894f-c3c9e356e134 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:13:46.437588 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-12344f50-19dc-40ef-894f-c3c9e356e134 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:13:46.438263 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-12344f50-19dc-40ef-894f-c3c9e356e134 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:13:46.438714 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-12344f50-19dc-40ef-894f-c3c9e356e134 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:13:46.439160 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-12344f50-19dc-40ef-894f-c3c9e356e134 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:13:46.563565 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-12344f50-19dc-40ef-894f-c3c9e356e134 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '454203f47b434cca952a1cef56de559f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7312d0ac9248f2bfbece5611913ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:13:46.571695 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-12344f50-19dc-40ef-894f-c3c9e356e134 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] 10.222.0.23 "GET /compute/v2.1/servers/b4ba0fd3-eb17-4e05-acaa-5570c1e364d7" status: 200 len: 1737 microversion: 2.1 time: 0.145475 Oct 13 13:13:46.572251 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 256/528] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:13:46 2022] GET /compute/v2.1/servers/b4ba0fd3-eb17-4e05-acaa-5570c1e364d7 => generated 1737 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:13:47.434924 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-f577313c-4956-43ad-982e-45aa85177728 tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Calling method '>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:13:47.435562 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-f577313c-4956-43ad-982e-45aa85177728 tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] [instance: 59e81a58-9400-4cea-aa38-b24b394e33d7] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:13:47.442573 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-f577313c-4956-43ad-982e-45aa85177728 tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:13:47.443048 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-f577313c-4956-43ad-982e-45aa85177728 tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:13:47.443508 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-f577313c-4956-43ad-982e-45aa85177728 tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:13:47.444191 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-f577313c-4956-43ad-982e-45aa85177728 tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:13:47.444633 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-f577313c-4956-43ad-982e-45aa85177728 tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:13:47.445051 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-f577313c-4956-43ad-982e-45aa85177728 tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:13:47.586209 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-f577313c-4956-43ad-982e-45aa85177728 tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d89667e52b24295ba619203c02c7bd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed5038c799342d48edc980983f1d996', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:13:47.593520 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-afb91fef-46f2-47c3-81c3-19019bc3bb43 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Calling method '>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:13:47.594133 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-afb91fef-46f2-47c3-81c3-19019bc3bb43 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] [instance: b4ba0fd3-eb17-4e05-acaa-5570c1e364d7] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:13:47.594557 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-f577313c-4956-43ad-982e-45aa85177728 tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] 10.222.0.23 "GET /compute/v2.1/servers/59e81a58-9400-4cea-aa38-b24b394e33d7" status: 200 len: 1754 microversion: 2.1 time: 0.163505 Oct 13 13:13:47.595213 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 273/529] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:13:47 2022] GET /compute/v2.1/servers/59e81a58-9400-4cea-aa38-b24b394e33d7 => generated 1754 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:13:47.600606 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-afb91fef-46f2-47c3-81c3-19019bc3bb43 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:13:47.601087 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-afb91fef-46f2-47c3-81c3-19019bc3bb43 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:13:47.601519 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-afb91fef-46f2-47c3-81c3-19019bc3bb43 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:13:47.602384 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-afb91fef-46f2-47c3-81c3-19019bc3bb43 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:13:47.602836 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-afb91fef-46f2-47c3-81c3-19019bc3bb43 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:13:47.603298 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-afb91fef-46f2-47c3-81c3-19019bc3bb43 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:13:47.729540 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-afb91fef-46f2-47c3-81c3-19019bc3bb43 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '454203f47b434cca952a1cef56de559f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7312d0ac9248f2bfbece5611913ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:13:47.738294 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-afb91fef-46f2-47c3-81c3-19019bc3bb43 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] 10.222.0.23 "GET /compute/v2.1/servers/b4ba0fd3-eb17-4e05-acaa-5570c1e364d7" status: 200 len: 1737 microversion: 2.1 time: 0.148572 Oct 13 13:13:47.738852 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 257/530] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:13:47 2022] GET /compute/v2.1/servers/b4ba0fd3-eb17-4e05-acaa-5570c1e364d7 => generated 1737 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 13:13:48.617844 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-07af58d8-64bc-4996-acb0-4ecbc18789b1 tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Calling method '>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:13:48.618612 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-07af58d8-64bc-4996-acb0-4ecbc18789b1 tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] [instance: 59e81a58-9400-4cea-aa38-b24b394e33d7] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:13:48.625238 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-07af58d8-64bc-4996-acb0-4ecbc18789b1 tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:13:48.626367 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-07af58d8-64bc-4996-acb0-4ecbc18789b1 tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:13:48.626942 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-07af58d8-64bc-4996-acb0-4ecbc18789b1 tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:13:48.627674 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-07af58d8-64bc-4996-acb0-4ecbc18789b1 tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:13:48.628132 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-07af58d8-64bc-4996-acb0-4ecbc18789b1 tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:13:48.628564 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-07af58d8-64bc-4996-acb0-4ecbc18789b1 tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:13:48.762013 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-379320fd-4355-433d-b560-531e2ab9ef59 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Calling method '>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:13:48.763265 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-379320fd-4355-433d-b560-531e2ab9ef59 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] [instance: b4ba0fd3-eb17-4e05-acaa-5570c1e364d7] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:13:48.769860 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-379320fd-4355-433d-b560-531e2ab9ef59 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:13:48.771506 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-379320fd-4355-433d-b560-531e2ab9ef59 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:13:48.772158 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-379320fd-4355-433d-b560-531e2ab9ef59 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:13:48.772868 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-379320fd-4355-433d-b560-531e2ab9ef59 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:13:48.773325 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-379320fd-4355-433d-b560-531e2ab9ef59 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:13:48.773839 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-379320fd-4355-433d-b560-531e2ab9ef59 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:13:48.778692 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-07af58d8-64bc-4996-acb0-4ecbc18789b1 tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d89667e52b24295ba619203c02c7bd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed5038c799342d48edc980983f1d996', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:13:48.786939 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-07af58d8-64bc-4996-acb0-4ecbc18789b1 tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] 10.222.0.23 "GET /compute/v2.1/servers/59e81a58-9400-4cea-aa38-b24b394e33d7" status: 200 len: 1754 microversion: 2.1 time: 0.173095 Oct 13 13:13:48.787547 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 274/531] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:13:48 2022] GET /compute/v2.1/servers/59e81a58-9400-4cea-aa38-b24b394e33d7 => generated 1754 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:13:48.906805 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-379320fd-4355-433d-b560-531e2ab9ef59 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '454203f47b434cca952a1cef56de559f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7312d0ac9248f2bfbece5611913ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:13:48.915749 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-379320fd-4355-433d-b560-531e2ab9ef59 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] 10.222.0.23 "GET /compute/v2.1/servers/b4ba0fd3-eb17-4e05-acaa-5570c1e364d7" status: 200 len: 1737 microversion: 2.1 time: 0.158101 Oct 13 13:13:48.931796 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 258/532] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:13:48 2022] GET /compute/v2.1/servers/b4ba0fd3-eb17-4e05-acaa-5570c1e364d7 => generated 1737 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 13:13:49.810326 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-622ccc3e-48f0-4313-b003-68ffdf4dd9b1 tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Calling method '>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:13:49.810938 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-622ccc3e-48f0-4313-b003-68ffdf4dd9b1 tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] [instance: 59e81a58-9400-4cea-aa38-b24b394e33d7] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:13:49.818073 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-622ccc3e-48f0-4313-b003-68ffdf4dd9b1 tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:13:49.818559 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-622ccc3e-48f0-4313-b003-68ffdf4dd9b1 tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:13:49.819032 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-622ccc3e-48f0-4313-b003-68ffdf4dd9b1 tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:13:49.819746 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-622ccc3e-48f0-4313-b003-68ffdf4dd9b1 tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:13:49.820201 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-622ccc3e-48f0-4313-b003-68ffdf4dd9b1 tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:13:49.820625 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-622ccc3e-48f0-4313-b003-68ffdf4dd9b1 tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:13:49.940708 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-9a4e2dc9-ae85-43f8-aac0-06af8d7cf05b tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Calling method '>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:13:49.941340 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-9a4e2dc9-ae85-43f8-aac0-06af8d7cf05b tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] [instance: b4ba0fd3-eb17-4e05-acaa-5570c1e364d7] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:13:49.948036 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-9a4e2dc9-ae85-43f8-aac0-06af8d7cf05b tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:13:49.948519 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-9a4e2dc9-ae85-43f8-aac0-06af8d7cf05b tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:13:49.948949 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-9a4e2dc9-ae85-43f8-aac0-06af8d7cf05b tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:13:49.949636 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-9a4e2dc9-ae85-43f8-aac0-06af8d7cf05b tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:13:49.950084 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-9a4e2dc9-ae85-43f8-aac0-06af8d7cf05b tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:13:49.950507 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-9a4e2dc9-ae85-43f8-aac0-06af8d7cf05b tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:13:49.958497 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-622ccc3e-48f0-4313-b003-68ffdf4dd9b1 tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d89667e52b24295ba619203c02c7bd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed5038c799342d48edc980983f1d996', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:13:49.966790 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-622ccc3e-48f0-4313-b003-68ffdf4dd9b1 tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] 10.222.0.23 "GET /compute/v2.1/servers/59e81a58-9400-4cea-aa38-b24b394e33d7" status: 200 len: 1754 microversion: 2.1 time: 0.160328 Oct 13 13:13:49.967390 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 275/533] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:13:49 2022] GET /compute/v2.1/servers/59e81a58-9400-4cea-aa38-b24b394e33d7 => generated 1754 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:13:50.079502 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-9a4e2dc9-ae85-43f8-aac0-06af8d7cf05b tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '454203f47b434cca952a1cef56de559f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7312d0ac9248f2bfbece5611913ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:13:50.087590 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-9a4e2dc9-ae85-43f8-aac0-06af8d7cf05b tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] 10.222.0.23 "GET /compute/v2.1/servers/b4ba0fd3-eb17-4e05-acaa-5570c1e364d7" status: 200 len: 1737 microversion: 2.1 time: 0.151470 Oct 13 13:13:50.088150 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 259/534] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:13:49 2022] GET /compute/v2.1/servers/b4ba0fd3-eb17-4e05-acaa-5570c1e364d7 => generated 1737 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 13:13:50.989668 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-86507c37-c412-4b30-b9c6-4d22652dd063 tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Calling method '>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:13:50.990275 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-86507c37-c412-4b30-b9c6-4d22652dd063 tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] [instance: 59e81a58-9400-4cea-aa38-b24b394e33d7] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:13:50.996688 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-86507c37-c412-4b30-b9c6-4d22652dd063 tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:13:50.997168 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-86507c37-c412-4b30-b9c6-4d22652dd063 tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:13:50.997710 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-86507c37-c412-4b30-b9c6-4d22652dd063 tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:13:50.998394 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-86507c37-c412-4b30-b9c6-4d22652dd063 tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:13:50.998842 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-86507c37-c412-4b30-b9c6-4d22652dd063 tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:13:50.999294 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-86507c37-c412-4b30-b9c6-4d22652dd063 tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:13:51.111578 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-fe76d3a0-e2fa-4073-9d5c-9989fc42811a tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Calling method '>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:13:51.112194 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-fe76d3a0-e2fa-4073-9d5c-9989fc42811a tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] [instance: b4ba0fd3-eb17-4e05-acaa-5570c1e364d7] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:13:51.118595 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-fe76d3a0-e2fa-4073-9d5c-9989fc42811a tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:13:51.119113 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-fe76d3a0-e2fa-4073-9d5c-9989fc42811a tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:13:51.119557 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-fe76d3a0-e2fa-4073-9d5c-9989fc42811a tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:13:51.120254 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-fe76d3a0-e2fa-4073-9d5c-9989fc42811a tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:13:51.120711 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-fe76d3a0-e2fa-4073-9d5c-9989fc42811a tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:13:51.121138 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-fe76d3a0-e2fa-4073-9d5c-9989fc42811a tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:13:51.147539 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-86507c37-c412-4b30-b9c6-4d22652dd063 tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d89667e52b24295ba619203c02c7bd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed5038c799342d48edc980983f1d996', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:13:51.155846 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-86507c37-c412-4b30-b9c6-4d22652dd063 tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] 10.222.0.23 "GET /compute/v2.1/servers/59e81a58-9400-4cea-aa38-b24b394e33d7" status: 200 len: 1754 microversion: 2.1 time: 0.169982 Oct 13 13:13:51.156631 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 276/535] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:13:50 2022] GET /compute/v2.1/servers/59e81a58-9400-4cea-aa38-b24b394e33d7 => generated 1754 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:13:51.252235 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-fe76d3a0-e2fa-4073-9d5c-9989fc42811a tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '454203f47b434cca952a1cef56de559f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7312d0ac9248f2bfbece5611913ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:13:51.260593 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-fe76d3a0-e2fa-4073-9d5c-9989fc42811a tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] 10.222.0.23 "GET /compute/v2.1/servers/b4ba0fd3-eb17-4e05-acaa-5570c1e364d7" status: 200 len: 1737 microversion: 2.1 time: 0.153436 Oct 13 13:13:51.261160 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 260/536] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:13:51 2022] GET /compute/v2.1/servers/b4ba0fd3-eb17-4e05-acaa-5570c1e364d7 => generated 1737 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 13:13:52.178392 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-773ed089-b891-4531-9f0c-69a920ca4179 tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Calling method '>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:13:52.178931 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-773ed089-b891-4531-9f0c-69a920ca4179 tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] [instance: 59e81a58-9400-4cea-aa38-b24b394e33d7] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:13:52.185433 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-773ed089-b891-4531-9f0c-69a920ca4179 tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:13:52.185913 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-773ed089-b891-4531-9f0c-69a920ca4179 tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:13:52.186350 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-773ed089-b891-4531-9f0c-69a920ca4179 tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:13:52.187036 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-773ed089-b891-4531-9f0c-69a920ca4179 tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:13:52.187516 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-773ed089-b891-4531-9f0c-69a920ca4179 tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:13:52.187942 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-773ed089-b891-4531-9f0c-69a920ca4179 tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:13:52.283545 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-41dad900-881b-45f2-940d-b753e0d20400 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Calling method '>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:13:52.284269 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-41dad900-881b-45f2-940d-b753e0d20400 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] [instance: b4ba0fd3-eb17-4e05-acaa-5570c1e364d7] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:13:52.290685 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-41dad900-881b-45f2-940d-b753e0d20400 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:13:52.291183 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-41dad900-881b-45f2-940d-b753e0d20400 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:13:52.291717 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-41dad900-881b-45f2-940d-b753e0d20400 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:13:52.292412 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-41dad900-881b-45f2-940d-b753e0d20400 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:13:52.292863 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-41dad900-881b-45f2-940d-b753e0d20400 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:13:52.293286 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-41dad900-881b-45f2-940d-b753e0d20400 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:13:52.327178 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-773ed089-b891-4531-9f0c-69a920ca4179 tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d89667e52b24295ba619203c02c7bd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed5038c799342d48edc980983f1d996', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:13:52.336415 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-773ed089-b891-4531-9f0c-69a920ca4179 tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] 10.222.0.23 "GET /compute/v2.1/servers/59e81a58-9400-4cea-aa38-b24b394e33d7" status: 200 len: 1757 microversion: 2.1 time: 0.162162 Oct 13 13:13:52.336989 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 277/537] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:13:52 2022] GET /compute/v2.1/servers/59e81a58-9400-4cea-aa38-b24b394e33d7 => generated 1757 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:13:52.423468 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-41dad900-881b-45f2-940d-b753e0d20400 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '454203f47b434cca952a1cef56de559f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7312d0ac9248f2bfbece5611913ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:13:52.432021 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-41dad900-881b-45f2-940d-b753e0d20400 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] 10.222.0.23 "GET /compute/v2.1/servers/b4ba0fd3-eb17-4e05-acaa-5570c1e364d7" status: 200 len: 1737 microversion: 2.1 time: 0.152303 Oct 13 13:13:52.432528 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 261/538] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:13:52 2022] GET /compute/v2.1/servers/b4ba0fd3-eb17-4e05-acaa-5570c1e364d7 => generated 1737 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 13:13:53.455509 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-4120c883-2eac-4a88-90e1-26b87b6e02e3 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Calling method '>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:13:53.456140 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-4120c883-2eac-4a88-90e1-26b87b6e02e3 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] [instance: b4ba0fd3-eb17-4e05-acaa-5570c1e364d7] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:13:53.462713 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-4120c883-2eac-4a88-90e1-26b87b6e02e3 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:13:53.463230 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-4120c883-2eac-4a88-90e1-26b87b6e02e3 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:13:53.463668 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-4120c883-2eac-4a88-90e1-26b87b6e02e3 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:13:53.464362 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-4120c883-2eac-4a88-90e1-26b87b6e02e3 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:13:53.464818 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-4120c883-2eac-4a88-90e1-26b87b6e02e3 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:13:53.465251 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-4120c883-2eac-4a88-90e1-26b87b6e02e3 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:13:53.596562 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-4120c883-2eac-4a88-90e1-26b87b6e02e3 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '454203f47b434cca952a1cef56de559f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7312d0ac9248f2bfbece5611913ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:13:53.605197 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-4120c883-2eac-4a88-90e1-26b87b6e02e3 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] 10.222.0.23 "GET /compute/v2.1/servers/b4ba0fd3-eb17-4e05-acaa-5570c1e364d7" status: 200 len: 1737 microversion: 2.1 time: 0.153557 Oct 13 13:13:53.605772 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 278/539] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:13:53 2022] GET /compute/v2.1/servers/b4ba0fd3-eb17-4e05-acaa-5570c1e364d7 => generated 1737 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:13:54.628948 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-39d03cda-2f5d-4fb5-82ef-50e6b78c53ad tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Calling method '>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:13:54.629550 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-39d03cda-2f5d-4fb5-82ef-50e6b78c53ad tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] [instance: b4ba0fd3-eb17-4e05-acaa-5570c1e364d7] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:13:54.636022 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-39d03cda-2f5d-4fb5-82ef-50e6b78c53ad tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:13:54.636501 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-39d03cda-2f5d-4fb5-82ef-50e6b78c53ad tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:13:54.636940 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-39d03cda-2f5d-4fb5-82ef-50e6b78c53ad tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:13:54.637619 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-39d03cda-2f5d-4fb5-82ef-50e6b78c53ad tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:13:54.638072 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-39d03cda-2f5d-4fb5-82ef-50e6b78c53ad tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:13:54.638501 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-39d03cda-2f5d-4fb5-82ef-50e6b78c53ad tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:13:54.764053 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-39d03cda-2f5d-4fb5-82ef-50e6b78c53ad tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '454203f47b434cca952a1cef56de559f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7312d0ac9248f2bfbece5611913ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:13:54.772786 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-39d03cda-2f5d-4fb5-82ef-50e6b78c53ad tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] 10.222.0.23 "GET /compute/v2.1/servers/b4ba0fd3-eb17-4e05-acaa-5570c1e364d7" status: 200 len: 1737 microversion: 2.1 time: 0.148153 Oct 13 13:13:54.773339 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 262/540] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:13:54 2022] GET /compute/v2.1/servers/b4ba0fd3-eb17-4e05-acaa-5570c1e364d7 => generated 1737 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:13:55.795560 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-adf2e739-3eb5-433c-8269-e205a5138aa6 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Calling method '>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:13:55.796164 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-adf2e739-3eb5-433c-8269-e205a5138aa6 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] [instance: b4ba0fd3-eb17-4e05-acaa-5570c1e364d7] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:13:55.802934 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-adf2e739-3eb5-433c-8269-e205a5138aa6 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:13:55.803439 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-adf2e739-3eb5-433c-8269-e205a5138aa6 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:13:55.803875 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-adf2e739-3eb5-433c-8269-e205a5138aa6 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:13:55.804552 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-adf2e739-3eb5-433c-8269-e205a5138aa6 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:13:55.805000 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-adf2e739-3eb5-433c-8269-e205a5138aa6 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:13:55.805422 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-adf2e739-3eb5-433c-8269-e205a5138aa6 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:13:55.934189 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-adf2e739-3eb5-433c-8269-e205a5138aa6 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '454203f47b434cca952a1cef56de559f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7312d0ac9248f2bfbece5611913ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:13:55.942301 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-adf2e739-3eb5-433c-8269-e205a5138aa6 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] 10.222.0.23 "GET /compute/v2.1/servers/b4ba0fd3-eb17-4e05-acaa-5570c1e364d7" status: 200 len: 1737 microversion: 2.1 time: 0.150575 Oct 13 13:13:55.942856 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 279/541] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:13:55 2022] GET /compute/v2.1/servers/b4ba0fd3-eb17-4e05-acaa-5570c1e364d7 => generated 1737 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:13:56.965661 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-2850b563-e53e-468c-9d6f-bfae60dbec78 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Calling method '>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:13:56.966296 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-2850b563-e53e-468c-9d6f-bfae60dbec78 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] [instance: b4ba0fd3-eb17-4e05-acaa-5570c1e364d7] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:13:56.973320 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-2850b563-e53e-468c-9d6f-bfae60dbec78 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:13:56.973805 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-2850b563-e53e-468c-9d6f-bfae60dbec78 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:13:56.974243 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-2850b563-e53e-468c-9d6f-bfae60dbec78 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:13:56.974931 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-2850b563-e53e-468c-9d6f-bfae60dbec78 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:13:56.975418 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-2850b563-e53e-468c-9d6f-bfae60dbec78 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:13:56.975849 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-2850b563-e53e-468c-9d6f-bfae60dbec78 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:13:57.102236 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-2850b563-e53e-468c-9d6f-bfae60dbec78 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '454203f47b434cca952a1cef56de559f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7312d0ac9248f2bfbece5611913ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:13:57.111123 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-2850b563-e53e-468c-9d6f-bfae60dbec78 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] 10.222.0.23 "GET /compute/v2.1/servers/b4ba0fd3-eb17-4e05-acaa-5570c1e364d7" status: 200 len: 1737 microversion: 2.1 time: 0.149283 Oct 13 13:13:57.111897 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 263/542] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:13:56 2022] GET /compute/v2.1/servers/b4ba0fd3-eb17-4e05-acaa-5570c1e364d7 => generated 1737 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:13:58.133605 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-c49a4c32-2d46-47ac-9b11-13ebce2bfbb5 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Calling method '>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:13:58.134244 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-c49a4c32-2d46-47ac-9b11-13ebce2bfbb5 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] [instance: b4ba0fd3-eb17-4e05-acaa-5570c1e364d7] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:13:58.140663 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-c49a4c32-2d46-47ac-9b11-13ebce2bfbb5 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:13:58.141146 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-c49a4c32-2d46-47ac-9b11-13ebce2bfbb5 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:13:58.141580 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-c49a4c32-2d46-47ac-9b11-13ebce2bfbb5 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:13:58.142265 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-c49a4c32-2d46-47ac-9b11-13ebce2bfbb5 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:13:58.142715 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-c49a4c32-2d46-47ac-9b11-13ebce2bfbb5 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:13:58.143174 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-c49a4c32-2d46-47ac-9b11-13ebce2bfbb5 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:13:58.273498 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-c49a4c32-2d46-47ac-9b11-13ebce2bfbb5 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '454203f47b434cca952a1cef56de559f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7312d0ac9248f2bfbece5611913ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:13:58.282174 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-c49a4c32-2d46-47ac-9b11-13ebce2bfbb5 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] 10.222.0.23 "GET /compute/v2.1/servers/b4ba0fd3-eb17-4e05-acaa-5570c1e364d7" status: 200 len: 1737 microversion: 2.1 time: 0.151904 Oct 13 13:13:58.282732 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 280/543] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:13:58 2022] GET /compute/v2.1/servers/b4ba0fd3-eb17-4e05-acaa-5570c1e364d7 => generated 1737 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:13:58.393989 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-a3a5c99e-4f0b-4003-9198-3d3b195f8be9 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Calling method '>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:13:58.394553 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-a3a5c99e-4f0b-4003-9198-3d3b195f8be9 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] [instance: 26bd475b-3495-4669-9985-d4a7dedb4bbf] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:13:58.400881 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-a3a5c99e-4f0b-4003-9198-3d3b195f8be9 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:13:58.401354 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-a3a5c99e-4f0b-4003-9198-3d3b195f8be9 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:13:58.401781 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-a3a5c99e-4f0b-4003-9198-3d3b195f8be9 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:13:58.402458 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-a3a5c99e-4f0b-4003-9198-3d3b195f8be9 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:13:58.402901 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-a3a5c99e-4f0b-4003-9198-3d3b195f8be9 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:13:58.403347 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-a3a5c99e-4f0b-4003-9198-3d3b195f8be9 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:13:58.434074 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-a3a5c99e-4f0b-4003-9198-3d3b195f8be9 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] 10.222.0.23 "GET /compute/v2.1/servers/26bd475b-3495-4669-9985-d4a7dedb4bbf/os-volume_attachments/ff067956-f298-4976-ae50-a3a9f77d18f4" status: 200 len: 194 microversion: 2.20 time: 0.044112 Oct 13 13:13:58.434634 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 264/544] 10.222.0.23 () {60 vars in 1454 bytes} [Thu Oct 13 13:13:58 2022] GET /compute/v2.1/servers/26bd475b-3495-4669-9985-d4a7dedb4bbf/os-volume_attachments/ff067956-f298-4976-ae50-a3a9f77d18f4 => generated 194 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 13 13:13:58.500561 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-02e4f9bd-bb6e-4787-a207-5c9808874679 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Calling method '>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:13:58.501050 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-02e4f9bd-bb6e-4787-a207-5c9808874679 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] [instance: 26bd475b-3495-4669-9985-d4a7dedb4bbf] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:13:58.506928 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-02e4f9bd-bb6e-4787-a207-5c9808874679 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:13:58.507439 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-02e4f9bd-bb6e-4787-a207-5c9808874679 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:13:58.507876 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-02e4f9bd-bb6e-4787-a207-5c9808874679 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:13:58.508560 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-02e4f9bd-bb6e-4787-a207-5c9808874679 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:13:58.509010 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-02e4f9bd-bb6e-4787-a207-5c9808874679 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:13:58.509433 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-02e4f9bd-bb6e-4787-a207-5c9808874679 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:13:58.587936 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.objects.instance [None req-02e4f9bd-bb6e-4787-a207-5c9808874679 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lazy-loading 'services' on Instance uuid 26bd475b-3495-4669-9985-d4a7dedb4bbf {{(pid=118814) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 13 13:13:58.658688 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-02e4f9bd-bb6e-4787-a207-5c9808874679 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] 10.222.0.23 "DELETE /compute/v2.1/servers/26bd475b-3495-4669-9985-d4a7dedb4bbf/os-volume_attachments/ff067956-f298-4976-ae50-a3a9f77d18f4" status: 202 len: 0 microversion: 2.20 time: 0.161894 Oct 13 13:13:58.659507 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 281/545] 10.222.0.23 () {60 vars in 1457 bytes} [Thu Oct 13 13:13:58 2022] DELETE /compute/v2.1/servers/26bd475b-3495-4669-9985-d4a7dedb4bbf/os-volume_attachments/ff067956-f298-4976-ae50-a3a9f77d18f4 => generated 0 bytes in 164 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 13 13:13:58.667922 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-730b4b4c-cfc4-4478-a197-a27e6b8285bc tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Calling method '>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:13:58.670235 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-730b4b4c-cfc4-4478-a197-a27e6b8285bc tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] [instance: 26bd475b-3495-4669-9985-d4a7dedb4bbf] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:13:58.676651 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-730b4b4c-cfc4-4478-a197-a27e6b8285bc tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:13:58.677125 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-730b4b4c-cfc4-4478-a197-a27e6b8285bc tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:13:58.677553 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-730b4b4c-cfc4-4478-a197-a27e6b8285bc tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:13:58.678237 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-730b4b4c-cfc4-4478-a197-a27e6b8285bc tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:13:58.678688 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-730b4b4c-cfc4-4478-a197-a27e6b8285bc tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:13:58.679129 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-730b4b4c-cfc4-4478-a197-a27e6b8285bc tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:13:58.709056 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-730b4b4c-cfc4-4478-a197-a27e6b8285bc tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] 10.222.0.23 "GET /compute/v2.1/servers/26bd475b-3495-4669-9985-d4a7dedb4bbf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045021 Oct 13 13:13:58.709444 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 265/546] 10.222.0.23 () {60 vars in 1343 bytes} [Thu Oct 13 13:13:58 2022] GET /compute/v2.1/servers/26bd475b-3495-4669-9985-d4a7dedb4bbf/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 13 13:13:59.306472 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-3809f455-f222-4db4-9572-4197625e85a0 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Calling method '>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:13:59.307214 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-3809f455-f222-4db4-9572-4197625e85a0 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] [instance: b4ba0fd3-eb17-4e05-acaa-5570c1e364d7] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:13:59.313772 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-3809f455-f222-4db4-9572-4197625e85a0 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:13:59.314251 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-3809f455-f222-4db4-9572-4197625e85a0 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:13:59.314687 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-3809f455-f222-4db4-9572-4197625e85a0 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:13:59.315399 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-3809f455-f222-4db4-9572-4197625e85a0 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:13:59.315853 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-3809f455-f222-4db4-9572-4197625e85a0 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:13:59.316279 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-3809f455-f222-4db4-9572-4197625e85a0 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:13:59.449261 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-3809f455-f222-4db4-9572-4197625e85a0 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '454203f47b434cca952a1cef56de559f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7312d0ac9248f2bfbece5611913ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:13:59.457970 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-3809f455-f222-4db4-9572-4197625e85a0 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] 10.222.0.23 "GET /compute/v2.1/servers/b4ba0fd3-eb17-4e05-acaa-5570c1e364d7" status: 200 len: 1737 microversion: 2.1 time: 0.155731 Oct 13 13:13:59.458535 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 282/547] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:13:59 2022] GET /compute/v2.1/servers/b4ba0fd3-eb17-4e05-acaa-5570c1e364d7 => generated 1737 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:13:59.722351 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-ba78ff9f-1b70-4993-bea0-bee4d98597d2 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Calling method '>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:13:59.724494 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-ba78ff9f-1b70-4993-bea0-bee4d98597d2 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] [instance: 26bd475b-3495-4669-9985-d4a7dedb4bbf] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:13:59.730839 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-ba78ff9f-1b70-4993-bea0-bee4d98597d2 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:13:59.731341 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-ba78ff9f-1b70-4993-bea0-bee4d98597d2 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:13:59.731773 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-ba78ff9f-1b70-4993-bea0-bee4d98597d2 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:13:59.732448 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-ba78ff9f-1b70-4993-bea0-bee4d98597d2 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:13:59.732893 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-ba78ff9f-1b70-4993-bea0-bee4d98597d2 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:13:59.733312 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-ba78ff9f-1b70-4993-bea0-bee4d98597d2 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:13:59.761559 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-ba78ff9f-1b70-4993-bea0-bee4d98597d2 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] 10.222.0.23 "GET /compute/v2.1/servers/26bd475b-3495-4669-9985-d4a7dedb4bbf/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.043978 Oct 13 13:13:59.762103 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 266/548] 10.222.0.23 () {60 vars in 1343 bytes} [Thu Oct 13 13:13:59 2022] GET /compute/v2.1/servers/26bd475b-3495-4669-9985-d4a7dedb4bbf/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:13:59.825223 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-ce5b1957-67b1-42b5-a9b9-b15af9d10322 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Calling method '>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:13:59.825724 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-ce5b1957-67b1-42b5-a9b9-b15af9d10322 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] [instance: 26bd475b-3495-4669-9985-d4a7dedb4bbf] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:13:59.832286 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-ce5b1957-67b1-42b5-a9b9-b15af9d10322 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:13:59.832770 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-ce5b1957-67b1-42b5-a9b9-b15af9d10322 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:13:59.833211 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-ce5b1957-67b1-42b5-a9b9-b15af9d10322 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:13:59.833898 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-ce5b1957-67b1-42b5-a9b9-b15af9d10322 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:13:59.834354 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-ce5b1957-67b1-42b5-a9b9-b15af9d10322 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:13:59.834780 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-ce5b1957-67b1-42b5-a9b9-b15af9d10322 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:13:59.853552 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG dbcounter [-] [118814] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=118814) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:13:59.859828 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-ce5b1957-67b1-42b5-a9b9-b15af9d10322 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] [instance: 26bd475b-3495-4669-9985-d4a7dedb4bbf] Going to try to terminate instance {{(pid=118814) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 13 13:13:59.941805 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-ce5b1957-67b1-42b5-a9b9-b15af9d10322 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] 10.222.0.23 "DELETE /compute/v2.1/servers/26bd475b-3495-4669-9985-d4a7dedb4bbf" status: 204 len: 0 microversion: 2.20 time: 0.120172 Oct 13 13:13:59.942573 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 283/549] 10.222.0.23 () {60 vars in 1280 bytes} [Thu Oct 13 13:13:59 2022] DELETE /compute/v2.1/servers/26bd475b-3495-4669-9985-d4a7dedb4bbf => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 13 13:13:59.950703 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-0f58b7f0-5094-4f7f-af61-1d7fab2882ec tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Calling method '>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:13:59.951322 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-0f58b7f0-5094-4f7f-af61-1d7fab2882ec tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] [instance: 26bd475b-3495-4669-9985-d4a7dedb4bbf] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:13:59.957763 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-0f58b7f0-5094-4f7f-af61-1d7fab2882ec tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:13:59.958237 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-0f58b7f0-5094-4f7f-af61-1d7fab2882ec tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:13:59.958667 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-0f58b7f0-5094-4f7f-af61-1d7fab2882ec tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:13:59.959371 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-0f58b7f0-5094-4f7f-af61-1d7fab2882ec tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:13:59.959820 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-0f58b7f0-5094-4f7f-af61-1d7fab2882ec tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:13:59.960236 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-0f58b7f0-5094-4f7f-af61-1d7fab2882ec tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:14:00.085247 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-0f58b7f0-5094-4f7f-af61-1d7fab2882ec tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:14:00.093250 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-0f58b7f0-5094-4f7f-af61-1d7fab2882ec tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:14:00.094683 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-0f58b7f0-5094-4f7f-af61-1d7fab2882ec tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:14:00.095858 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-0f58b7f0-5094-4f7f-af61-1d7fab2882ec tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] 10.222.0.23 "GET /compute/v2.1/servers/26bd475b-3495-4669-9985-d4a7dedb4bbf" status: 200 len: 1724 microversion: 2.20 time: 0.149065 Oct 13 13:14:00.096398 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 267/550] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 13:13:59 2022] GET /compute/v2.1/servers/26bd475b-3495-4669-9985-d4a7dedb4bbf => generated 1724 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 13:14:00.481364 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-52f37ffd-26c9-4aea-8049-51f0cd7d6002 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Calling method '>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:14:00.482069 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-52f37ffd-26c9-4aea-8049-51f0cd7d6002 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] [instance: b4ba0fd3-eb17-4e05-acaa-5570c1e364d7] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:14:00.488509 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-52f37ffd-26c9-4aea-8049-51f0cd7d6002 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:14:00.488999 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-52f37ffd-26c9-4aea-8049-51f0cd7d6002 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:14:00.489440 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-52f37ffd-26c9-4aea-8049-51f0cd7d6002 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:14:00.490131 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-52f37ffd-26c9-4aea-8049-51f0cd7d6002 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:14:00.490585 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-52f37ffd-26c9-4aea-8049-51f0cd7d6002 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:14:00.491014 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-52f37ffd-26c9-4aea-8049-51f0cd7d6002 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:14:00.619213 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-52f37ffd-26c9-4aea-8049-51f0cd7d6002 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '454203f47b434cca952a1cef56de559f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7312d0ac9248f2bfbece5611913ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:14:00.627984 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-52f37ffd-26c9-4aea-8049-51f0cd7d6002 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] 10.222.0.23 "GET /compute/v2.1/servers/b4ba0fd3-eb17-4e05-acaa-5570c1e364d7" status: 200 len: 1737 microversion: 2.1 time: 0.150937 Oct 13 13:14:00.628577 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 284/551] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:14:00 2022] GET /compute/v2.1/servers/b4ba0fd3-eb17-4e05-acaa-5570c1e364d7 => generated 1737 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:14:01.122778 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-dfb84131-0928-401d-b7c5-4ae431d238b9 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Calling method '>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:14:01.123399 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-dfb84131-0928-401d-b7c5-4ae431d238b9 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] [instance: 26bd475b-3495-4669-9985-d4a7dedb4bbf] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:14:01.130720 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-dfb84131-0928-401d-b7c5-4ae431d238b9 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:14:01.131238 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-dfb84131-0928-401d-b7c5-4ae431d238b9 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:14:01.131672 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-dfb84131-0928-401d-b7c5-4ae431d238b9 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:14:01.132349 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-dfb84131-0928-401d-b7c5-4ae431d238b9 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:14:01.132793 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-dfb84131-0928-401d-b7c5-4ae431d238b9 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:14:01.133209 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-dfb84131-0928-401d-b7c5-4ae431d238b9 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:14:01.259377 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-dfb84131-0928-401d-b7c5-4ae431d238b9 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:14:01.267579 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-dfb84131-0928-401d-b7c5-4ae431d238b9 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:14:01.269034 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-dfb84131-0928-401d-b7c5-4ae431d238b9 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:14:01.270257 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-dfb84131-0928-401d-b7c5-4ae431d238b9 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] 10.222.0.23 "GET /compute/v2.1/servers/26bd475b-3495-4669-9985-d4a7dedb4bbf" status: 200 len: 1724 microversion: 2.20 time: 0.151365 Oct 13 13:14:01.270824 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 268/552] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 13:14:01 2022] GET /compute/v2.1/servers/26bd475b-3495-4669-9985-d4a7dedb4bbf => generated 1724 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 13:14:01.651797 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-8856d5cf-0c65-4118-a73d-a546579086e7 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Calling method '>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:14:01.652471 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-8856d5cf-0c65-4118-a73d-a546579086e7 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] [instance: b4ba0fd3-eb17-4e05-acaa-5570c1e364d7] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:14:01.659662 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-8856d5cf-0c65-4118-a73d-a546579086e7 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:14:01.660151 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-8856d5cf-0c65-4118-a73d-a546579086e7 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:14:01.660593 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-8856d5cf-0c65-4118-a73d-a546579086e7 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:14:01.661284 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-8856d5cf-0c65-4118-a73d-a546579086e7 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:14:01.661742 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-8856d5cf-0c65-4118-a73d-a546579086e7 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:14:01.662171 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-8856d5cf-0c65-4118-a73d-a546579086e7 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:14:01.791916 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-8856d5cf-0c65-4118-a73d-a546579086e7 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '454203f47b434cca952a1cef56de559f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7312d0ac9248f2bfbece5611913ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:14:01.800618 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-8856d5cf-0c65-4118-a73d-a546579086e7 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] 10.222.0.23 "GET /compute/v2.1/servers/b4ba0fd3-eb17-4e05-acaa-5570c1e364d7" status: 200 len: 1737 microversion: 2.1 time: 0.152568 Oct 13 13:14:01.801176 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 285/553] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:14:01 2022] GET /compute/v2.1/servers/b4ba0fd3-eb17-4e05-acaa-5570c1e364d7 => generated 1737 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:14:02.298383 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-c423ec96-9865-4497-b0f1-9f30df13b21d tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Calling method '>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:14:02.298992 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-c423ec96-9865-4497-b0f1-9f30df13b21d tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] [instance: 26bd475b-3495-4669-9985-d4a7dedb4bbf] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:14:02.305657 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-c423ec96-9865-4497-b0f1-9f30df13b21d tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:14:02.306141 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-c423ec96-9865-4497-b0f1-9f30df13b21d tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:14:02.306579 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-c423ec96-9865-4497-b0f1-9f30df13b21d tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:14:02.307306 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-c423ec96-9865-4497-b0f1-9f30df13b21d tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:14:02.307767 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-c423ec96-9865-4497-b0f1-9f30df13b21d tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:14:02.308190 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-c423ec96-9865-4497-b0f1-9f30df13b21d tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:14:02.322557 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG dbcounter [-] [118815] Writing DB stats nova_cell1:SELECT=100 {{(pid=118815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:14:02.433712 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-c423ec96-9865-4497-b0f1-9f30df13b21d tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:14:02.441691 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-c423ec96-9865-4497-b0f1-9f30df13b21d tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:14:02.443179 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-c423ec96-9865-4497-b0f1-9f30df13b21d tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:14:02.444337 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-c423ec96-9865-4497-b0f1-9f30df13b21d tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] 10.222.0.23 "GET /compute/v2.1/servers/26bd475b-3495-4669-9985-d4a7dedb4bbf" status: 200 len: 1724 microversion: 2.20 time: 0.150509 Oct 13 13:14:02.444891 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 269/554] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 13:14:02 2022] GET /compute/v2.1/servers/26bd475b-3495-4669-9985-d4a7dedb4bbf => generated 1724 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 13:14:02.823459 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-87f1f20d-2f37-4b29-9eb6-18f46c355450 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Calling method '>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:14:02.824063 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-87f1f20d-2f37-4b29-9eb6-18f46c355450 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] [instance: b4ba0fd3-eb17-4e05-acaa-5570c1e364d7] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:14:02.831013 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-87f1f20d-2f37-4b29-9eb6-18f46c355450 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:14:02.831531 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-87f1f20d-2f37-4b29-9eb6-18f46c355450 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:14:02.831960 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-87f1f20d-2f37-4b29-9eb6-18f46c355450 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:14:02.832638 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-87f1f20d-2f37-4b29-9eb6-18f46c355450 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:14:02.833085 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-87f1f20d-2f37-4b29-9eb6-18f46c355450 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:14:02.833505 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-87f1f20d-2f37-4b29-9eb6-18f46c355450 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:14:02.962355 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-87f1f20d-2f37-4b29-9eb6-18f46c355450 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '454203f47b434cca952a1cef56de559f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7312d0ac9248f2bfbece5611913ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:14:02.971005 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-87f1f20d-2f37-4b29-9eb6-18f46c355450 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] 10.222.0.23 "GET /compute/v2.1/servers/b4ba0fd3-eb17-4e05-acaa-5570c1e364d7" status: 200 len: 1737 microversion: 2.1 time: 0.151310 Oct 13 13:14:02.971624 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 286/555] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:14:02 2022] GET /compute/v2.1/servers/b4ba0fd3-eb17-4e05-acaa-5570c1e364d7 => generated 1737 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:14:03.471393 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-ad4f69e4-ab17-4fe8-8f9f-a5a37e625c63 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Calling method '>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:14:03.472338 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-ad4f69e4-ab17-4fe8-8f9f-a5a37e625c63 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] [instance: 26bd475b-3495-4669-9985-d4a7dedb4bbf] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:14:03.479705 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-ad4f69e4-ab17-4fe8-8f9f-a5a37e625c63 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:14:03.480184 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-ad4f69e4-ab17-4fe8-8f9f-a5a37e625c63 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:14:03.480617 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-ad4f69e4-ab17-4fe8-8f9f-a5a37e625c63 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:14:03.481302 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-ad4f69e4-ab17-4fe8-8f9f-a5a37e625c63 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:14:03.481778 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-ad4f69e4-ab17-4fe8-8f9f-a5a37e625c63 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:14:03.482252 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-ad4f69e4-ab17-4fe8-8f9f-a5a37e625c63 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:14:03.555116 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-ad4f69e4-ab17-4fe8-8f9f-a5a37e625c63 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:14:03.563777 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-ad4f69e4-ab17-4fe8-8f9f-a5a37e625c63 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:14:03.565255 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-ad4f69e4-ab17-4fe8-8f9f-a5a37e625c63 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:14:03.566400 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-ad4f69e4-ab17-4fe8-8f9f-a5a37e625c63 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] 10.222.0.23 "GET /compute/v2.1/servers/26bd475b-3495-4669-9985-d4a7dedb4bbf" status: 200 len: 1657 microversion: 2.20 time: 0.100328 Oct 13 13:14:03.566948 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 270/556] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 13:14:03 2022] GET /compute/v2.1/servers/26bd475b-3495-4669-9985-d4a7dedb4bbf => generated 1657 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 13 13:14:03.816734 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [req-80da1ec0-e8a4-43a9-835f-39e6a459f268 req-bf4822f7-4629-42e3-890c-0a3e5a78fac8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "26bd475b-3495-4669-9985-d4a7dedb4bbf", "name": "network-vif-deleted", "tag": "bd0eddba-ab0b-4c35-805b-853067734898"}]} {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 13:14:03.826236 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [req-80da1ec0-e8a4-43a9-835f-39e6a459f268 req-bf4822f7-4629-42e3-890c-0a3e5a78fac8 service nova] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:14:03.826875 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [req-80da1ec0-e8a4-43a9-835f-39e6a459f268 req-bf4822f7-4629-42e3-890c-0a3e5a78fac8 service nova] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:14:03.827161 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [req-80da1ec0-e8a4-43a9-835f-39e6a459f268 req-bf4822f7-4629-42e3-890c-0a3e5a78fac8 service nova] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:14:03.839603 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.compute.server_external_events [req-80da1ec0-e8a4-43a9-835f-39e6a459f268 req-bf4822f7-4629-42e3-890c-0a3e5a78fac8 service nova] Creating event network-vif-deleted:bd0eddba-ab0b-4c35-805b-853067734898 for instance 26bd475b-3495-4669-9985-d4a7dedb4bbf on hv-cinder-82660 Oct 13 13:14:03.844682 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [req-80da1ec0-e8a4-43a9-835f-39e6a459f268 req-bf4822f7-4629-42e3-890c-0a3e5a78fac8 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032168 Oct 13 13:14:03.845269 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 287/557] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 13:14:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 13:14:03.994281 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-66218024-d559-4484-a08e-839f248d6ddb tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Calling method '>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:14:03.994809 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-66218024-d559-4484-a08e-839f248d6ddb tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] [instance: b4ba0fd3-eb17-4e05-acaa-5570c1e364d7] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:14:04.001529 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-66218024-d559-4484-a08e-839f248d6ddb tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:14:04.002013 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-66218024-d559-4484-a08e-839f248d6ddb tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:14:04.002455 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-66218024-d559-4484-a08e-839f248d6ddb tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:14:04.003179 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-66218024-d559-4484-a08e-839f248d6ddb tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:14:04.003633 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-66218024-d559-4484-a08e-839f248d6ddb tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:14:04.004063 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-66218024-d559-4484-a08e-839f248d6ddb tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:14:04.141596 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-66218024-d559-4484-a08e-839f248d6ddb tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '454203f47b434cca952a1cef56de559f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7312d0ac9248f2bfbece5611913ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:14:04.149955 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-66218024-d559-4484-a08e-839f248d6ddb tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] 10.222.0.23 "GET /compute/v2.1/servers/b4ba0fd3-eb17-4e05-acaa-5570c1e364d7" status: 200 len: 1737 microversion: 2.1 time: 0.160038 Oct 13 13:14:04.150652 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 271/558] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:14:03 2022] GET /compute/v2.1/servers/b4ba0fd3-eb17-4e05-acaa-5570c1e364d7 => generated 1737 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:14:04.593645 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-b25cd14f-b7cd-4891-be52-82eac5dd2745 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Calling method '>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:14:04.594389 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-b25cd14f-b7cd-4891-be52-82eac5dd2745 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] [instance: 26bd475b-3495-4669-9985-d4a7dedb4bbf] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:14:04.600949 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-b25cd14f-b7cd-4891-be52-82eac5dd2745 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:14:04.601472 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-b25cd14f-b7cd-4891-be52-82eac5dd2745 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:14:04.601887 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-b25cd14f-b7cd-4891-be52-82eac5dd2745 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:14:04.602771 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-b25cd14f-b7cd-4891-be52-82eac5dd2745 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:14:04.603466 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-b25cd14f-b7cd-4891-be52-82eac5dd2745 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:14:04.604055 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-b25cd14f-b7cd-4891-be52-82eac5dd2745 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:14:04.640435 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-b25cd14f-b7cd-4891-be52-82eac5dd2745 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:14:04.641150 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-b25cd14f-b7cd-4891-be52-82eac5dd2745 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:14:04.641748 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-b25cd14f-b7cd-4891-be52-82eac5dd2745 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:14:04.642367 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.objects.instance [None req-b25cd14f-b7cd-4891-be52-82eac5dd2745 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lazy-loading 'fault' on Instance uuid 26bd475b-3495-4669-9985-d4a7dedb4bbf {{(pid=118814) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 13 13:14:04.692431 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-b25cd14f-b7cd-4891-be52-82eac5dd2745 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:14:04.701216 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-b25cd14f-b7cd-4891-be52-82eac5dd2745 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:14:04.702671 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-b25cd14f-b7cd-4891-be52-82eac5dd2745 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:14:04.703889 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-b25cd14f-b7cd-4891-be52-82eac5dd2745 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] 10.222.0.23 "GET /compute/v2.1/servers/26bd475b-3495-4669-9985-d4a7dedb4bbf" status: 200 len: 1372 microversion: 2.20 time: 0.115396 Oct 13 13:14:04.704614 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 288/559] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 13:14:04 2022] GET /compute/v2.1/servers/26bd475b-3495-4669-9985-d4a7dedb4bbf => generated 1372 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 13:14:05.174283 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-a4eb1c71-f9e6-42c1-9ffd-2d62513850f6 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Calling method '>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:14:05.175276 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-a4eb1c71-f9e6-42c1-9ffd-2d62513850f6 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] [instance: b4ba0fd3-eb17-4e05-acaa-5570c1e364d7] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:14:05.181714 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-a4eb1c71-f9e6-42c1-9ffd-2d62513850f6 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:14:05.182198 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-a4eb1c71-f9e6-42c1-9ffd-2d62513850f6 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:14:05.182633 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-a4eb1c71-f9e6-42c1-9ffd-2d62513850f6 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:14:05.183351 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-a4eb1c71-f9e6-42c1-9ffd-2d62513850f6 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:14:05.183805 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-a4eb1c71-f9e6-42c1-9ffd-2d62513850f6 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:14:05.184229 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-a4eb1c71-f9e6-42c1-9ffd-2d62513850f6 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:14:05.312548 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-a4eb1c71-f9e6-42c1-9ffd-2d62513850f6 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '454203f47b434cca952a1cef56de559f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7312d0ac9248f2bfbece5611913ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:14:05.320697 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-a4eb1c71-f9e6-42c1-9ffd-2d62513850f6 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] 10.222.0.23 "GET /compute/v2.1/servers/b4ba0fd3-eb17-4e05-acaa-5570c1e364d7" status: 200 len: 1717 microversion: 2.1 time: 0.151014 Oct 13 13:14:05.321258 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 272/560] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:14:05 2022] GET /compute/v2.1/servers/b4ba0fd3-eb17-4e05-acaa-5570c1e364d7 => generated 1717 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:14:05.430088 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-55aa6100-6628-4394-a26d-e9ccfc0c2ff2 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Calling method '>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:14:05.430603 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-55aa6100-6628-4394-a26d-e9ccfc0c2ff2 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] [instance: b4ba0fd3-eb17-4e05-acaa-5570c1e364d7] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:14:05.437034 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-55aa6100-6628-4394-a26d-e9ccfc0c2ff2 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:14:05.437566 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-55aa6100-6628-4394-a26d-e9ccfc0c2ff2 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:14:05.438056 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-55aa6100-6628-4394-a26d-e9ccfc0c2ff2 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:14:05.438735 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-55aa6100-6628-4394-a26d-e9ccfc0c2ff2 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:14:05.439217 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-55aa6100-6628-4394-a26d-e9ccfc0c2ff2 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:14:05.439641 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-55aa6100-6628-4394-a26d-e9ccfc0c2ff2 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:14:05.524474 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.wsgi [None req-55aa6100-6628-4394-a26d-e9ccfc0c2ff2 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] HTTP exception thrown: Cannot 'detach_volume' instance b4ba0fd3-eb17-4e05-acaa-5570c1e364d7 while it is in vm_state rescued Oct 13 13:14:05.526347 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-55aa6100-6628-4394-a26d-e9ccfc0c2ff2 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Request method failure captured: Oct 13 13:14:05.526347 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: request: DELETE /compute/v2.1/servers/b4ba0fd3-eb17-4e05-acaa-5570c1e364d7/os-volume_attachments/515371e1-4f2e-44c4-b36f-ac2cfdfced9b HTTP/1.1 Oct 13 13:14:05.526347 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: Accept: application/json Oct 13 13:14:05.526347 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: Accept-Encoding: identity Oct 13 13:14:05.526347 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: Connection: close Oct 13 13:14:05.526347 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: Content-Length: 0 Oct 13 13:14:05.526347 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: Content-Type: application/json Oct 13 13:14:05.526347 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: Host: 10.222.0.23 Oct 13 13:14:05.526347 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: Openstack-System-Scope: None Oct 13 13:14:05.526347 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: User-Agent: python-urllib3/1.26.12 Oct 13 13:14:05.526347 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Auth-Token: gAAAAABjSA4svM9mETgfaOiuUXJIEReF5lLu9fPZCd8DzHzDMjsgoKCuGBBfmSl0ftubwAnibGB2dnB8E_e8xQKe1PCHs7Ng4fH6y7rFwijiKdlg3jwpLv7Ts_hAoMDCd_X3SSeHFWudl61mtpIoaIAJsH8UQKtB4J3uZqOXyPx22DWeiRT4uVg Oct 13 13:14:05.526347 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Domain-Id: None Oct 13 13:14:05.526347 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Domain-Name: None Oct 13 13:14:05.526347 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Identity-Status: Confirmed Oct 13 13:14:05.526347 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Is-Admin-Project: True Oct 13 13:14:05.526347 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Project-Domain-Id: default Oct 13 13:14:05.526347 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Project-Domain-Name: Default Oct 13 13:14:05.526347 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Project-Id: 5e7312d0ac9248f2bfbece5611913ab2 Oct 13 13:14:05.526347 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-633823286 Oct 13 13:14:05.526347 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Role: reader,member Oct 13 13:14:05.526347 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Roles: reader,member Oct 13 13:14:05.527761 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_5e7312d0ac9248f2bfbece5611913ab2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/5e7312d0ac9248f2bfbece5611913ab2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/5e7312d0ac9248f2bfbece5611913ab2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/5e7312d0ac9248f2bfbece5611913ab2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}] Oct 13 13:14:05.527761 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Tenant: tempest-ServerRescueNegativeTestJSON-633823286 Oct 13 13:14:05.527761 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Tenant-Id: 5e7312d0ac9248f2bfbece5611913ab2 Oct 13 13:14:05.527761 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-633823286 Oct 13 13:14:05.527761 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-User: tempest-ServerRescueNegativeTestJSON-633823286-project Oct 13 13:14:05.527761 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-User-Domain-Id: default Oct 13 13:14:05.527761 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-User-Domain-Name: Default Oct 13 13:14:05.527761 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-User-Id: 454203f47b434cca952a1cef56de559f Oct 13 13:14:05.527761 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-User-Name: tempest-ServerRescueNegativeTestJSON-633823286-project Oct 13 13:14:05.527761 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: method: > Oct 13 13:14:05.527761 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: exception: Cannot 'detach_volume' instance b4ba0fd3-eb17-4e05-acaa-5570c1e364d7 while it is in vm_state rescued Oct 13 13:14:05.528442 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: action_args: {'server_id': 'b4ba0fd3-eb17-4e05-acaa-5570c1e364d7', 'id': '515371e1-4f2e-44c4-b36f-ac2cfdfced9b'} Oct 13 13:14:05.528442 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 13:14:05.528442 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 13:14:05.528442 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Oct 13 13:14:05.528442 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Oct 13 13:14:05.528442 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 13 13:14:05.528442 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 13 13:14:05.528442 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 13 13:14:05.528442 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 13 13:14:05.528442 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance b4ba0fd3-eb17-4e05-acaa-5570c1e364d7 in vm_state rescued. Cannot detach_volume while the instance is in this state. Oct 13 13:14:05.528442 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi Oct 13 13:14:05.528442 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 13:14:05.528442 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi Oct 13 13:14:05.528442 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 13:14:05.528442 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 13:14:05.528442 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 13:14:05.528442 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 13:14:05.528442 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 13:14:05.528442 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 13:14:05.528442 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 13:14:05.530340 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Oct 13 13:14:05.530340 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 13 13:14:05.530340 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 13 13:14:05.530340 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 13 13:14:05.530340 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance b4ba0fd3-eb17-4e05-acaa-5570c1e364d7 while it is in vm_state rescued Oct 13 13:14:05.530340 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi Oct 13 13:14:05.530340 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 13:14:05.530340 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi Oct 13 13:14:05.530340 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 13:14:05.530340 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 13:14:05.530340 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 13:14:05.530340 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 13:14:05.530340 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 13:14:05.530340 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance b4ba0fd3-eb17-4e05-acaa-5570c1e364d7 while it is in vm_state rescued Oct 13 13:14:05.530340 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi Oct 13 13:14:05.530340 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-55aa6100-6628-4394-a26d-e9ccfc0c2ff2 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Returning 409 to user: Cannot 'detach_volume' instance b4ba0fd3-eb17-4e05-acaa-5570c1e364d7 while it is in vm_state rescued {{(pid=118814) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 13:14:05.532735 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-55aa6100-6628-4394-a26d-e9ccfc0c2ff2 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] 10.222.0.23 "DELETE /compute/v2.1/servers/b4ba0fd3-eb17-4e05-acaa-5570c1e364d7/os-volume_attachments/515371e1-4f2e-44c4-b36f-ac2cfdfced9b" status: 409 len: 152 microversion: 2.1 time: 0.102020 Oct 13 13:14:05.532735 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 289/561] 10.222.0.23 () {58 vars in 1416 bytes} [Thu Oct 13 13:14:05 2022] DELETE /compute/v2.1/servers/b4ba0fd3-eb17-4e05-acaa-5570c1e364d7/os-volume_attachments/515371e1-4f2e-44c4-b36f-ac2cfdfced9b => generated 152 bytes in 103 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 13 13:14:05.537792 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-4092f911-88a1-46da-9ee6-6fc40a7d1c7b tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 13:14:05.538369 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-4092f911-88a1-46da-9ee6-6fc40a7d1c7b tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] [instance: b4ba0fd3-eb17-4e05-acaa-5570c1e364d7] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:14:05.544512 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-4092f911-88a1-46da-9ee6-6fc40a7d1c7b tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:14:05.545008 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-4092f911-88a1-46da-9ee6-6fc40a7d1c7b tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:14:05.545451 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-4092f911-88a1-46da-9ee6-6fc40a7d1c7b tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:14:05.546165 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-4092f911-88a1-46da-9ee6-6fc40a7d1c7b tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:14:05.546623 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-4092f911-88a1-46da-9ee6-6fc40a7d1c7b tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:14:05.547073 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-4092f911-88a1-46da-9ee6-6fc40a7d1c7b tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:14:05.619109 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-4092f911-88a1-46da-9ee6-6fc40a7d1c7b tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] 10.222.0.23 "POST /compute/v2.1/servers/b4ba0fd3-eb17-4e05-acaa-5570c1e364d7/action" status: 202 len: 0 microversion: 2.1 time: 0.084743 Oct 13 13:14:05.622876 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 273/562] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Oct 13 13:14:05 2022] POST /compute/v2.1/servers/b4ba0fd3-eb17-4e05-acaa-5570c1e364d7/action => generated 0 bytes in 87 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 13 13:14:05.628378 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-10028131-31ae-4449-a2b8-68d573d8c8cb tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Calling method '>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:14:05.629872 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-10028131-31ae-4449-a2b8-68d573d8c8cb tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] [instance: b4ba0fd3-eb17-4e05-acaa-5570c1e364d7] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:14:05.638268 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-10028131-31ae-4449-a2b8-68d573d8c8cb tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:14:05.638931 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-10028131-31ae-4449-a2b8-68d573d8c8cb tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:14:05.639555 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-10028131-31ae-4449-a2b8-68d573d8c8cb tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:14:05.641483 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-10028131-31ae-4449-a2b8-68d573d8c8cb tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:14:05.641624 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-10028131-31ae-4449-a2b8-68d573d8c8cb tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:14:05.641997 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-10028131-31ae-4449-a2b8-68d573d8c8cb tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:14:05.729162 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-788225ab-d875-408b-9d89-d50d07628ea6 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Calling method '>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:14:05.729858 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-788225ab-d875-408b-9d89-d50d07628ea6 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] [instance: 26bd475b-3495-4669-9985-d4a7dedb4bbf] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:14:05.736023 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-788225ab-d875-408b-9d89-d50d07628ea6 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:14:05.736498 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-788225ab-d875-408b-9d89-d50d07628ea6 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:14:05.736927 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-788225ab-d875-408b-9d89-d50d07628ea6 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:14:05.739920 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-788225ab-d875-408b-9d89-d50d07628ea6 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:14:05.740372 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-788225ab-d875-408b-9d89-d50d07628ea6 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:14:05.740802 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-788225ab-d875-408b-9d89-d50d07628ea6 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:14:05.756875 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.wsgi [None req-788225ab-d875-408b-9d89-d50d07628ea6 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] HTTP exception thrown: Instance 26bd475b-3495-4669-9985-d4a7dedb4bbf could not be found. Oct 13 13:14:05.758815 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-788225ab-d875-408b-9d89-d50d07628ea6 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Request method failure captured: Oct 13 13:14:05.758815 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: request: GET /compute/v2.1/servers/26bd475b-3495-4669-9985-d4a7dedb4bbf HTTP/1.1 Oct 13 13:14:05.758815 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: Accept: application/json Oct 13 13:14:05.758815 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: Accept-Encoding: identity Oct 13 13:14:05.758815 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: Connection: close Oct 13 13:14:05.758815 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: Content-Length: 0 Oct 13 13:14:05.758815 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: Content-Type: application/json Oct 13 13:14:05.758815 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: Host: 10.222.0.23 Oct 13 13:14:05.758815 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: Openstack-System-Scope: None Oct 13 13:14:05.758815 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: User-Agent: python-urllib3/1.26.12 Oct 13 13:14:05.758815 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Auth-Token: gAAAAABjSA4tunBxxiLAsDcwzJnwD5icNArXVS2ALCK2Nvdw6H3lylo131jngSpW20VrB3U3uqD1tS775HGTmTQdbdvjmqKoRpB1Vocz90KRcx7_8rqcewdlzjgGcPlOm4Zdl2XeN-E8XYbc53rR87qrHwzD5wGkbh7UPN54dUXu2qfZrWBj3hg Oct 13 13:14:05.758815 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Domain-Id: None Oct 13 13:14:05.758815 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Domain-Name: None Oct 13 13:14:05.758815 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Identity-Status: Confirmed Oct 13 13:14:05.758815 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Is-Admin-Project: True Oct 13 13:14:05.758815 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Openstack-Nova-Api-Version: 2.20 Oct 13 13:14:05.758815 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Project-Domain-Id: default Oct 13 13:14:05.758815 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Project-Domain-Name: Default Oct 13 13:14:05.758815 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Project-Id: 4af4b9833fd14a1f881610bbc90bbd37 Oct 13 13:14:05.758815 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2099157911 Oct 13 13:14:05.758815 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Role: reader,member Oct 13 13:14:05.758815 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Roles: reader,member Oct 13 13:14:05.760437 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_4af4b9833fd14a1f881610bbc90bbd37"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/4af4b9833fd14a1f881610bbc90bbd37"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/4af4b9833fd14a1f881610bbc90bbd37"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/4af4b9833fd14a1f881610bbc90bbd37"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}] Oct 13 13:14:05.760437 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2099157911 Oct 13 13:14:05.760437 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Tenant-Id: 4af4b9833fd14a1f881610bbc90bbd37 Oct 13 13:14:05.760437 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2099157911 Oct 13 13:14:05.760437 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-User: tempest-AttachVolumeShelveTestJSON-2099157911-project Oct 13 13:14:05.760437 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-User-Domain-Id: default Oct 13 13:14:05.760437 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-User-Domain-Name: Default Oct 13 13:14:05.760437 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-User-Id: b5dbaf53464b44fe8d9e16f5013587b4 Oct 13 13:14:05.760437 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2099157911-project Oct 13 13:14:05.760437 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: method: > Oct 13 13:14:05.760437 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: exception: Instance 26bd475b-3495-4669-9985-d4a7dedb4bbf could not be found. Oct 13 13:14:05.760437 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: action_args: {'id': '26bd475b-3495-4669-9985-d4a7dedb4bbf'} Oct 13 13:14:05.761426 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 13:14:05.761426 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 13:14:05.761426 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 13 13:14:05.761426 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 13 13:14:05.761426 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 13 13:14:05.761426 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 13 13:14:05.761426 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 13 13:14:05.761426 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 13 13:14:05.761426 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 13 13:14:05.761426 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 13 13:14:05.761426 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 26bd475b-3495-4669-9985-d4a7dedb4bbf could not be found. Oct 13 13:14:05.761426 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi Oct 13 13:14:05.761426 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 13:14:05.761426 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi Oct 13 13:14:05.761426 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 13:14:05.761426 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 13:14:05.761426 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 13:14:05.761426 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 13:14:05.761426 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 13:14:05.761426 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 13:14:05.762858 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 13:14:05.762858 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 13 13:14:05.762858 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 13 13:14:05.762858 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 13 13:14:05.762858 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 13 13:14:05.762858 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 13 13:14:05.762858 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 13 13:14:05.762858 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 26bd475b-3495-4669-9985-d4a7dedb4bbf could not be found. Oct 13 13:14:05.762858 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi Oct 13 13:14:05.762858 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 13:14:05.762858 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi Oct 13 13:14:05.762858 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 13:14:05.762858 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 13:14:05.762858 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 13:14:05.762858 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 13:14:05.762858 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 13:14:05.762858 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 26bd475b-3495-4669-9985-d4a7dedb4bbf could not be found. Oct 13 13:14:05.762858 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi Oct 13 13:14:05.765188 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-788225ab-d875-408b-9d89-d50d07628ea6 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Returning 404 to user: Instance 26bd475b-3495-4669-9985-d4a7dedb4bbf could not be found. {{(pid=118815) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 13:14:05.766795 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-788225ab-d875-408b-9d89-d50d07628ea6 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] 10.222.0.23 "GET /compute/v2.1/servers/26bd475b-3495-4669-9985-d4a7dedb4bbf" status: 404 len: 111 microversion: 2.20 time: 0.041957 Oct 13 13:14:05.771206 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 274/563] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 13:14:05 2022] GET /compute/v2.1/servers/26bd475b-3495-4669-9985-d4a7dedb4bbf => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Oct 13 13:14:05.776286 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-6e92285f-6cef-4e27-8e67-2735ba69ed7f tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Calling method '.version_select at 0x7f5093bc6940>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:14:05.792823 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-10028131-31ae-4449-a2b8-68d573d8c8cb tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '454203f47b434cca952a1cef56de559f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7312d0ac9248f2bfbece5611913ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:14:05.803844 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-10028131-31ae-4449-a2b8-68d573d8c8cb tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] 10.222.0.23 "GET /compute/v2.1/servers/b4ba0fd3-eb17-4e05-acaa-5570c1e364d7" status: 200 len: 1725 microversion: 2.1 time: 0.179483 Oct 13 13:14:05.804654 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 290/564] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:14:05 2022] GET /compute/v2.1/servers/b4ba0fd3-eb17-4e05-acaa-5570c1e364d7 => generated 1725 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:14:05.809637 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-6e92285f-6cef-4e27-8e67-2735ba69ed7f tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2036477842" status: 204 len: 0 microversion: 2.20 time: 0.037185 Oct 13 13:14:05.814947 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 275/565] 10.222.0.23 () {60 vars in 1262 bytes} [Thu Oct 13 13:14:05 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2036477842 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 13 13:14:06.650699 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-185dad2b-d648-4154-81bd-e81fda562808 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Action: 'create', calling method: .version_select at 0x7f5093d17dc0>, body: {"keypair": {"name": "tempest-keypair-1069400532", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKyyFK3WpbAEHOpMmgTp9iOH8PTE8K1nYF9abMITiHzYTktcg3mS3NzNYjoJ6toDdAXcM0xDG9FTdsPEnzoPOGQb+VJdZCvr6Dzh3LAjac1eVka6qnfifZNFvAUbxgP5Fw=="}} {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 13:14:06.666811 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.quota [None req-185dad2b-d648-4154-81bd-e81fda562808 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Getting quotas for project 4af4b9833fd14a1f881610bbc90bbd37. Resources: {'key_pairs'} {{(pid=118814) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 13 13:14:06.670680 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.quota [None req-185dad2b-d648-4154-81bd-e81fda562808 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Getting quotas for user b5dbaf53464b44fe8d9e16f5013587b4 and project 4af4b9833fd14a1f881610bbc90bbd37. Resources: {'key_pairs'} {{(pid=118814) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 13 13:14:06.692503 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-185dad2b-d648-4154-81bd-e81fda562808 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.045749 Oct 13 13:14:06.693086 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 291/566] 10.222.0.23 () {62 vars in 1200 bytes} [Thu Oct 13 13:14:06 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 47 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 13 13:14:06.831559 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-81a07c86-7929-4c13-acfc-da97226a1748 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Calling method '>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:14:06.832197 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-81a07c86-7929-4c13-acfc-da97226a1748 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] [instance: b4ba0fd3-eb17-4e05-acaa-5570c1e364d7] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:14:06.839436 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-81a07c86-7929-4c13-acfc-da97226a1748 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:14:06.839933 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-81a07c86-7929-4c13-acfc-da97226a1748 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:14:06.840381 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-81a07c86-7929-4c13-acfc-da97226a1748 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:14:06.841085 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-81a07c86-7929-4c13-acfc-da97226a1748 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:14:06.841547 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-81a07c86-7929-4c13-acfc-da97226a1748 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:14:06.842054 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-81a07c86-7929-4c13-acfc-da97226a1748 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:14:06.976421 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-81a07c86-7929-4c13-acfc-da97226a1748 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '454203f47b434cca952a1cef56de559f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7312d0ac9248f2bfbece5611913ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:14:06.985523 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-81a07c86-7929-4c13-acfc-da97226a1748 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] 10.222.0.23 "GET /compute/v2.1/servers/b4ba0fd3-eb17-4e05-acaa-5570c1e364d7" status: 200 len: 1725 microversion: 2.1 time: 0.158548 Oct 13 13:14:06.986097 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 276/567] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:14:06 2022] GET /compute/v2.1/servers/b4ba0fd3-eb17-4e05-acaa-5570c1e364d7 => generated 1725 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:14:07.962371 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-a02d2749-a724-444c-9621-77bc146975d8 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1867880985", "imageRef": "e2cdd20b-2540-48bc-a05c-d6a2e7e9a66e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "be617289-4b6b-4fbf-91a3-2f05a4825667"}], "security_groups": [{"name": "tempest-securitygroup--271582545"}], "key_name": "tempest-keypair-1069400532", "user_data": "}} {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 13:14:08.009079 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-47735ee5-fa27-42d7-9ba8-a49532e166b5 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Calling method '>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:14:08.009782 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-47735ee5-fa27-42d7-9ba8-a49532e166b5 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] [instance: b4ba0fd3-eb17-4e05-acaa-5570c1e364d7] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:14:08.016633 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-47735ee5-fa27-42d7-9ba8-a49532e166b5 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:14:08.017135 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-47735ee5-fa27-42d7-9ba8-a49532e166b5 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:14:08.017648 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-47735ee5-fa27-42d7-9ba8-a49532e166b5 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:14:08.018352 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-47735ee5-fa27-42d7-9ba8-a49532e166b5 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:14:08.018814 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-47735ee5-fa27-42d7-9ba8-a49532e166b5 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:14:08.019268 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-47735ee5-fa27-42d7-9ba8-a49532e166b5 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:14:08.071801 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.network.neutron [None req-a02d2749-a724-444c-9621-77bc146975d8 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] validate_networks() for [('be617289-4b6b-4fbf-91a3-2f05a4825667', None, None, None, None, None)] {{(pid=118814) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 13 13:14:08.242018 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-47735ee5-fa27-42d7-9ba8-a49532e166b5 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '454203f47b434cca952a1cef56de559f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7312d0ac9248f2bfbece5611913ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:14:08.250428 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-47735ee5-fa27-42d7-9ba8-a49532e166b5 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] 10.222.0.23 "GET /compute/v2.1/servers/b4ba0fd3-eb17-4e05-acaa-5570c1e364d7" status: 200 len: 1725 microversion: 2.1 time: 0.245450 Oct 13 13:14:08.251166 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 277/568] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:14:08 2022] GET /compute/v2.1/servers/b4ba0fd3-eb17-4e05-acaa-5570c1e364d7 => generated 1725 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:14:08.495717 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.virt.hardware [None req-a02d2749-a724-444c-9621-77bc146975d8 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Flavor limits 0:0:0 {{(pid=118814) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 13 13:14:08.496209 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.virt.hardware [None req-a02d2749-a724-444c-9621-77bc146975d8 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Image limits 0:0:0 {{(pid=118814) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 13 13:14:08.496676 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.virt.hardware [None req-a02d2749-a724-444c-9621-77bc146975d8 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Flavor pref 0:0:0 {{(pid=118814) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 13 13:14:08.497080 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.virt.hardware [None req-a02d2749-a724-444c-9621-77bc146975d8 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Image pref 0:0:0 {{(pid=118814) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 13 13:14:08.497488 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.virt.hardware [None req-a02d2749-a724-444c-9621-77bc146975d8 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118814) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 13 13:14:08.506395 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-a02d2749-a724-444c-9621-77bc146975d8 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:14:08.506928 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-a02d2749-a724-444c-9621-77bc146975d8 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:14:08.507428 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-a02d2749-a724-444c-9621-77bc146975d8 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:14:08.508200 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-a02d2749-a724-444c-9621-77bc146975d8 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:14:08.508648 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-a02d2749-a724-444c-9621-77bc146975d8 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:14:08.509070 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-a02d2749-a724-444c-9621-77bc146975d8 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:14:08.526181 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.quota [None req-a02d2749-a724-444c-9621-77bc146975d8 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Getting quotas for project 4af4b9833fd14a1f881610bbc90bbd37. Resources: {'instances', 'cores', 'ram'} {{(pid=118814) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 13 13:14:08.530053 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.quota [None req-a02d2749-a724-444c-9621-77bc146975d8 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Getting quotas for user b5dbaf53464b44fe8d9e16f5013587b4 and project 4af4b9833fd14a1f881610bbc90bbd37. Resources: {'instances', 'cores', 'ram'} {{(pid=118814) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 13 13:14:08.541268 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-a02d2749-a724-444c-9621-77bc146975d8 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Going to run 1 instances... {{(pid=118814) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 13 13:14:08.543545 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-a02d2749-a724-444c-9621-77bc146975d8 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] [instance: c3478cd4-e4ab-4a7d-9f4d-65323c450348] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e2cdd20b-2540-48bc-a05c-d6a2e7e9a66e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118814) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 13 13:14:08.590564 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-a02d2749-a724-444c-9621-77bc146975d8 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.632850 Oct 13 13:14:08.591595 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 292/569] 10.222.0.23 () {62 vars in 1188 bytes} [Thu Oct 13 13:14:07 2022] POST /compute/v2.1/servers => generated 401 bytes in 634 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 13 13:14:08.602976 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-5ae1c2a0-148d-4b81-9f5f-b671f7b1ede3 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Calling method '>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:14:08.603866 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-5ae1c2a0-148d-4b81-9f5f-b671f7b1ede3 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] [instance: c3478cd4-e4ab-4a7d-9f4d-65323c450348] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:14:08.656992 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-5ae1c2a0-148d-4b81-9f5f-b671f7b1ede3 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:14:08.664567 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-5ae1c2a0-148d-4b81-9f5f-b671f7b1ede3 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:14:08.666033 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-5ae1c2a0-148d-4b81-9f5f-b671f7b1ede3 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:14:08.667364 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-5ae1c2a0-148d-4b81-9f5f-b671f7b1ede3 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] 10.222.0.23 "GET /compute/v2.1/servers/c3478cd4-e4ab-4a7d-9f4d-65323c450348" status: 200 len: 1282 microversion: 2.20 time: 0.068295 Oct 13 13:14:08.667905 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 278/570] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 13:14:08 2022] GET /compute/v2.1/servers/c3478cd4-e4ab-4a7d-9f4d-65323c450348 => generated 1282 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 13:14:09.274081 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-091d4e66-e480-4502-890d-db815670602f tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Calling method '>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:14:09.274703 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-091d4e66-e480-4502-890d-db815670602f tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] [instance: b4ba0fd3-eb17-4e05-acaa-5570c1e364d7] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:14:09.281130 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-091d4e66-e480-4502-890d-db815670602f tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:14:09.281905 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-091d4e66-e480-4502-890d-db815670602f tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:14:09.282355 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-091d4e66-e480-4502-890d-db815670602f tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:14:09.283072 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-091d4e66-e480-4502-890d-db815670602f tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:14:09.283534 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-091d4e66-e480-4502-890d-db815670602f tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:14:09.283964 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-091d4e66-e480-4502-890d-db815670602f tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:14:09.417754 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-091d4e66-e480-4502-890d-db815670602f tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '454203f47b434cca952a1cef56de559f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7312d0ac9248f2bfbece5611913ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:14:09.426849 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-091d4e66-e480-4502-890d-db815670602f tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] 10.222.0.23 "GET /compute/v2.1/servers/b4ba0fd3-eb17-4e05-acaa-5570c1e364d7" status: 200 len: 1731 microversion: 2.1 time: 0.157115 Oct 13 13:14:09.427481 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 293/571] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:14:09 2022] GET /compute/v2.1/servers/b4ba0fd3-eb17-4e05-acaa-5570c1e364d7 => generated 1731 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:14:09.449415 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-266111dd-ccdf-4b18-ab37-195a1734eccd tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Calling method '>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:14:09.449908 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-266111dd-ccdf-4b18-ab37-195a1734eccd tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] [instance: b4ba0fd3-eb17-4e05-acaa-5570c1e364d7] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:14:09.456084 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-266111dd-ccdf-4b18-ab37-195a1734eccd tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:14:09.456563 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-266111dd-ccdf-4b18-ab37-195a1734eccd tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:14:09.457000 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-266111dd-ccdf-4b18-ab37-195a1734eccd tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:14:09.457680 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-266111dd-ccdf-4b18-ab37-195a1734eccd tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:14:09.458133 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-266111dd-ccdf-4b18-ab37-195a1734eccd tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:14:09.458555 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-266111dd-ccdf-4b18-ab37-195a1734eccd tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:14:09.536897 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-266111dd-ccdf-4b18-ab37-195a1734eccd tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] 10.222.0.23 "GET /compute/v2.1/servers/b4ba0fd3-eb17-4e05-acaa-5570c1e364d7/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.091165 Oct 13 13:14:09.537486 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 279/572] 10.222.0.23 () {58 vars in 1275 bytes} [Thu Oct 13 13:14:09 2022] GET /compute/v2.1/servers/b4ba0fd3-eb17-4e05-acaa-5570c1e364d7/os-interface => generated 285 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 13:14:09.694162 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-bc221c89-7961-4b3c-938c-6e5f9f1b5a42 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Calling method '>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:14:09.694826 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-bc221c89-7961-4b3c-938c-6e5f9f1b5a42 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] [instance: c3478cd4-e4ab-4a7d-9f4d-65323c450348] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:14:09.701936 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-bc221c89-7961-4b3c-938c-6e5f9f1b5a42 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:14:09.702527 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-bc221c89-7961-4b3c-938c-6e5f9f1b5a42 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:14:09.703037 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-bc221c89-7961-4b3c-938c-6e5f9f1b5a42 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:14:09.703840 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-bc221c89-7961-4b3c-938c-6e5f9f1b5a42 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:14:09.704367 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-bc221c89-7961-4b3c-938c-6e5f9f1b5a42 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:14:09.704866 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-bc221c89-7961-4b3c-938c-6e5f9f1b5a42 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:14:09.944937 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-bc221c89-7961-4b3c-938c-6e5f9f1b5a42 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:14:09.953633 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-bc221c89-7961-4b3c-938c-6e5f9f1b5a42 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:14:09.955096 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-bc221c89-7961-4b3c-938c-6e5f9f1b5a42 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:14:09.956175 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-bc221c89-7961-4b3c-938c-6e5f9f1b5a42 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] 10.222.0.23 "GET /compute/v2.1/servers/c3478cd4-e4ab-4a7d-9f4d-65323c450348" status: 200 len: 1334 microversion: 2.20 time: 0.267801 Oct 13 13:14:09.956712 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 294/573] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 13:14:09 2022] GET /compute/v2.1/servers/c3478cd4-e4ab-4a7d-9f4d-65323c450348 => generated 1334 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 13:14:10.695950 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [req-cb60fc58-fd7e-4009-bd92-53e92dcadbb8 req-b76b2c39-e968-42bf-ab1c-6236cde1d877 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b4ba0fd3-eb17-4e05-acaa-5570c1e364d7", "tag": "feb1b7b8-f5e8-4310-8e6d-7eb1841b5c04"}]} {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 13:14:10.709352 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [req-cb60fc58-fd7e-4009-bd92-53e92dcadbb8 req-b76b2c39-e968-42bf-ab1c-6236cde1d877 service nova] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:14:10.710193 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [req-cb60fc58-fd7e-4009-bd92-53e92dcadbb8 req-b76b2c39-e968-42bf-ab1c-6236cde1d877 service nova] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:14:10.711099 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [req-cb60fc58-fd7e-4009-bd92-53e92dcadbb8 req-b76b2c39-e968-42bf-ab1c-6236cde1d877 service nova] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:14:10.723954 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.compute.server_external_events [req-cb60fc58-fd7e-4009-bd92-53e92dcadbb8 req-b76b2c39-e968-42bf-ab1c-6236cde1d877 service nova] Creating event network-changed:feb1b7b8-f5e8-4310-8e6d-7eb1841b5c04 for instance b4ba0fd3-eb17-4e05-acaa-5570c1e364d7 on hv-cinder-82660 Oct 13 13:14:10.729449 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [req-cb60fc58-fd7e-4009-bd92-53e92dcadbb8 req-b76b2c39-e968-42bf-ab1c-6236cde1d877 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037267 Oct 13 13:14:10.731375 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 280/574] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 13:14:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 13:14:10.986598 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-98b9d584-8324-4c1d-b70d-2e70dd395a4b tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Calling method '>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:14:10.987822 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-98b9d584-8324-4c1d-b70d-2e70dd395a4b tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] [instance: c3478cd4-e4ab-4a7d-9f4d-65323c450348] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:14:11.000355 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-98b9d584-8324-4c1d-b70d-2e70dd395a4b tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:14:11.001090 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-98b9d584-8324-4c1d-b70d-2e70dd395a4b tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:14:11.001817 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-98b9d584-8324-4c1d-b70d-2e70dd395a4b tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:14:11.004079 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-98b9d584-8324-4c1d-b70d-2e70dd395a4b tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:14:11.004714 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-98b9d584-8324-4c1d-b70d-2e70dd395a4b tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:14:11.005774 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-98b9d584-8324-4c1d-b70d-2e70dd395a4b tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:14:11.152884 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-98b9d584-8324-4c1d-b70d-2e70dd395a4b tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:14:11.162340 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-98b9d584-8324-4c1d-b70d-2e70dd395a4b tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:14:11.164182 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-98b9d584-8324-4c1d-b70d-2e70dd395a4b tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:14:11.165789 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-98b9d584-8324-4c1d-b70d-2e70dd395a4b tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] 10.222.0.23 "GET /compute/v2.1/servers/c3478cd4-e4ab-4a7d-9f4d-65323c450348" status: 200 len: 1407 microversion: 2.20 time: 0.187524 Oct 13 13:14:11.166561 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 295/575] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 13:14:10 2022] GET /compute/v2.1/servers/c3478cd4-e4ab-4a7d-9f4d-65323c450348 => generated 1407 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 13:14:11.896285 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [req-92d7c396-9d01-4658-a676-0bedc6ff28be req-d8de11d3-f2a2-46ab-884a-4390fa343577 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c3478cd4-e4ab-4a7d-9f4d-65323c450348", "tag": "ff57ee79-9921-43ed-817d-5ba082c97343"}]} {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 13:14:11.909604 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [req-92d7c396-9d01-4658-a676-0bedc6ff28be req-d8de11d3-f2a2-46ab-884a-4390fa343577 service nova] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:14:11.910358 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [req-92d7c396-9d01-4658-a676-0bedc6ff28be req-d8de11d3-f2a2-46ab-884a-4390fa343577 service nova] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:14:11.910963 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [req-92d7c396-9d01-4658-a676-0bedc6ff28be req-d8de11d3-f2a2-46ab-884a-4390fa343577 service nova] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:14:11.925790 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.compute.server_external_events [req-92d7c396-9d01-4658-a676-0bedc6ff28be req-d8de11d3-f2a2-46ab-884a-4390fa343577 service nova] Creating event network-changed:ff57ee79-9921-43ed-817d-5ba082c97343 for instance c3478cd4-e4ab-4a7d-9f4d-65323c450348 on hv-cinder-82660 Oct 13 13:14:11.931118 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [req-92d7c396-9d01-4658-a676-0bedc6ff28be req-d8de11d3-f2a2-46ab-884a-4390fa343577 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039479 Oct 13 13:14:11.931709 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 281/576] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 13:14:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 13:14:12.191322 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-41fb6eeb-ef45-493b-a89e-2960481b0e5d tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Calling method '>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:14:12.191958 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-41fb6eeb-ef45-493b-a89e-2960481b0e5d tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] [instance: c3478cd4-e4ab-4a7d-9f4d-65323c450348] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:14:12.194385 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG dbcounter [-] [118814] Writing DB stats nova_api:SELECT=83,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=118814) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:14:12.199679 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-41fb6eeb-ef45-493b-a89e-2960481b0e5d tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:14:12.200153 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-41fb6eeb-ef45-493b-a89e-2960481b0e5d tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:14:12.200587 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-41fb6eeb-ef45-493b-a89e-2960481b0e5d tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:14:12.201276 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-41fb6eeb-ef45-493b-a89e-2960481b0e5d tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:14:12.201726 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-41fb6eeb-ef45-493b-a89e-2960481b0e5d tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:14:12.202151 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-41fb6eeb-ef45-493b-a89e-2960481b0e5d tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:14:12.331388 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-41fb6eeb-ef45-493b-a89e-2960481b0e5d tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:14:12.339664 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-41fb6eeb-ef45-493b-a89e-2960481b0e5d tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:14:12.341109 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-41fb6eeb-ef45-493b-a89e-2960481b0e5d tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:14:12.342246 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-41fb6eeb-ef45-493b-a89e-2960481b0e5d tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] 10.222.0.23 "GET /compute/v2.1/servers/c3478cd4-e4ab-4a7d-9f4d-65323c450348" status: 200 len: 1407 microversion: 2.20 time: 0.154813 Oct 13 13:14:12.342794 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 296/577] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 13:14:12 2022] GET /compute/v2.1/servers/c3478cd4-e4ab-4a7d-9f4d-65323c450348 => generated 1407 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 13:14:12.744721 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [req-5d31ff68-0281-49e8-93a0-ef27f5b5d390 req-f178408e-259e-43a0-8006-202f6b35f9c0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b4ba0fd3-eb17-4e05-acaa-5570c1e364d7", "tag": "feb1b7b8-f5e8-4310-8e6d-7eb1841b5c04"}]} {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 13:14:12.754594 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [req-5d31ff68-0281-49e8-93a0-ef27f5b5d390 req-f178408e-259e-43a0-8006-202f6b35f9c0 service nova] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:14:12.755095 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [req-5d31ff68-0281-49e8-93a0-ef27f5b5d390 req-f178408e-259e-43a0-8006-202f6b35f9c0 service nova] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:14:12.755513 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [req-5d31ff68-0281-49e8-93a0-ef27f5b5d390 req-f178408e-259e-43a0-8006-202f6b35f9c0 service nova] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:14:12.768050 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.compute.server_external_events [req-5d31ff68-0281-49e8-93a0-ef27f5b5d390 req-f178408e-259e-43a0-8006-202f6b35f9c0 service nova] Creating event network-changed:feb1b7b8-f5e8-4310-8e6d-7eb1841b5c04 for instance b4ba0fd3-eb17-4e05-acaa-5570c1e364d7 on hv-cinder-82660 Oct 13 13:14:12.773076 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [req-5d31ff68-0281-49e8-93a0-ef27f5b5d390 req-f178408e-259e-43a0-8006-202f6b35f9c0 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032588 Oct 13 13:14:12.773650 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 282/578] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 13:14:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 13:14:13.367610 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-6b033a0a-0291-403d-93ea-086d2b028f96 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Calling method '>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:14:13.368335 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-6b033a0a-0291-403d-93ea-086d2b028f96 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] [instance: c3478cd4-e4ab-4a7d-9f4d-65323c450348] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:14:13.374836 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-6b033a0a-0291-403d-93ea-086d2b028f96 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:14:13.375351 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-6b033a0a-0291-403d-93ea-086d2b028f96 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:14:13.375791 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-6b033a0a-0291-403d-93ea-086d2b028f96 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:14:13.376483 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-6b033a0a-0291-403d-93ea-086d2b028f96 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:14:13.376937 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-6b033a0a-0291-403d-93ea-086d2b028f96 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:14:13.377360 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-6b033a0a-0291-403d-93ea-086d2b028f96 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:14:13.506217 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-6b033a0a-0291-403d-93ea-086d2b028f96 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:14:13.514274 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-6b033a0a-0291-403d-93ea-086d2b028f96 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:14:13.516672 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-6b033a0a-0291-403d-93ea-086d2b028f96 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:14:13.517773 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-6b033a0a-0291-403d-93ea-086d2b028f96 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] 10.222.0.23 "GET /compute/v2.1/servers/c3478cd4-e4ab-4a7d-9f4d-65323c450348" status: 200 len: 1407 microversion: 2.20 time: 0.154159 Oct 13 13:14:13.518324 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 297/579] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 13:14:13 2022] GET /compute/v2.1/servers/c3478cd4-e4ab-4a7d-9f4d-65323c450348 => generated 1407 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 13:14:14.543207 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-3533263c-5ef3-4fe1-9045-85b48c34613d tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Calling method '>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:14:14.543893 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-3533263c-5ef3-4fe1-9045-85b48c34613d tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] [instance: c3478cd4-e4ab-4a7d-9f4d-65323c450348] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:14:14.550847 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-3533263c-5ef3-4fe1-9045-85b48c34613d tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:14:14.551358 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-3533263c-5ef3-4fe1-9045-85b48c34613d tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:14:14.551791 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-3533263c-5ef3-4fe1-9045-85b48c34613d tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:14:14.552464 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-3533263c-5ef3-4fe1-9045-85b48c34613d tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:14:14.552909 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-3533263c-5ef3-4fe1-9045-85b48c34613d tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:14:14.553331 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-3533263c-5ef3-4fe1-9045-85b48c34613d tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:14:14.685236 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-3533263c-5ef3-4fe1-9045-85b48c34613d tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:14:14.693937 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-3533263c-5ef3-4fe1-9045-85b48c34613d tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:14:14.695524 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-3533263c-5ef3-4fe1-9045-85b48c34613d tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:14:14.696764 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-3533263c-5ef3-4fe1-9045-85b48c34613d tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] 10.222.0.23 "GET /compute/v2.1/servers/c3478cd4-e4ab-4a7d-9f4d-65323c450348" status: 200 len: 1407 microversion: 2.20 time: 0.157794 Oct 13 13:14:14.697309 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 283/580] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 13:14:14 2022] GET /compute/v2.1/servers/c3478cd4-e4ab-4a7d-9f4d-65323c450348 => generated 1407 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 13:14:15.722466 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-3740c5c9-4eb4-45c5-bded-ea72dacc103a tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Calling method '>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:14:15.723127 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-3740c5c9-4eb4-45c5-bded-ea72dacc103a tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] [instance: c3478cd4-e4ab-4a7d-9f4d-65323c450348] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:14:15.729483 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-3740c5c9-4eb4-45c5-bded-ea72dacc103a tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:14:15.729964 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-3740c5c9-4eb4-45c5-bded-ea72dacc103a tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:14:15.730394 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-3740c5c9-4eb4-45c5-bded-ea72dacc103a tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:14:15.731098 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-3740c5c9-4eb4-45c5-bded-ea72dacc103a tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:14:15.731577 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-3740c5c9-4eb4-45c5-bded-ea72dacc103a tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:14:15.731994 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-3740c5c9-4eb4-45c5-bded-ea72dacc103a tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:14:15.857825 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-3740c5c9-4eb4-45c5-bded-ea72dacc103a tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:14:15.866673 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-3740c5c9-4eb4-45c5-bded-ea72dacc103a tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:14:15.868184 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-3740c5c9-4eb4-45c5-bded-ea72dacc103a tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:14:15.869313 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-3740c5c9-4eb4-45c5-bded-ea72dacc103a tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] 10.222.0.23 "GET /compute/v2.1/servers/c3478cd4-e4ab-4a7d-9f4d-65323c450348" status: 200 len: 1407 microversion: 2.20 time: 0.151401 Oct 13 13:14:15.869892 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 298/581] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 13:14:15 2022] GET /compute/v2.1/servers/c3478cd4-e4ab-4a7d-9f4d-65323c450348 => generated 1407 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 13:14:16.183296 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-90b7eb62-38f7-4b8a-9ff7-a6ff3ee82a0e tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Calling method '>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:14:16.185517 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-90b7eb62-38f7-4b8a-9ff7-a6ff3ee82a0e tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] [instance: e125ab44-9111-4260-909d-95d57b7861a7] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:14:16.187529 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG dbcounter [-] [118815] Writing DB stats nova_api:SELECT=63,nova_api:DELETE=1 {{(pid=118815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:14:16.192754 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-90b7eb62-38f7-4b8a-9ff7-a6ff3ee82a0e tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:14:16.193237 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-90b7eb62-38f7-4b8a-9ff7-a6ff3ee82a0e tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:14:16.193673 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-90b7eb62-38f7-4b8a-9ff7-a6ff3ee82a0e tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:14:16.194355 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-90b7eb62-38f7-4b8a-9ff7-a6ff3ee82a0e tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:14:16.194808 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-90b7eb62-38f7-4b8a-9ff7-a6ff3ee82a0e tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:14:16.195264 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-90b7eb62-38f7-4b8a-9ff7-a6ff3ee82a0e tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:14:16.224753 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-90b7eb62-38f7-4b8a-9ff7-a6ff3ee82a0e tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] 10.222.0.23 "GET /compute/v2.1/servers/e125ab44-9111-4260-909d-95d57b7861a7/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045760 Oct 13 13:14:16.225288 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 284/582] 10.222.0.23 () {58 vars in 1302 bytes} [Thu Oct 13 13:14:16 2022] GET /compute/v2.1/servers/e125ab44-9111-4260-909d-95d57b7861a7/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 13 13:14:16.286738 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-d05be589-e0e3-40ed-8398-07fcdcce48ee tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Calling method '>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:14:16.287269 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-d05be589-e0e3-40ed-8398-07fcdcce48ee tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] [instance: e125ab44-9111-4260-909d-95d57b7861a7] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:14:16.293061 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-d05be589-e0e3-40ed-8398-07fcdcce48ee tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:14:16.293535 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-d05be589-e0e3-40ed-8398-07fcdcce48ee tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:14:16.293967 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-d05be589-e0e3-40ed-8398-07fcdcce48ee tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:14:16.294668 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-d05be589-e0e3-40ed-8398-07fcdcce48ee tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:14:16.295140 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-d05be589-e0e3-40ed-8398-07fcdcce48ee tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:14:16.295561 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-d05be589-e0e3-40ed-8398-07fcdcce48ee tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:14:16.320086 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-d05be589-e0e3-40ed-8398-07fcdcce48ee tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] [instance: e125ab44-9111-4260-909d-95d57b7861a7] Going to try to terminate instance {{(pid=118814) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 13 13:14:16.346963 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG dbcounter [-] [118814] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118814) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:14:16.394996 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-d05be589-e0e3-40ed-8398-07fcdcce48ee tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] 10.222.0.23 "DELETE /compute/v2.1/servers/e125ab44-9111-4260-909d-95d57b7861a7" status: 204 len: 0 microversion: 2.1 time: 0.111613 Oct 13 13:14:16.397191 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 299/583] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Oct 13 13:14:16 2022] DELETE /compute/v2.1/servers/e125ab44-9111-4260-909d-95d57b7861a7 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 13 13:14:16.407336 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-523dd668-4c69-4215-9e08-91f293c563b0 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Calling method '>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:14:16.407947 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-523dd668-4c69-4215-9e08-91f293c563b0 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] [instance: e125ab44-9111-4260-909d-95d57b7861a7] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:14:16.417417 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-523dd668-4c69-4215-9e08-91f293c563b0 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:14:16.417940 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-523dd668-4c69-4215-9e08-91f293c563b0 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:14:16.418376 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-523dd668-4c69-4215-9e08-91f293c563b0 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:14:16.419092 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-523dd668-4c69-4215-9e08-91f293c563b0 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:14:16.419544 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-523dd668-4c69-4215-9e08-91f293c563b0 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:14:16.419965 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-523dd668-4c69-4215-9e08-91f293c563b0 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:14:16.548419 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-523dd668-4c69-4215-9e08-91f293c563b0 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e783caddcad473dbdd764919286e244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecd3d5d2a3a54a07ba64f1fea4846c40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:14:16.556318 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-523dd668-4c69-4215-9e08-91f293c563b0 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] 10.222.0.23 "GET /compute/v2.1/servers/e125ab44-9111-4260-909d-95d57b7861a7" status: 200 len: 1674 microversion: 2.1 time: 0.155463 Oct 13 13:14:16.556881 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 285/584] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:14:16 2022] GET /compute/v2.1/servers/e125ab44-9111-4260-909d-95d57b7861a7 => generated 1674 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:14:16.894012 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-77d7477e-fbd3-47c3-bbba-df705a1d7c88 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Calling method '>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:14:16.894703 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-77d7477e-fbd3-47c3-bbba-df705a1d7c88 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] [instance: c3478cd4-e4ab-4a7d-9f4d-65323c450348] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:14:16.900997 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-77d7477e-fbd3-47c3-bbba-df705a1d7c88 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:14:16.901476 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-77d7477e-fbd3-47c3-bbba-df705a1d7c88 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:14:16.901910 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-77d7477e-fbd3-47c3-bbba-df705a1d7c88 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:14:16.902581 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-77d7477e-fbd3-47c3-bbba-df705a1d7c88 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:14:16.903030 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-77d7477e-fbd3-47c3-bbba-df705a1d7c88 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:14:16.903474 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-77d7477e-fbd3-47c3-bbba-df705a1d7c88 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:14:17.033281 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-77d7477e-fbd3-47c3-bbba-df705a1d7c88 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:14:17.041503 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-77d7477e-fbd3-47c3-bbba-df705a1d7c88 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:14:17.042924 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-77d7477e-fbd3-47c3-bbba-df705a1d7c88 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:14:17.044093 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-77d7477e-fbd3-47c3-bbba-df705a1d7c88 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] 10.222.0.23 "GET /compute/v2.1/servers/c3478cd4-e4ab-4a7d-9f4d-65323c450348" status: 200 len: 1407 microversion: 2.20 time: 0.154354 Oct 13 13:14:17.044641 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 300/585] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 13:14:16 2022] GET /compute/v2.1/servers/c3478cd4-e4ab-4a7d-9f4d-65323c450348 => generated 1407 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 13:14:17.255843 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [req-48c1e573-d224-4852-81ad-0a1dd17df552 req-323a93da-318d-4de2-9a5a-1e139a9eea37 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c3478cd4-e4ab-4a7d-9f4d-65323c450348", "name": "network-vif-plugged", "status": "completed", "tag": "ff57ee79-9921-43ed-817d-5ba082c97343"}]} {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 13:14:17.267978 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [req-48c1e573-d224-4852-81ad-0a1dd17df552 req-323a93da-318d-4de2-9a5a-1e139a9eea37 service nova] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:14:17.268478 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [req-48c1e573-d224-4852-81ad-0a1dd17df552 req-323a93da-318d-4de2-9a5a-1e139a9eea37 service nova] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:14:17.268910 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [req-48c1e573-d224-4852-81ad-0a1dd17df552 req-323a93da-318d-4de2-9a5a-1e139a9eea37 service nova] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:14:17.280227 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.compute.server_external_events [req-48c1e573-d224-4852-81ad-0a1dd17df552 req-323a93da-318d-4de2-9a5a-1e139a9eea37 service nova] Creating event network-vif-plugged:ff57ee79-9921-43ed-817d-5ba082c97343 for instance c3478cd4-e4ab-4a7d-9f4d-65323c450348 on hv-cinder-82660 Oct 13 13:14:17.285832 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [req-48c1e573-d224-4852-81ad-0a1dd17df552 req-323a93da-318d-4de2-9a5a-1e139a9eea37 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033696 Oct 13 13:14:17.286432 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 286/586] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 13:14:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 13:14:17.580325 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-6538c3e4-e064-4451-b326-6c2acc79d9ed tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Calling method '>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:14:17.580861 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-6538c3e4-e064-4451-b326-6c2acc79d9ed tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] [instance: e125ab44-9111-4260-909d-95d57b7861a7] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:14:17.586694 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-6538c3e4-e064-4451-b326-6c2acc79d9ed tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:14:17.587215 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-6538c3e4-e064-4451-b326-6c2acc79d9ed tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:14:17.587637 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-6538c3e4-e064-4451-b326-6c2acc79d9ed tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:14:17.588314 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-6538c3e4-e064-4451-b326-6c2acc79d9ed tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:14:17.588761 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-6538c3e4-e064-4451-b326-6c2acc79d9ed tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:14:17.589179 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-6538c3e4-e064-4451-b326-6c2acc79d9ed tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:14:17.717068 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-6538c3e4-e064-4451-b326-6c2acc79d9ed tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e783caddcad473dbdd764919286e244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecd3d5d2a3a54a07ba64f1fea4846c40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:14:17.725297 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-6538c3e4-e064-4451-b326-6c2acc79d9ed tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] 10.222.0.23 "GET /compute/v2.1/servers/e125ab44-9111-4260-909d-95d57b7861a7" status: 200 len: 1674 microversion: 2.1 time: 0.149440 Oct 13 13:14:17.725856 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 301/587] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:14:17 2022] GET /compute/v2.1/servers/e125ab44-9111-4260-909d-95d57b7861a7 => generated 1674 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:14:18.070267 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-9acac2b7-887d-4d1d-bdf0-372fb1338b13 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Calling method '>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:14:18.070962 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-9acac2b7-887d-4d1d-bdf0-372fb1338b13 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] [instance: c3478cd4-e4ab-4a7d-9f4d-65323c450348] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:14:18.077088 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-9acac2b7-887d-4d1d-bdf0-372fb1338b13 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:14:18.078161 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-9acac2b7-887d-4d1d-bdf0-372fb1338b13 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:14:18.078618 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-9acac2b7-887d-4d1d-bdf0-372fb1338b13 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:14:18.079348 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-9acac2b7-887d-4d1d-bdf0-372fb1338b13 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:14:18.079791 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-9acac2b7-887d-4d1d-bdf0-372fb1338b13 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:14:18.080215 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-9acac2b7-887d-4d1d-bdf0-372fb1338b13 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:14:18.209401 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-9acac2b7-887d-4d1d-bdf0-372fb1338b13 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:14:18.217556 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-9acac2b7-887d-4d1d-bdf0-372fb1338b13 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:14:18.219010 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-9acac2b7-887d-4d1d-bdf0-372fb1338b13 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:14:18.220144 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-9acac2b7-887d-4d1d-bdf0-372fb1338b13 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] 10.222.0.23 "GET /compute/v2.1/servers/c3478cd4-e4ab-4a7d-9f4d-65323c450348" status: 200 len: 1407 microversion: 2.20 time: 0.154175 Oct 13 13:14:18.220712 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 287/588] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 13:14:18 2022] GET /compute/v2.1/servers/c3478cd4-e4ab-4a7d-9f4d-65323c450348 => generated 1407 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 13:14:18.748542 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-c42d12a2-4a44-4471-aeb2-db76c5647728 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Calling method '>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:14:18.749183 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-c42d12a2-4a44-4471-aeb2-db76c5647728 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] [instance: e125ab44-9111-4260-909d-95d57b7861a7] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:14:18.751624 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG dbcounter [-] [118814] Writing DB stats nova_cell0:SELECT=2 {{(pid=118814) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:14:18.752275 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG dbcounter [-] [118814] Writing DB stats nova_cell0:SELECT=10 {{(pid=118814) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:14:18.757686 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-c42d12a2-4a44-4471-aeb2-db76c5647728 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:14:18.758170 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-c42d12a2-4a44-4471-aeb2-db76c5647728 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:14:18.758600 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-c42d12a2-4a44-4471-aeb2-db76c5647728 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:14:18.759310 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-c42d12a2-4a44-4471-aeb2-db76c5647728 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:14:18.759803 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-c42d12a2-4a44-4471-aeb2-db76c5647728 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:14:18.760171 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-c42d12a2-4a44-4471-aeb2-db76c5647728 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:14:18.889300 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-c42d12a2-4a44-4471-aeb2-db76c5647728 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e783caddcad473dbdd764919286e244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecd3d5d2a3a54a07ba64f1fea4846c40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:14:18.897962 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-c42d12a2-4a44-4471-aeb2-db76c5647728 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] 10.222.0.23 "GET /compute/v2.1/servers/e125ab44-9111-4260-909d-95d57b7861a7" status: 200 len: 1674 microversion: 2.1 time: 0.153360 Oct 13 13:14:18.898650 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 302/589] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:14:18 2022] GET /compute/v2.1/servers/e125ab44-9111-4260-909d-95d57b7861a7 => generated 1674 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:14:19.245812 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-c367ad4d-8577-4708-9516-747b93ef5b01 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Calling method '>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:14:19.246423 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-c367ad4d-8577-4708-9516-747b93ef5b01 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] [instance: c3478cd4-e4ab-4a7d-9f4d-65323c450348] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:14:19.248860 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG dbcounter [-] [118815] Writing DB stats nova_cell0:SELECT=2 {{(pid=118815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:14:19.254761 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-c367ad4d-8577-4708-9516-747b93ef5b01 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:14:19.255284 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-c367ad4d-8577-4708-9516-747b93ef5b01 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:14:19.255727 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-c367ad4d-8577-4708-9516-747b93ef5b01 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:14:19.256427 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-c367ad4d-8577-4708-9516-747b93ef5b01 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:14:19.256887 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-c367ad4d-8577-4708-9516-747b93ef5b01 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:14:19.257311 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-c367ad4d-8577-4708-9516-747b93ef5b01 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:14:19.392772 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-c367ad4d-8577-4708-9516-747b93ef5b01 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:14:19.402241 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-c367ad4d-8577-4708-9516-747b93ef5b01 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:14:19.403954 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-c367ad4d-8577-4708-9516-747b93ef5b01 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:14:19.405323 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-c367ad4d-8577-4708-9516-747b93ef5b01 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] 10.222.0.23 "GET /compute/v2.1/servers/c3478cd4-e4ab-4a7d-9f4d-65323c450348" status: 200 len: 1407 microversion: 2.20 time: 0.163382 Oct 13 13:14:19.406504 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 288/590] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 13:14:19 2022] GET /compute/v2.1/servers/c3478cd4-e4ab-4a7d-9f4d-65323c450348 => generated 1407 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 13:14:19.439223 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [req-c7964a6b-0075-467a-bec7-3718030e6a6b req-44f4bbac-5114-471c-ace9-5b728e7cf711 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e125ab44-9111-4260-909d-95d57b7861a7", "name": "network-vif-deleted", "tag": "95c8323b-318e-4698-a732-2714f447a0ff"}]} {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 13:14:19.452497 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [req-c7964a6b-0075-467a-bec7-3718030e6a6b req-44f4bbac-5114-471c-ace9-5b728e7cf711 service nova] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:14:19.453082 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [req-c7964a6b-0075-467a-bec7-3718030e6a6b req-44f4bbac-5114-471c-ace9-5b728e7cf711 service nova] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:14:19.453584 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [req-c7964a6b-0075-467a-bec7-3718030e6a6b req-44f4bbac-5114-471c-ace9-5b728e7cf711 service nova] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:14:19.466815 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.compute.server_external_events [req-c7964a6b-0075-467a-bec7-3718030e6a6b req-44f4bbac-5114-471c-ace9-5b728e7cf711 service nova] Creating event network-vif-deleted:95c8323b-318e-4698-a732-2714f447a0ff for instance e125ab44-9111-4260-909d-95d57b7861a7 on hv-cinder-82660 Oct 13 13:14:19.473012 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [req-c7964a6b-0075-467a-bec7-3718030e6a6b req-44f4bbac-5114-471c-ace9-5b728e7cf711 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037402 Oct 13 13:14:19.474947 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 303/591] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 13:14:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 13:14:19.926459 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-ae8f9233-1c06-4404-9c8d-bc375e63e9d8 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Calling method '>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:14:19.927253 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-ae8f9233-1c06-4404-9c8d-bc375e63e9d8 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] [instance: e125ab44-9111-4260-909d-95d57b7861a7] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:14:19.933154 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-ae8f9233-1c06-4404-9c8d-bc375e63e9d8 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:14:19.933628 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-ae8f9233-1c06-4404-9c8d-bc375e63e9d8 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:14:19.934058 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-ae8f9233-1c06-4404-9c8d-bc375e63e9d8 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:14:19.934746 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-ae8f9233-1c06-4404-9c8d-bc375e63e9d8 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:14:19.935242 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-ae8f9233-1c06-4404-9c8d-bc375e63e9d8 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:14:19.935660 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-ae8f9233-1c06-4404-9c8d-bc375e63e9d8 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:14:19.965847 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-ae8f9233-1c06-4404-9c8d-bc375e63e9d8 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:14:19.966571 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-ae8f9233-1c06-4404-9c8d-bc375e63e9d8 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:14:19.967006 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-ae8f9233-1c06-4404-9c8d-bc375e63e9d8 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:14:19.967479 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.objects.instance [None req-ae8f9233-1c06-4404-9c8d-bc375e63e9d8 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lazy-loading 'fault' on Instance uuid e125ab44-9111-4260-909d-95d57b7861a7 {{(pid=118815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 13 13:14:20.008621 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-ae8f9233-1c06-4404-9c8d-bc375e63e9d8 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e783caddcad473dbdd764919286e244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecd3d5d2a3a54a07ba64f1fea4846c40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:14:20.016850 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-ae8f9233-1c06-4404-9c8d-bc375e63e9d8 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] 10.222.0.23 "GET /compute/v2.1/servers/e125ab44-9111-4260-909d-95d57b7861a7" status: 200 len: 1328 microversion: 2.1 time: 0.098906 Oct 13 13:14:20.017415 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 289/592] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:14:19 2022] GET /compute/v2.1/servers/e125ab44-9111-4260-909d-95d57b7861a7 => generated 1328 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:14:20.432364 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-5e7b1e22-9d17-4ccd-983a-4800b6303ce8 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Calling method '>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:14:20.432987 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-5e7b1e22-9d17-4ccd-983a-4800b6303ce8 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] [instance: c3478cd4-e4ab-4a7d-9f4d-65323c450348] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:14:20.440474 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-5e7b1e22-9d17-4ccd-983a-4800b6303ce8 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:14:20.440955 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-5e7b1e22-9d17-4ccd-983a-4800b6303ce8 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:14:20.441390 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-5e7b1e22-9d17-4ccd-983a-4800b6303ce8 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:14:20.442069 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-5e7b1e22-9d17-4ccd-983a-4800b6303ce8 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:14:20.442520 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-5e7b1e22-9d17-4ccd-983a-4800b6303ce8 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:14:20.442945 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-5e7b1e22-9d17-4ccd-983a-4800b6303ce8 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:14:20.571787 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-5e7b1e22-9d17-4ccd-983a-4800b6303ce8 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:14:20.580248 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-5e7b1e22-9d17-4ccd-983a-4800b6303ce8 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:14:20.581723 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-5e7b1e22-9d17-4ccd-983a-4800b6303ce8 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:14:20.582869 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-5e7b1e22-9d17-4ccd-983a-4800b6303ce8 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] 10.222.0.23 "GET /compute/v2.1/servers/c3478cd4-e4ab-4a7d-9f4d-65323c450348" status: 200 len: 1599 microversion: 2.20 time: 0.154722 Oct 13 13:14:20.583455 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 304/593] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 13:14:20 2022] GET /compute/v2.1/servers/c3478cd4-e4ab-4a7d-9f4d-65323c450348 => generated 1599 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 13:14:20.607969 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-7c6d9342-43ae-4f38-80b1-95f2d41f382a tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Calling method '>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:14:20.608533 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-7c6d9342-43ae-4f38-80b1-95f2d41f382a tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] [instance: c3478cd4-e4ab-4a7d-9f4d-65323c450348] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:14:20.615774 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-7c6d9342-43ae-4f38-80b1-95f2d41f382a tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:14:20.616256 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-7c6d9342-43ae-4f38-80b1-95f2d41f382a tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:14:20.616687 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-7c6d9342-43ae-4f38-80b1-95f2d41f382a tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:14:20.617378 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-7c6d9342-43ae-4f38-80b1-95f2d41f382a tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:14:20.617855 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-7c6d9342-43ae-4f38-80b1-95f2d41f382a tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:14:20.618290 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-7c6d9342-43ae-4f38-80b1-95f2d41f382a tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:14:20.632731 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG dbcounter [-] [118815] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:14:20.701771 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-7c6d9342-43ae-4f38-80b1-95f2d41f382a tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] 10.222.0.23 "GET /compute/v2.1/servers/c3478cd4-e4ab-4a7d-9f4d-65323c450348/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.097699 Oct 13 13:14:20.702392 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 290/594] 10.222.0.23 () {60 vars in 1316 bytes} [Thu Oct 13 13:14:20 2022] GET /compute/v2.1/servers/c3478cd4-e4ab-4a7d-9f4d-65323c450348/os-interface => generated 285 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 13 13:14:21.040168 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-fbbcf836-2e82-46f7-bc2c-b4ec22f16b21 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Calling method '>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:14:21.040803 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-fbbcf836-2e82-46f7-bc2c-b4ec22f16b21 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] [instance: e125ab44-9111-4260-909d-95d57b7861a7] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:14:21.047540 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-fbbcf836-2e82-46f7-bc2c-b4ec22f16b21 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:14:21.048036 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-fbbcf836-2e82-46f7-bc2c-b4ec22f16b21 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:14:21.048476 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-fbbcf836-2e82-46f7-bc2c-b4ec22f16b21 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:14:21.049176 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-fbbcf836-2e82-46f7-bc2c-b4ec22f16b21 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:14:21.049631 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-fbbcf836-2e82-46f7-bc2c-b4ec22f16b21 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:14:21.050313 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-fbbcf836-2e82-46f7-bc2c-b4ec22f16b21 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:14:21.063723 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.wsgi [None req-fbbcf836-2e82-46f7-bc2c-b4ec22f16b21 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] HTTP exception thrown: Instance e125ab44-9111-4260-909d-95d57b7861a7 could not be found. Oct 13 13:14:21.065368 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-fbbcf836-2e82-46f7-bc2c-b4ec22f16b21 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Request method failure captured: Oct 13 13:14:21.065368 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: request: GET /compute/v2.1/servers/e125ab44-9111-4260-909d-95d57b7861a7 HTTP/1.1 Oct 13 13:14:21.065368 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: Accept: application/json Oct 13 13:14:21.065368 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: Accept-Encoding: identity Oct 13 13:14:21.065368 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: Connection: close Oct 13 13:14:21.065368 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: Content-Length: 0 Oct 13 13:14:21.065368 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: Content-Type: application/json Oct 13 13:14:21.065368 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: Host: 10.222.0.23 Oct 13 13:14:21.065368 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: Openstack-System-Scope: None Oct 13 13:14:21.065368 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: User-Agent: python-urllib3/1.26.12 Oct 13 13:14:21.065368 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Auth-Token: gAAAAABjSA4j2QZ79JADlbjw7OER1BQZIiLZ1uCyFy0h36PJaXCQoDK_yCwayKC5Dar6tv1xHn9Cdo-oanif51w0YCyPjllC9Rp_s6doFqdHrbagiQe_kWvWm9qSmDfIBvi6knMX5BwHXrEbR4L15OTJyRFkB4RlDw3ylQxb4D5_yL2WGeVHmtE Oct 13 13:14:21.065368 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Domain-Id: None Oct 13 13:14:21.065368 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Domain-Name: None Oct 13 13:14:21.065368 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Identity-Status: Confirmed Oct 13 13:14:21.065368 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Is-Admin-Project: True Oct 13 13:14:21.065368 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Project-Domain-Id: default Oct 13 13:14:21.065368 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Project-Domain-Name: Default Oct 13 13:14:21.065368 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Project-Id: ecd3d5d2a3a54a07ba64f1fea4846c40 Oct 13 13:14:21.065368 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Project-Name: tempest-AttachVolumeTestJSON-1763301118 Oct 13 13:14:21.065368 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Role: reader,member Oct 13 13:14:21.065368 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Roles: reader,member Oct 13 13:14:21.066648 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_ecd3d5d2a3a54a07ba64f1fea4846c40"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ecd3d5d2a3a54a07ba64f1fea4846c40"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ecd3d5d2a3a54a07ba64f1fea4846c40"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/ecd3d5d2a3a54a07ba64f1fea4846c40"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}] Oct 13 13:14:21.066648 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Tenant: tempest-AttachVolumeTestJSON-1763301118 Oct 13 13:14:21.066648 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Tenant-Id: ecd3d5d2a3a54a07ba64f1fea4846c40 Oct 13 13:14:21.066648 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1763301118 Oct 13 13:14:21.066648 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-User: tempest-AttachVolumeTestJSON-1763301118-project Oct 13 13:14:21.066648 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-User-Domain-Id: default Oct 13 13:14:21.066648 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-User-Domain-Name: Default Oct 13 13:14:21.066648 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-User-Id: 2e783caddcad473dbdd764919286e244 Oct 13 13:14:21.066648 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-User-Name: tempest-AttachVolumeTestJSON-1763301118-project Oct 13 13:14:21.066648 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: method: > Oct 13 13:14:21.066648 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: exception: Instance e125ab44-9111-4260-909d-95d57b7861a7 could not be found. Oct 13 13:14:21.066648 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: action_args: {'id': 'e125ab44-9111-4260-909d-95d57b7861a7'} Oct 13 13:14:21.067451 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 13:14:21.067451 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 13:14:21.067451 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 13 13:14:21.067451 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 13 13:14:21.067451 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 13 13:14:21.067451 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 13 13:14:21.067451 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 13 13:14:21.067451 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 13 13:14:21.067451 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 13 13:14:21.067451 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 13 13:14:21.067451 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e125ab44-9111-4260-909d-95d57b7861a7 could not be found. Oct 13 13:14:21.067451 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi Oct 13 13:14:21.067451 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 13:14:21.067451 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi Oct 13 13:14:21.067451 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 13:14:21.067451 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 13:14:21.067451 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 13:14:21.067451 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 13:14:21.067451 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 13:14:21.067451 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 13:14:21.068623 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 13:14:21.068623 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 13 13:14:21.068623 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 13 13:14:21.068623 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 13 13:14:21.068623 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 13 13:14:21.068623 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 13 13:14:21.068623 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 13 13:14:21.068623 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e125ab44-9111-4260-909d-95d57b7861a7 could not be found. Oct 13 13:14:21.068623 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi Oct 13 13:14:21.068623 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 13:14:21.068623 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi Oct 13 13:14:21.068623 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 13:14:21.068623 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 13:14:21.068623 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 13:14:21.068623 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 13:14:21.068623 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 13:14:21.068623 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e125ab44-9111-4260-909d-95d57b7861a7 could not be found. Oct 13 13:14:21.068623 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi Oct 13 13:14:21.069683 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-fbbcf836-2e82-46f7-bc2c-b4ec22f16b21 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Returning 404 to user: Instance e125ab44-9111-4260-909d-95d57b7861a7 could not be found. {{(pid=118814) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 13:14:21.069683 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-fbbcf836-2e82-46f7-bc2c-b4ec22f16b21 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] 10.222.0.23 "GET /compute/v2.1/servers/e125ab44-9111-4260-909d-95d57b7861a7" status: 404 len: 111 microversion: 2.1 time: 0.030624 Oct 13 13:14:21.069683 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 305/595] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:14:21 2022] GET /compute/v2.1/servers/e125ab44-9111-4260-909d-95d57b7861a7 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 13 13:14:21.075998 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-01e84d9c-137e-43ab-845a-24727c5452b4 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Calling method '.version_select at 0x7f5093bc6f70>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:14:21.095812 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-01e84d9c-137e-43ab-845a-24727c5452b4 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1254467242" status: 202 len: 0 microversion: 2.1 time: 0.023693 Oct 13 13:14:21.096394 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 291/596] 10.222.0.23 () {58 vars in 1221 bytes} [Thu Oct 13 13:14:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1254467242 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 13 13:14:21.648871 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [req-1d60cd84-26ed-4112-8d1b-155890f24fd5 req-515f9426-4afd-4087-82b3-68864b8500e7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c3478cd4-e4ab-4a7d-9f4d-65323c450348", "tag": "ff57ee79-9921-43ed-817d-5ba082c97343"}]} {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 13:14:21.659264 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [req-1d60cd84-26ed-4112-8d1b-155890f24fd5 req-515f9426-4afd-4087-82b3-68864b8500e7 service nova] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:14:21.659748 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [req-1d60cd84-26ed-4112-8d1b-155890f24fd5 req-515f9426-4afd-4087-82b3-68864b8500e7 service nova] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:14:21.660181 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [req-1d60cd84-26ed-4112-8d1b-155890f24fd5 req-515f9426-4afd-4087-82b3-68864b8500e7 service nova] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:14:21.671582 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.compute.server_external_events [req-1d60cd84-26ed-4112-8d1b-155890f24fd5 req-515f9426-4afd-4087-82b3-68864b8500e7 service nova] Creating event network-changed:ff57ee79-9921-43ed-817d-5ba082c97343 for instance c3478cd4-e4ab-4a7d-9f4d-65323c450348 on hv-cinder-82660 Oct 13 13:14:21.677128 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [req-1d60cd84-26ed-4112-8d1b-155890f24fd5 req-515f9426-4afd-4087-82b3-68864b8500e7 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031848 Oct 13 13:14:21.677718 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 306/597] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 13:14:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 13:14:22.174453 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-b80d5030-a44c-4feb-8b34-3d3c7a5bad62 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Action: 'create', calling method: .version_select at 0x7f5093bea820>, body: {"keypair": {"name": "tempest-keypair-137972482", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI5K/Wi6JqsANTYt2MjZ/RHdD/JayeVwmbun2WSYspAG5yTzKIlRxHmChPQfWBE1skNttFlhM2QSSV6Tb5FK9D2pA+D3LBUS32qjK33GNMz0mHroDnwxLKIwKm/mlqLHEA=="}} {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 13:14:22.193679 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.quota [None req-b80d5030-a44c-4feb-8b34-3d3c7a5bad62 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Getting quotas for project ecd3d5d2a3a54a07ba64f1fea4846c40. Resources: {'key_pairs'} {{(pid=118815) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 13 13:14:22.197873 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.quota [None req-b80d5030-a44c-4feb-8b34-3d3c7a5bad62 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Getting quotas for user 2e783caddcad473dbdd764919286e244 and project ecd3d5d2a3a54a07ba64f1fea4846c40. Resources: {'key_pairs'} {{(pid=118815) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 13 13:14:22.226935 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-b80d5030-a44c-4feb-8b34-3d3c7a5bad62 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.057111 Oct 13 13:14:22.227850 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 292/598] 10.222.0.23 () {60 vars in 1159 bytes} [Thu Oct 13 13:14:22 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 13:14:23.547548 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-ffdc3ff3-9453-431c-a2ba-0d611fc58068 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1761045414", "imageRef": "e2cdd20b-2540-48bc-a05c-d6a2e7e9a66e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "9007e121-4e22-42f4-a8ed-c79c5c61badd"}], "security_groups": [{"name": "tempest-securitygroup--146144921"}], "key_name": "tempest-keypair-137972482", "user_data": "}} {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 13:14:23.650356 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.network.neutron [None req-ffdc3ff3-9453-431c-a2ba-0d611fc58068 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] validate_networks() for [('9007e121-4e22-42f4-a8ed-c79c5c61badd', None, None, None, None, None)] {{(pid=118814) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 13 13:14:24.238162 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.virt.hardware [None req-ffdc3ff3-9453-431c-a2ba-0d611fc58068 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Flavor limits 0:0:0 {{(pid=118814) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 13 13:14:24.238595 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.virt.hardware [None req-ffdc3ff3-9453-431c-a2ba-0d611fc58068 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Image limits 0:0:0 {{(pid=118814) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 13 13:14:24.239128 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.virt.hardware [None req-ffdc3ff3-9453-431c-a2ba-0d611fc58068 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Flavor pref 0:0:0 {{(pid=118814) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 13 13:14:24.239544 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.virt.hardware [None req-ffdc3ff3-9453-431c-a2ba-0d611fc58068 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Image pref 0:0:0 {{(pid=118814) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 13 13:14:24.239960 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.virt.hardware [None req-ffdc3ff3-9453-431c-a2ba-0d611fc58068 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118814) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 13 13:14:24.248638 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-ffdc3ff3-9453-431c-a2ba-0d611fc58068 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:14:24.249132 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-ffdc3ff3-9453-431c-a2ba-0d611fc58068 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:14:24.250193 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-ffdc3ff3-9453-431c-a2ba-0d611fc58068 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:14:24.250922 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-ffdc3ff3-9453-431c-a2ba-0d611fc58068 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:14:24.251409 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-ffdc3ff3-9453-431c-a2ba-0d611fc58068 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:14:24.251843 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-ffdc3ff3-9453-431c-a2ba-0d611fc58068 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:14:24.268081 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.quota [None req-ffdc3ff3-9453-431c-a2ba-0d611fc58068 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Getting quotas for project ecd3d5d2a3a54a07ba64f1fea4846c40. Resources: {'instances', 'cores', 'ram'} {{(pid=118814) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 13 13:14:24.271993 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.quota [None req-ffdc3ff3-9453-431c-a2ba-0d611fc58068 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Getting quotas for user 2e783caddcad473dbdd764919286e244 and project ecd3d5d2a3a54a07ba64f1fea4846c40. Resources: {'instances', 'cores', 'ram'} {{(pid=118814) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 13 13:14:24.282677 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-ffdc3ff3-9453-431c-a2ba-0d611fc58068 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Going to run 1 instances... {{(pid=118814) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 13 13:14:24.285043 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-ffdc3ff3-9453-431c-a2ba-0d611fc58068 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] [instance: 2aa89397-329a-494c-8b4b-fa7e513d3171] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e2cdd20b-2540-48bc-a05c-d6a2e7e9a66e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118814) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 13 13:14:24.331578 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-ffdc3ff3-9453-431c-a2ba-0d611fc58068 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.789611 Oct 13 13:14:24.332219 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 307/599] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Oct 13 13:14:23 2022] POST /compute/v2.1/servers => generated 401 bytes in 791 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 13 13:14:24.343837 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-7b990c76-97b3-4de3-ab69-ea7c71ac0bf0 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Calling method '>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:14:24.344450 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-7b990c76-97b3-4de3-ab69-ea7c71ac0bf0 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] [instance: 2aa89397-329a-494c-8b4b-fa7e513d3171] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:14:24.397352 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-7b990c76-97b3-4de3-ab69-ea7c71ac0bf0 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e783caddcad473dbdd764919286e244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecd3d5d2a3a54a07ba64f1fea4846c40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:14:24.404187 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-7b990c76-97b3-4de3-ab69-ea7c71ac0bf0 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] 10.222.0.23 "GET /compute/v2.1/servers/2aa89397-329a-494c-8b4b-fa7e513d3171" status: 200 len: 1237 microversion: 2.1 time: 0.064700 Oct 13 13:14:24.404749 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 293/600] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:14:24 2022] GET /compute/v2.1/servers/2aa89397-329a-494c-8b4b-fa7e513d3171 => generated 1237 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:14:25.427687 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-945c52a4-d717-49ad-b4c1-ede0b30ab396 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Calling method '>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:14:25.428212 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-945c52a4-d717-49ad-b4c1-ede0b30ab396 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] [instance: 2aa89397-329a-494c-8b4b-fa7e513d3171] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:14:25.435593 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-945c52a4-d717-49ad-b4c1-ede0b30ab396 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:14:25.436075 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-945c52a4-d717-49ad-b4c1-ede0b30ab396 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:14:25.437059 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-945c52a4-d717-49ad-b4c1-ede0b30ab396 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:14:25.437776 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-945c52a4-d717-49ad-b4c1-ede0b30ab396 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:14:25.438234 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-945c52a4-d717-49ad-b4c1-ede0b30ab396 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:14:25.438666 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-945c52a4-d717-49ad-b4c1-ede0b30ab396 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:14:25.500377 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-945c52a4-d717-49ad-b4c1-ede0b30ab396 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e783caddcad473dbdd764919286e244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecd3d5d2a3a54a07ba64f1fea4846c40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:14:25.509250 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-945c52a4-d717-49ad-b4c1-ede0b30ab396 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] 10.222.0.23 "GET /compute/v2.1/servers/2aa89397-329a-494c-8b4b-fa7e513d3171" status: 200 len: 1297 microversion: 2.1 time: 0.086259 Oct 13 13:14:25.515469 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 308/601] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:14:25 2022] GET /compute/v2.1/servers/2aa89397-329a-494c-8b4b-fa7e513d3171 => generated 1297 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:14:26.534060 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-67920d9f-ded6-418a-922c-cffefd88d962 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Calling method '>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:14:26.534668 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-67920d9f-ded6-418a-922c-cffefd88d962 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] [instance: 2aa89397-329a-494c-8b4b-fa7e513d3171] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:14:26.541086 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-67920d9f-ded6-418a-922c-cffefd88d962 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:14:26.541575 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-67920d9f-ded6-418a-922c-cffefd88d962 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:14:26.542011 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-67920d9f-ded6-418a-922c-cffefd88d962 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:14:26.542705 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-67920d9f-ded6-418a-922c-cffefd88d962 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:14:26.543189 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-67920d9f-ded6-418a-922c-cffefd88d962 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:14:26.543703 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-67920d9f-ded6-418a-922c-cffefd88d962 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:14:26.677926 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-67920d9f-ded6-418a-922c-cffefd88d962 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e783caddcad473dbdd764919286e244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecd3d5d2a3a54a07ba64f1fea4846c40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:14:26.685533 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-67920d9f-ded6-418a-922c-cffefd88d962 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] 10.222.0.23 "GET /compute/v2.1/servers/2aa89397-329a-494c-8b4b-fa7e513d3171" status: 200 len: 1362 microversion: 2.1 time: 0.156041 Oct 13 13:14:26.686096 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 294/602] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:14:26 2022] GET /compute/v2.1/servers/2aa89397-329a-494c-8b4b-fa7e513d3171 => generated 1362 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:14:26.855852 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [req-7a0a0aa2-7149-4bf7-aee0-b94f9d058260 req-f42ae99b-62eb-4547-ade8-0823605a69e8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2aa89397-329a-494c-8b4b-fa7e513d3171", "tag": "c2c3f2c7-45cd-4ffe-85fe-fc2012972cc8"}]} {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 13:14:26.865951 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [req-7a0a0aa2-7149-4bf7-aee0-b94f9d058260 req-f42ae99b-62eb-4547-ade8-0823605a69e8 service nova] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:14:26.866430 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [req-7a0a0aa2-7149-4bf7-aee0-b94f9d058260 req-f42ae99b-62eb-4547-ade8-0823605a69e8 service nova] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:14:26.867081 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [req-7a0a0aa2-7149-4bf7-aee0-b94f9d058260 req-f42ae99b-62eb-4547-ade8-0823605a69e8 service nova] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:14:26.879014 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.compute.server_external_events [req-7a0a0aa2-7149-4bf7-aee0-b94f9d058260 req-f42ae99b-62eb-4547-ade8-0823605a69e8 service nova] Creating event network-changed:c2c3f2c7-45cd-4ffe-85fe-fc2012972cc8 for instance 2aa89397-329a-494c-8b4b-fa7e513d3171 on hv-cinder-82660 Oct 13 13:14:26.883842 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [req-7a0a0aa2-7149-4bf7-aee0-b94f9d058260 req-f42ae99b-62eb-4547-ade8-0823605a69e8 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031669 Oct 13 13:14:26.884592 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 309/603] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 13:14:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 13:14:27.708734 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-eaead0d1-3ac8-41fc-8822-230db076ed3e tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Calling method '>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:14:27.709346 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-eaead0d1-3ac8-41fc-8822-230db076ed3e tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] [instance: 2aa89397-329a-494c-8b4b-fa7e513d3171] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:14:27.715729 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-eaead0d1-3ac8-41fc-8822-230db076ed3e tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:14:27.716209 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-eaead0d1-3ac8-41fc-8822-230db076ed3e tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:14:27.716650 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-eaead0d1-3ac8-41fc-8822-230db076ed3e tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:14:27.717332 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-eaead0d1-3ac8-41fc-8822-230db076ed3e tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:14:27.718302 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-eaead0d1-3ac8-41fc-8822-230db076ed3e tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:14:27.718725 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-eaead0d1-3ac8-41fc-8822-230db076ed3e tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:14:27.843764 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-eaead0d1-3ac8-41fc-8822-230db076ed3e tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e783caddcad473dbdd764919286e244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecd3d5d2a3a54a07ba64f1fea4846c40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:14:27.851430 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-eaead0d1-3ac8-41fc-8822-230db076ed3e tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] 10.222.0.23 "GET /compute/v2.1/servers/2aa89397-329a-494c-8b4b-fa7e513d3171" status: 200 len: 1362 microversion: 2.1 time: 0.146466 Oct 13 13:14:27.851980 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 295/604] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:14:27 2022] GET /compute/v2.1/servers/2aa89397-329a-494c-8b4b-fa7e513d3171 => generated 1362 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:14:27.994218 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-0edfd41b-c982-489f-9ddc-f12b8d0321bd tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-180345211"}} {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 13:14:27.994772 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-0edfd41b-c982-489f-9ddc-f12b8d0321bd tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] [instance: 59e81a58-9400-4cea-aa38-b24b394e33d7] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:14:28.000914 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-0edfd41b-c982-489f-9ddc-f12b8d0321bd tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:14:28.001397 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-0edfd41b-c982-489f-9ddc-f12b8d0321bd tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:14:28.001832 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-0edfd41b-c982-489f-9ddc-f12b8d0321bd tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:14:28.002507 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-0edfd41b-c982-489f-9ddc-f12b8d0321bd tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:14:28.002960 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-0edfd41b-c982-489f-9ddc-f12b8d0321bd tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:14:28.003409 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-0edfd41b-c982-489f-9ddc-f12b8d0321bd tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:14:28.130019 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.network.security_group_api [None req-0edfd41b-c982-489f-9ddc-f12b8d0321bd tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Removing security group 3803a510-33fe-4754-8fcc-b9e1875f1efa from port 5e82a763-989b-4ba3-b2d2-7ad17b260a77 Oct 13 13:14:28.434402 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-0edfd41b-c982-489f-9ddc-f12b8d0321bd tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] 10.222.0.23 "POST /compute/v2.1/servers/59e81a58-9400-4cea-aa38-b24b394e33d7/action" status: 202 len: 0 microversion: 2.1 time: 0.444942 Oct 13 13:14:28.441097 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 310/605] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Oct 13 13:14:27 2022] POST /compute/v2.1/servers/59e81a58-9400-4cea-aa38-b24b394e33d7/action => generated 0 bytes in 452 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 13 13:14:28.442613 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [req-b12e126f-7818-486b-9efd-22e520fd6cff req-2194af27-6022-4a6b-9ad1-4a8c13ad0b4a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "59e81a58-9400-4cea-aa38-b24b394e33d7", "tag": "5e82a763-989b-4ba3-b2d2-7ad17b260a77"}]} {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 13:14:28.454541 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [req-b12e126f-7818-486b-9efd-22e520fd6cff req-2194af27-6022-4a6b-9ad1-4a8c13ad0b4a service nova] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:14:28.455265 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [req-b12e126f-7818-486b-9efd-22e520fd6cff req-2194af27-6022-4a6b-9ad1-4a8c13ad0b4a service nova] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:14:28.455868 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [req-b12e126f-7818-486b-9efd-22e520fd6cff req-2194af27-6022-4a6b-9ad1-4a8c13ad0b4a service nova] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:14:28.467567 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.compute.server_external_events [req-b12e126f-7818-486b-9efd-22e520fd6cff req-2194af27-6022-4a6b-9ad1-4a8c13ad0b4a service nova] Creating event network-changed:5e82a763-989b-4ba3-b2d2-7ad17b260a77 for instance 59e81a58-9400-4cea-aa38-b24b394e33d7 on hv-cinder-82660 Oct 13 13:14:28.473056 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [req-b12e126f-7818-486b-9efd-22e520fd6cff req-2194af27-6022-4a6b-9ad1-4a8c13ad0b4a service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034202 Oct 13 13:14:28.474350 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 296/606] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 13:14:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 13 13:14:28.873827 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-a20f3bc6-f1be-47ad-8f94-0c6bb5fbded7 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Calling method '>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:14:28.875430 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-a20f3bc6-f1be-47ad-8f94-0c6bb5fbded7 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] [instance: 2aa89397-329a-494c-8b4b-fa7e513d3171] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:14:28.882087 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-a20f3bc6-f1be-47ad-8f94-0c6bb5fbded7 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:14:28.882576 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-a20f3bc6-f1be-47ad-8f94-0c6bb5fbded7 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:14:28.883238 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-a20f3bc6-f1be-47ad-8f94-0c6bb5fbded7 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:14:28.884120 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-a20f3bc6-f1be-47ad-8f94-0c6bb5fbded7 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:14:28.884729 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-a20f3bc6-f1be-47ad-8f94-0c6bb5fbded7 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:14:28.885320 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-a20f3bc6-f1be-47ad-8f94-0c6bb5fbded7 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:14:29.112363 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-a20f3bc6-f1be-47ad-8f94-0c6bb5fbded7 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e783caddcad473dbdd764919286e244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecd3d5d2a3a54a07ba64f1fea4846c40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:14:29.121036 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-a20f3bc6-f1be-47ad-8f94-0c6bb5fbded7 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] 10.222.0.23 "GET /compute/v2.1/servers/2aa89397-329a-494c-8b4b-fa7e513d3171" status: 200 len: 1362 microversion: 2.1 time: 0.251059 Oct 13 13:14:29.122064 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 311/607] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:14:28 2022] GET /compute/v2.1/servers/2aa89397-329a-494c-8b4b-fa7e513d3171 => generated 1362 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:14:29.670091 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-2da66bbd-f58a-4b7c-b75c-c36cd9a59fbd tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Calling method '>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:14:29.670700 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-2da66bbd-f58a-4b7c-b75c-c36cd9a59fbd tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] [instance: 59e81a58-9400-4cea-aa38-b24b394e33d7] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:14:29.678548 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-2da66bbd-f58a-4b7c-b75c-c36cd9a59fbd tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:14:29.679036 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-2da66bbd-f58a-4b7c-b75c-c36cd9a59fbd tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:14:29.679501 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-2da66bbd-f58a-4b7c-b75c-c36cd9a59fbd tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:14:29.680198 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-2da66bbd-f58a-4b7c-b75c-c36cd9a59fbd tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:14:29.680652 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-2da66bbd-f58a-4b7c-b75c-c36cd9a59fbd tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:14:29.681082 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-2da66bbd-f58a-4b7c-b75c-c36cd9a59fbd tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:14:29.763078 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.objects.instance [None req-2da66bbd-f58a-4b7c-b75c-c36cd9a59fbd tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Lazy-loading 'services' on Instance uuid 59e81a58-9400-4cea-aa38-b24b394e33d7 {{(pid=118815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 13 13:14:29.837309 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-2da66bbd-f58a-4b7c-b75c-c36cd9a59fbd tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] 10.222.0.23 "DELETE /compute/v2.1/servers/59e81a58-9400-4cea-aa38-b24b394e33d7/os-volume_attachments/d6ae42f7-e4b4-4261-9527-4bd288cf7bf8" status: 202 len: 0 microversion: 2.1 time: 0.171807 Oct 13 13:14:29.837999 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 297/608] 10.222.0.23 () {58 vars in 1416 bytes} [Thu Oct 13 13:14:29 2022] DELETE /compute/v2.1/servers/59e81a58-9400-4cea-aa38-b24b394e33d7/os-volume_attachments/d6ae42f7-e4b4-4261-9527-4bd288cf7bf8 => generated 0 bytes in 174 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 13 13:14:29.846381 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-48e5077e-d77c-459f-b485-5c1c19e3dd02 tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Calling method '>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:14:29.849046 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-48e5077e-d77c-459f-b485-5c1c19e3dd02 tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] [instance: 59e81a58-9400-4cea-aa38-b24b394e33d7] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:14:29.855386 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-48e5077e-d77c-459f-b485-5c1c19e3dd02 tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:14:29.855890 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-48e5077e-d77c-459f-b485-5c1c19e3dd02 tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:14:29.856313 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-48e5077e-d77c-459f-b485-5c1c19e3dd02 tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:14:29.857153 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-48e5077e-d77c-459f-b485-5c1c19e3dd02 tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:14:29.857632 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-48e5077e-d77c-459f-b485-5c1c19e3dd02 tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:14:29.858043 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-48e5077e-d77c-459f-b485-5c1c19e3dd02 tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:14:29.890448 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-48e5077e-d77c-459f-b485-5c1c19e3dd02 tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] 10.222.0.23 "GET /compute/v2.1/servers/59e81a58-9400-4cea-aa38-b24b394e33d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047313 Oct 13 13:14:29.891291 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 312/609] 10.222.0.23 () {58 vars in 1302 bytes} [Thu Oct 13 13:14:29 2022] GET /compute/v2.1/servers/59e81a58-9400-4cea-aa38-b24b394e33d7/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 13 13:14:30.145123 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-72a443de-9774-45fa-87e8-e61270d44b7d tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Calling method '>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:14:30.145768 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-72a443de-9774-45fa-87e8-e61270d44b7d tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] [instance: 2aa89397-329a-494c-8b4b-fa7e513d3171] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:14:30.152047 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-72a443de-9774-45fa-87e8-e61270d44b7d tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:14:30.152565 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-72a443de-9774-45fa-87e8-e61270d44b7d tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:14:30.153008 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-72a443de-9774-45fa-87e8-e61270d44b7d tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:14:30.153729 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-72a443de-9774-45fa-87e8-e61270d44b7d tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:14:30.154217 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-72a443de-9774-45fa-87e8-e61270d44b7d tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:14:30.154644 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-72a443de-9774-45fa-87e8-e61270d44b7d tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:14:30.282771 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-72a443de-9774-45fa-87e8-e61270d44b7d tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e783caddcad473dbdd764919286e244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecd3d5d2a3a54a07ba64f1fea4846c40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:14:30.290434 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-72a443de-9774-45fa-87e8-e61270d44b7d tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] 10.222.0.23 "GET /compute/v2.1/servers/2aa89397-329a-494c-8b4b-fa7e513d3171" status: 200 len: 1362 microversion: 2.1 time: 0.149650 Oct 13 13:14:30.290997 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 298/610] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:14:30 2022] GET /compute/v2.1/servers/2aa89397-329a-494c-8b4b-fa7e513d3171 => generated 1362 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:14:30.490304 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [req-13132b26-fffa-49a0-8d21-993c4be86e56 req-5b41f4ca-6cb4-4538-95bc-e851b3fe8dd3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "59e81a58-9400-4cea-aa38-b24b394e33d7", "tag": "5e82a763-989b-4ba3-b2d2-7ad17b260a77"}]} {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 13:14:30.501043 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [req-13132b26-fffa-49a0-8d21-993c4be86e56 req-5b41f4ca-6cb4-4538-95bc-e851b3fe8dd3 service nova] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:14:30.501519 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [req-13132b26-fffa-49a0-8d21-993c4be86e56 req-5b41f4ca-6cb4-4538-95bc-e851b3fe8dd3 service nova] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:14:30.501950 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [req-13132b26-fffa-49a0-8d21-993c4be86e56 req-5b41f4ca-6cb4-4538-95bc-e851b3fe8dd3 service nova] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:14:30.513097 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.compute.server_external_events [req-13132b26-fffa-49a0-8d21-993c4be86e56 req-5b41f4ca-6cb4-4538-95bc-e851b3fe8dd3 service nova] Creating event network-changed:5e82a763-989b-4ba3-b2d2-7ad17b260a77 for instance 59e81a58-9400-4cea-aa38-b24b394e33d7 on hv-cinder-82660 Oct 13 13:14:30.518509 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [req-13132b26-fffa-49a0-8d21-993c4be86e56 req-5b41f4ca-6cb4-4538-95bc-e851b3fe8dd3 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031945 Oct 13 13:14:30.519169 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 313/611] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 13:14:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 13:14:30.903015 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-3bcab963-4e7c-4d85-a8fb-ac333f126c43 tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Calling method '>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:14:30.905312 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-3bcab963-4e7c-4d85-a8fb-ac333f126c43 tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] [instance: 59e81a58-9400-4cea-aa38-b24b394e33d7] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:14:30.912196 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-3bcab963-4e7c-4d85-a8fb-ac333f126c43 tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:14:30.912676 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-3bcab963-4e7c-4d85-a8fb-ac333f126c43 tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:14:30.913108 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-3bcab963-4e7c-4d85-a8fb-ac333f126c43 tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:14:30.913979 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-3bcab963-4e7c-4d85-a8fb-ac333f126c43 tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:14:30.914593 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-3bcab963-4e7c-4d85-a8fb-ac333f126c43 tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:14:30.915018 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-3bcab963-4e7c-4d85-a8fb-ac333f126c43 tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:14:30.945716 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-3bcab963-4e7c-4d85-a8fb-ac333f126c43 tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] 10.222.0.23 "GET /compute/v2.1/servers/59e81a58-9400-4cea-aa38-b24b394e33d7/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046639 Oct 13 13:14:30.951909 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 299/612] 10.222.0.23 () {58 vars in 1302 bytes} [Thu Oct 13 13:14:30 2022] GET /compute/v2.1/servers/59e81a58-9400-4cea-aa38-b24b394e33d7/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 13 13:14:30.957460 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-bc88297c-2d2d-4488-b2ca-af7f8b35926d tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Calling method '>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:14:30.958026 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-bc88297c-2d2d-4488-b2ca-af7f8b35926d tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] [instance: 59e81a58-9400-4cea-aa38-b24b394e33d7] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:14:30.964127 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-bc88297c-2d2d-4488-b2ca-af7f8b35926d tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:14:30.964606 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-bc88297c-2d2d-4488-b2ca-af7f8b35926d tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:14:30.965038 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-bc88297c-2d2d-4488-b2ca-af7f8b35926d tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:14:30.965719 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-bc88297c-2d2d-4488-b2ca-af7f8b35926d tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:14:30.966163 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-bc88297c-2d2d-4488-b2ca-af7f8b35926d tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:14:30.966577 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-bc88297c-2d2d-4488-b2ca-af7f8b35926d tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:14:31.044146 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.wsgi [None req-bc88297c-2d2d-4488-b2ca-af7f8b35926d tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] HTTP exception thrown: Instance 59e81a58-9400-4cea-aa38-b24b394e33d7 is not attached to volume d6ae42f7-e4b4-4261-9527-4bd288cf7bf8 Oct 13 13:14:31.047234 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-bc88297c-2d2d-4488-b2ca-af7f8b35926d tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Request method failure captured: Oct 13 13:14:31.047234 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: request: DELETE /compute/v2.1/servers/59e81a58-9400-4cea-aa38-b24b394e33d7/os-volume_attachments/d6ae42f7-e4b4-4261-9527-4bd288cf7bf8 HTTP/1.1 Oct 13 13:14:31.047234 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: Accept: application/json Oct 13 13:14:31.047234 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: Accept-Encoding: identity Oct 13 13:14:31.047234 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: Connection: close Oct 13 13:14:31.047234 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: Content-Length: 0 Oct 13 13:14:31.047234 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: Content-Type: application/json Oct 13 13:14:31.047234 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: Host: 10.222.0.23 Oct 13 13:14:31.047234 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: Openstack-System-Scope: None Oct 13 13:14:31.047234 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: User-Agent: python-urllib3/1.26.12 Oct 13 13:14:31.047234 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Auth-Token: gAAAAABjSA6YzzwKnsiw5C4YwB7d1iykFt7gUG5rL-k-8VmRKCkSryi3JvIochgftCQGgPbOoN2OVeUh3m9xKE3lONjNldXpMZT_PzUeJWKMmASvaanv4XYPLy_Ux1eMWxdR32kuv9dEm6uFo6viWqq-MAA3_95iI_HpWk2kE_bb5TRe55tqg9A Oct 13 13:14:31.047234 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Domain-Id: None Oct 13 13:14:31.047234 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Domain-Name: None Oct 13 13:14:31.047234 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Identity-Status: Confirmed Oct 13 13:14:31.047234 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Is-Admin-Project: True Oct 13 13:14:31.047234 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Project-Domain-Id: default Oct 13 13:14:31.047234 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Project-Domain-Name: Default Oct 13 13:14:31.047234 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Project-Id: 3ed5038c799342d48edc980983f1d996 Oct 13 13:14:31.047234 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Project-Name: tempest-TestMinimumBasicScenario-366179387 Oct 13 13:14:31.047234 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Role: reader,member Oct 13 13:14:31.047234 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Roles: reader,member Oct 13 13:14:31.048726 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_3ed5038c799342d48edc980983f1d996"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/3ed5038c799342d48edc980983f1d996"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/3ed5038c799342d48edc980983f1d996"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/3ed5038c799342d48edc980983f1d996"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}] Oct 13 13:14:31.048726 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Tenant: tempest-TestMinimumBasicScenario-366179387 Oct 13 13:14:31.048726 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Tenant-Id: 3ed5038c799342d48edc980983f1d996 Oct 13 13:14:31.048726 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Tenant-Name: tempest-TestMinimumBasicScenario-366179387 Oct 13 13:14:31.048726 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-User: tempest-TestMinimumBasicScenario-366179387-project Oct 13 13:14:31.048726 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-User-Domain-Id: default Oct 13 13:14:31.048726 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-User-Domain-Name: Default Oct 13 13:14:31.048726 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-User-Id: 7d89667e52b24295ba619203c02c7bd4 Oct 13 13:14:31.048726 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-User-Name: tempest-TestMinimumBasicScenario-366179387-project Oct 13 13:14:31.048726 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: method: > Oct 13 13:14:31.048726 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: exception: Instance 59e81a58-9400-4cea-aa38-b24b394e33d7 is not attached to volume d6ae42f7-e4b4-4261-9527-4bd288cf7bf8 Oct 13 13:14:31.049531 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: action_args: {'server_id': '59e81a58-9400-4cea-aa38-b24b394e33d7', 'id': 'd6ae42f7-e4b4-4261-9527-4bd288cf7bf8'} Oct 13 13:14:31.049531 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 13:14:31.049531 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 13:14:31.049531 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Oct 13 13:14:31.049531 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Oct 13 13:14:31.049531 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 13 13:14:31.049531 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 13 13:14:31.049531 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Oct 13 13:14:31.049531 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Oct 13 13:14:31.049531 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id d6ae42f7-e4b4-4261-9527-4bd288cf7bf8. Oct 13 13:14:31.049531 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi Oct 13 13:14:31.049531 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 13:14:31.049531 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi Oct 13 13:14:31.049531 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 13:14:31.049531 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 13:14:31.049531 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 13:14:31.049531 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 13:14:31.049531 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 13:14:31.049531 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 13:14:31.051167 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 13:14:31.051167 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Oct 13 13:14:31.051167 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 13 13:14:31.051167 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 59e81a58-9400-4cea-aa38-b24b394e33d7 is not attached to volume d6ae42f7-e4b4-4261-9527-4bd288cf7bf8 Oct 13 13:14:31.051167 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi Oct 13 13:14:31.051167 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 13:14:31.051167 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi Oct 13 13:14:31.051167 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 13:14:31.051167 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 13:14:31.051167 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 13:14:31.051167 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 13:14:31.051167 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 13:14:31.051167 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 59e81a58-9400-4cea-aa38-b24b394e33d7 is not attached to volume d6ae42f7-e4b4-4261-9527-4bd288cf7bf8 Oct 13 13:14:31.051167 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi Oct 13 13:14:31.051167 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-bc88297c-2d2d-4488-b2ca-af7f8b35926d tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Returning 404 to user: Instance 59e81a58-9400-4cea-aa38-b24b394e33d7 is not attached to volume d6ae42f7-e4b4-4261-9527-4bd288cf7bf8 {{(pid=118814) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 13:14:31.052389 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-bc88297c-2d2d-4488-b2ca-af7f8b35926d tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] 10.222.0.23 "DELETE /compute/v2.1/servers/59e81a58-9400-4cea-aa38-b24b394e33d7/os-volume_attachments/d6ae42f7-e4b4-4261-9527-4bd288cf7bf8" status: 404 len: 154 microversion: 2.1 time: 0.095631 Oct 13 13:14:31.052389 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 314/613] 10.222.0.23 () {58 vars in 1416 bytes} [Thu Oct 13 13:14:30 2022] DELETE /compute/v2.1/servers/59e81a58-9400-4cea-aa38-b24b394e33d7/os-volume_attachments/d6ae42f7-e4b4-4261-9527-4bd288cf7bf8 => generated 154 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 13 13:14:31.315608 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-3c116233-0302-4b0a-82e9-faeed4fbd0a6 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Calling method '>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:14:31.316479 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [req-1bc60ada-e9bd-405c-8d52-a3b84196609b req-1bf2037a-fe2c-4974-8932-5b38ec913f57 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2aa89397-329a-494c-8b4b-fa7e513d3171", "name": "network-vif-plugged", "status": "completed", "tag": "c2c3f2c7-45cd-4ffe-85fe-fc2012972cc8"}]} {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 13:14:31.317113 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-3c116233-0302-4b0a-82e9-faeed4fbd0a6 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] [instance: 2aa89397-329a-494c-8b4b-fa7e513d3171] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:14:31.326279 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [req-1bc60ada-e9bd-405c-8d52-a3b84196609b req-1bf2037a-fe2c-4974-8932-5b38ec913f57 service nova] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:14:31.326428 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-3c116233-0302-4b0a-82e9-faeed4fbd0a6 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:14:31.326586 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [req-1bc60ada-e9bd-405c-8d52-a3b84196609b req-1bf2037a-fe2c-4974-8932-5b38ec913f57 service nova] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:14:31.326965 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-3c116233-0302-4b0a-82e9-faeed4fbd0a6 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:14:31.327239 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [req-1bc60ada-e9bd-405c-8d52-a3b84196609b req-1bf2037a-fe2c-4974-8932-5b38ec913f57 service nova] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:14:31.327656 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-3c116233-0302-4b0a-82e9-faeed4fbd0a6 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:14:31.328621 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-3c116233-0302-4b0a-82e9-faeed4fbd0a6 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:14:31.329441 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-3c116233-0302-4b0a-82e9-faeed4fbd0a6 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:14:31.329916 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-3c116233-0302-4b0a-82e9-faeed4fbd0a6 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:14:31.340585 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.compute.server_external_events [req-1bc60ada-e9bd-405c-8d52-a3b84196609b req-1bf2037a-fe2c-4974-8932-5b38ec913f57 service nova] Creating event network-vif-plugged:c2c3f2c7-45cd-4ffe-85fe-fc2012972cc8 for instance 2aa89397-329a-494c-8b4b-fa7e513d3171 on hv-cinder-82660 Oct 13 13:14:31.345335 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [req-1bc60ada-e9bd-405c-8d52-a3b84196609b req-1bf2037a-fe2c-4974-8932-5b38ec913f57 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032507 Oct 13 13:14:31.346420 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 315/614] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 13:14:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 13:14:31.487272 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-3c116233-0302-4b0a-82e9-faeed4fbd0a6 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e783caddcad473dbdd764919286e244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecd3d5d2a3a54a07ba64f1fea4846c40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:14:31.494968 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-3c116233-0302-4b0a-82e9-faeed4fbd0a6 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] 10.222.0.23 "GET /compute/v2.1/servers/2aa89397-329a-494c-8b4b-fa7e513d3171" status: 200 len: 1362 microversion: 2.1 time: 0.184950 Oct 13 13:14:31.495560 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 300/615] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:14:31 2022] GET /compute/v2.1/servers/2aa89397-329a-494c-8b4b-fa7e513d3171 => generated 1362 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:14:32.202627 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-de87b8c7-f1fe-4026-bbf9-6f59846d6344 tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Calling method '>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:14:32.203245 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-de87b8c7-f1fe-4026-bbf9-6f59846d6344 tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] [instance: 59e81a58-9400-4cea-aa38-b24b394e33d7] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:14:32.209353 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-de87b8c7-f1fe-4026-bbf9-6f59846d6344 tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:14:32.209834 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-de87b8c7-f1fe-4026-bbf9-6f59846d6344 tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:14:32.210270 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-de87b8c7-f1fe-4026-bbf9-6f59846d6344 tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:14:32.210950 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-de87b8c7-f1fe-4026-bbf9-6f59846d6344 tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:14:32.211425 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-de87b8c7-f1fe-4026-bbf9-6f59846d6344 tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:14:32.211846 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-de87b8c7-f1fe-4026-bbf9-6f59846d6344 tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:14:32.235682 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-de87b8c7-f1fe-4026-bbf9-6f59846d6344 tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] [instance: 59e81a58-9400-4cea-aa38-b24b394e33d7] Going to try to terminate instance {{(pid=118814) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 13 13:14:32.306317 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-de87b8c7-f1fe-4026-bbf9-6f59846d6344 tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] 10.222.0.23 "DELETE /compute/v2.1/servers/59e81a58-9400-4cea-aa38-b24b394e33d7" status: 204 len: 0 microversion: 2.1 time: 0.108898 Oct 13 13:14:32.306878 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 316/616] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Oct 13 13:14:32 2022] DELETE /compute/v2.1/servers/59e81a58-9400-4cea-aa38-b24b394e33d7 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 13 13:14:32.315477 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-e9eb4c06-7fc2-4b3a-899a-ed6bab1df221 tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Calling method '>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:14:32.316118 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-e9eb4c06-7fc2-4b3a-899a-ed6bab1df221 tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] [instance: 59e81a58-9400-4cea-aa38-b24b394e33d7] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:14:32.322375 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-e9eb4c06-7fc2-4b3a-899a-ed6bab1df221 tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:14:32.322854 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-e9eb4c06-7fc2-4b3a-899a-ed6bab1df221 tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:14:32.323339 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-e9eb4c06-7fc2-4b3a-899a-ed6bab1df221 tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:14:32.324027 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-e9eb4c06-7fc2-4b3a-899a-ed6bab1df221 tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:14:32.324479 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-e9eb4c06-7fc2-4b3a-899a-ed6bab1df221 tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:14:32.324907 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-e9eb4c06-7fc2-4b3a-899a-ed6bab1df221 tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:14:32.452444 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-e9eb4c06-7fc2-4b3a-899a-ed6bab1df221 tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d89667e52b24295ba619203c02c7bd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed5038c799342d48edc980983f1d996', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:14:32.460881 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-e9eb4c06-7fc2-4b3a-899a-ed6bab1df221 tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] 10.222.0.23 "GET /compute/v2.1/servers/59e81a58-9400-4cea-aa38-b24b394e33d7" status: 200 len: 1553 microversion: 2.1 time: 0.149243 Oct 13 13:14:32.461341 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 301/617] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:14:32 2022] GET /compute/v2.1/servers/59e81a58-9400-4cea-aa38-b24b394e33d7 => generated 1553 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:14:32.518149 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-cce801ab-d573-446f-98a7-0dd9b64e3b88 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Calling method '>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:14:32.518844 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-cce801ab-d573-446f-98a7-0dd9b64e3b88 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] [instance: 2aa89397-329a-494c-8b4b-fa7e513d3171] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:14:32.524756 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-cce801ab-d573-446f-98a7-0dd9b64e3b88 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:14:32.525237 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-cce801ab-d573-446f-98a7-0dd9b64e3b88 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:14:32.525675 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-cce801ab-d573-446f-98a7-0dd9b64e3b88 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:14:32.526355 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-cce801ab-d573-446f-98a7-0dd9b64e3b88 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:14:32.526806 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-cce801ab-d573-446f-98a7-0dd9b64e3b88 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:14:32.527255 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-cce801ab-d573-446f-98a7-0dd9b64e3b88 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:14:32.652518 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-cce801ab-d573-446f-98a7-0dd9b64e3b88 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e783caddcad473dbdd764919286e244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecd3d5d2a3a54a07ba64f1fea4846c40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:14:32.660936 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-cce801ab-d573-446f-98a7-0dd9b64e3b88 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] 10.222.0.23 "GET /compute/v2.1/servers/2aa89397-329a-494c-8b4b-fa7e513d3171" status: 200 len: 1362 microversion: 2.1 time: 0.146991 Oct 13 13:14:32.661493 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 317/618] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:14:32 2022] GET /compute/v2.1/servers/2aa89397-329a-494c-8b4b-fa7e513d3171 => generated 1362 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:14:33.483171 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-ab1b2eb5-6109-4f91-97af-f873979c0054 tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Calling method '>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:14:33.483781 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-ab1b2eb5-6109-4f91-97af-f873979c0054 tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] [instance: 59e81a58-9400-4cea-aa38-b24b394e33d7] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:14:33.490172 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-ab1b2eb5-6109-4f91-97af-f873979c0054 tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:14:33.490659 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-ab1b2eb5-6109-4f91-97af-f873979c0054 tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:14:33.491126 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-ab1b2eb5-6109-4f91-97af-f873979c0054 tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:14:33.491818 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-ab1b2eb5-6109-4f91-97af-f873979c0054 tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:14:33.492271 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-ab1b2eb5-6109-4f91-97af-f873979c0054 tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:14:33.492700 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-ab1b2eb5-6109-4f91-97af-f873979c0054 tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:14:33.620045 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-ab1b2eb5-6109-4f91-97af-f873979c0054 tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d89667e52b24295ba619203c02c7bd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed5038c799342d48edc980983f1d996', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:14:33.628222 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-ab1b2eb5-6109-4f91-97af-f873979c0054 tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] 10.222.0.23 "GET /compute/v2.1/servers/59e81a58-9400-4cea-aa38-b24b394e33d7" status: 200 len: 1553 microversion: 2.1 time: 0.148917 Oct 13 13:14:33.628791 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 302/619] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:14:33 2022] GET /compute/v2.1/servers/59e81a58-9400-4cea-aa38-b24b394e33d7 => generated 1553 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:14:33.684225 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-cab48895-7e9b-48f9-adb5-512acf588105 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Calling method '>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:14:33.684833 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-cab48895-7e9b-48f9-adb5-512acf588105 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] [instance: 2aa89397-329a-494c-8b4b-fa7e513d3171] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:14:33.691518 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-cab48895-7e9b-48f9-adb5-512acf588105 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:14:33.692001 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-cab48895-7e9b-48f9-adb5-512acf588105 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:14:33.692435 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-cab48895-7e9b-48f9-adb5-512acf588105 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:14:33.693119 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-cab48895-7e9b-48f9-adb5-512acf588105 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:14:33.693569 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-cab48895-7e9b-48f9-adb5-512acf588105 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:14:33.693993 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-cab48895-7e9b-48f9-adb5-512acf588105 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:14:33.819426 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-cab48895-7e9b-48f9-adb5-512acf588105 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e783caddcad473dbdd764919286e244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecd3d5d2a3a54a07ba64f1fea4846c40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:14:33.822889 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG dbcounter [-] [118814] Writing DB stats nova_cell1:UPDATE=2,nova_cell1:SELECT=96,nova_cell1:INSERT=2 {{(pid=118814) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:14:33.828110 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-cab48895-7e9b-48f9-adb5-512acf588105 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] 10.222.0.23 "GET /compute/v2.1/servers/2aa89397-329a-494c-8b4b-fa7e513d3171" status: 200 len: 1362 microversion: 2.1 time: 0.147939 Oct 13 13:14:33.828659 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 318/620] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:14:33 2022] GET /compute/v2.1/servers/2aa89397-329a-494c-8b4b-fa7e513d3171 => generated 1362 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:14:34.650607 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-4f21e620-a560-4505-b70b-6d8c77624b69 tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Calling method '>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:14:34.651258 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-4f21e620-a560-4505-b70b-6d8c77624b69 tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] [instance: 59e81a58-9400-4cea-aa38-b24b394e33d7] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:14:34.654629 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG dbcounter [-] [118815] Writing DB stats nova_cell0:SELECT=6 {{(pid=118815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:14:34.660055 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-4f21e620-a560-4505-b70b-6d8c77624b69 tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:14:34.660545 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-4f21e620-a560-4505-b70b-6d8c77624b69 tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:14:34.660986 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-4f21e620-a560-4505-b70b-6d8c77624b69 tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:14:34.661679 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-4f21e620-a560-4505-b70b-6d8c77624b69 tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:14:34.662134 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-4f21e620-a560-4505-b70b-6d8c77624b69 tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:14:34.662560 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-4f21e620-a560-4505-b70b-6d8c77624b69 tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:14:34.792504 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-4f21e620-a560-4505-b70b-6d8c77624b69 tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d89667e52b24295ba619203c02c7bd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed5038c799342d48edc980983f1d996', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:14:34.801855 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-4f21e620-a560-4505-b70b-6d8c77624b69 tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] 10.222.0.23 "GET /compute/v2.1/servers/59e81a58-9400-4cea-aa38-b24b394e33d7" status: 200 len: 1553 microversion: 2.1 time: 0.154872 Oct 13 13:14:34.802423 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 303/621] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:14:34 2022] GET /compute/v2.1/servers/59e81a58-9400-4cea-aa38-b24b394e33d7 => generated 1553 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:14:34.850025 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-d36d5f97-78f0-4b64-9adf-45cb00772271 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Calling method '>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:14:34.850635 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-d36d5f97-78f0-4b64-9adf-45cb00772271 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] [instance: 2aa89397-329a-494c-8b4b-fa7e513d3171] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:14:34.852466 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG dbcounter [-] [118814] Writing DB stats nova_cell0:SELECT=2 {{(pid=118814) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:14:34.853120 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG dbcounter [-] [118814] Writing DB stats nova_cell0:SELECT=6 {{(pid=118814) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:14:34.860529 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-d36d5f97-78f0-4b64-9adf-45cb00772271 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:14:34.861014 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-d36d5f97-78f0-4b64-9adf-45cb00772271 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:14:34.861450 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-d36d5f97-78f0-4b64-9adf-45cb00772271 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:14:34.862139 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-d36d5f97-78f0-4b64-9adf-45cb00772271 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:14:34.862592 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-d36d5f97-78f0-4b64-9adf-45cb00772271 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:14:34.863014 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-d36d5f97-78f0-4b64-9adf-45cb00772271 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:14:34.995405 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-d36d5f97-78f0-4b64-9adf-45cb00772271 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e783caddcad473dbdd764919286e244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecd3d5d2a3a54a07ba64f1fea4846c40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:14:35.003678 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-d36d5f97-78f0-4b64-9adf-45cb00772271 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] 10.222.0.23 "GET /compute/v2.1/servers/2aa89397-329a-494c-8b4b-fa7e513d3171" status: 200 len: 1549 microversion: 2.1 time: 0.157832 Oct 13 13:14:35.004243 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 319/622] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:14:34 2022] GET /compute/v2.1/servers/2aa89397-329a-494c-8b4b-fa7e513d3171 => generated 1549 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:14:35.026875 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-e7896fa0-1ca9-483f-b71d-826de4751b86 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Calling method '>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:14:35.027566 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-e7896fa0-1ca9-483f-b71d-826de4751b86 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] [instance: 2aa89397-329a-494c-8b4b-fa7e513d3171] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:14:35.033608 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-e7896fa0-1ca9-483f-b71d-826de4751b86 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:14:35.034161 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-e7896fa0-1ca9-483f-b71d-826de4751b86 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:14:35.034690 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-e7896fa0-1ca9-483f-b71d-826de4751b86 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:14:35.035470 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-e7896fa0-1ca9-483f-b71d-826de4751b86 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:14:35.035995 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-e7896fa0-1ca9-483f-b71d-826de4751b86 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:14:35.036490 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-e7896fa0-1ca9-483f-b71d-826de4751b86 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:14:35.112772 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-e7896fa0-1ca9-483f-b71d-826de4751b86 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] 10.222.0.23 "GET /compute/v2.1/servers/2aa89397-329a-494c-8b4b-fa7e513d3171/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.089742 Oct 13 13:14:35.113371 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 304/623] 10.222.0.23 () {58 vars in 1275 bytes} [Thu Oct 13 13:14:35 2022] GET /compute/v2.1/servers/2aa89397-329a-494c-8b4b-fa7e513d3171/os-interface => generated 285 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 13:14:35.253909 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [req-0234f48a-5312-403e-b4d3-a3d87c324b54 req-f8646e63-6c93-44df-80b6-bf3a4eb3f132 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "59e81a58-9400-4cea-aa38-b24b394e33d7", "name": "network-vif-deleted", "tag": "5e82a763-989b-4ba3-b2d2-7ad17b260a77"}]} {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 13:14:35.265525 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [req-0234f48a-5312-403e-b4d3-a3d87c324b54 req-f8646e63-6c93-44df-80b6-bf3a4eb3f132 service nova] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:14:35.266339 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [req-0234f48a-5312-403e-b4d3-a3d87c324b54 req-f8646e63-6c93-44df-80b6-bf3a4eb3f132 service nova] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:14:35.267424 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [req-0234f48a-5312-403e-b4d3-a3d87c324b54 req-f8646e63-6c93-44df-80b6-bf3a4eb3f132 service nova] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:14:35.278444 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.compute.server_external_events [req-0234f48a-5312-403e-b4d3-a3d87c324b54 req-f8646e63-6c93-44df-80b6-bf3a4eb3f132 service nova] Creating event network-vif-deleted:5e82a763-989b-4ba3-b2d2-7ad17b260a77 for instance 59e81a58-9400-4cea-aa38-b24b394e33d7 on hv-cinder-82660 Oct 13 13:14:35.285746 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [req-0234f48a-5312-403e-b4d3-a3d87c324b54 req-f8646e63-6c93-44df-80b6-bf3a4eb3f132 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035765 Oct 13 13:14:35.286917 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 320/624] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 13:14:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 13:14:35.824662 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-5b6a9325-5f6c-4393-8a6e-2cb649db0d29 tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Calling method '>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:14:35.825257 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-5b6a9325-5f6c-4393-8a6e-2cb649db0d29 tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] [instance: 59e81a58-9400-4cea-aa38-b24b394e33d7] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:14:35.832417 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-5b6a9325-5f6c-4393-8a6e-2cb649db0d29 tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:14:35.832911 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-5b6a9325-5f6c-4393-8a6e-2cb649db0d29 tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:14:35.833351 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-5b6a9325-5f6c-4393-8a6e-2cb649db0d29 tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:14:35.834064 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-5b6a9325-5f6c-4393-8a6e-2cb649db0d29 tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:14:35.834518 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-5b6a9325-5f6c-4393-8a6e-2cb649db0d29 tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:14:35.834952 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-5b6a9325-5f6c-4393-8a6e-2cb649db0d29 tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:14:35.878471 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-5b6a9325-5f6c-4393-8a6e-2cb649db0d29 tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:14:35.879145 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-5b6a9325-5f6c-4393-8a6e-2cb649db0d29 tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:14:35.879594 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-5b6a9325-5f6c-4393-8a6e-2cb649db0d29 tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:14:35.880057 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.objects.instance [None req-5b6a9325-5f6c-4393-8a6e-2cb649db0d29 tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Lazy-loading 'fault' on Instance uuid 59e81a58-9400-4cea-aa38-b24b394e33d7 {{(pid=118815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 13 13:14:36.025430 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-5b6a9325-5f6c-4393-8a6e-2cb649db0d29 tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d89667e52b24295ba619203c02c7bd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed5038c799342d48edc980983f1d996', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:14:36.032509 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-5b6a9325-5f6c-4393-8a6e-2cb649db0d29 tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] 10.222.0.23 "GET /compute/v2.1/servers/59e81a58-9400-4cea-aa38-b24b394e33d7" status: 200 len: 1347 microversion: 2.1 time: 0.211650 Oct 13 13:14:36.033079 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 305/625] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:14:35 2022] GET /compute/v2.1/servers/59e81a58-9400-4cea-aa38-b24b394e33d7 => generated 1347 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:14:36.331903 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [req-d1565698-79d5-4ea8-b26b-93742bcb795a req-ad014811-2aec-4bf5-bf5e-0b45b3275a11 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2aa89397-329a-494c-8b4b-fa7e513d3171", "tag": "c2c3f2c7-45cd-4ffe-85fe-fc2012972cc8"}]} {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 13:14:36.341859 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [req-d1565698-79d5-4ea8-b26b-93742bcb795a req-ad014811-2aec-4bf5-bf5e-0b45b3275a11 service nova] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:14:36.342340 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [req-d1565698-79d5-4ea8-b26b-93742bcb795a req-ad014811-2aec-4bf5-bf5e-0b45b3275a11 service nova] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:14:36.342769 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [req-d1565698-79d5-4ea8-b26b-93742bcb795a req-ad014811-2aec-4bf5-bf5e-0b45b3275a11 service nova] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:14:36.353285 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.compute.server_external_events [req-d1565698-79d5-4ea8-b26b-93742bcb795a req-ad014811-2aec-4bf5-bf5e-0b45b3275a11 service nova] Creating event network-changed:c2c3f2c7-45cd-4ffe-85fe-fc2012972cc8 for instance 2aa89397-329a-494c-8b4b-fa7e513d3171 on hv-cinder-82660 Oct 13 13:14:36.358747 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [req-d1565698-79d5-4ea8-b26b-93742bcb795a req-ad014811-2aec-4bf5-bf5e-0b45b3275a11 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030171 Oct 13 13:14:36.359374 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 321/626] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 13:14:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 13:14:37.055227 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-6c5835e5-a57d-4902-8ebb-15de513a9cc5 tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Calling method '>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:14:37.055976 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-6c5835e5-a57d-4902-8ebb-15de513a9cc5 tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] [instance: 59e81a58-9400-4cea-aa38-b24b394e33d7] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:14:37.062247 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-6c5835e5-a57d-4902-8ebb-15de513a9cc5 tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:14:37.062731 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-6c5835e5-a57d-4902-8ebb-15de513a9cc5 tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:14:37.063206 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-6c5835e5-a57d-4902-8ebb-15de513a9cc5 tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:14:37.063902 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-6c5835e5-a57d-4902-8ebb-15de513a9cc5 tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:14:37.064363 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-6c5835e5-a57d-4902-8ebb-15de513a9cc5 tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:14:37.064787 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-6c5835e5-a57d-4902-8ebb-15de513a9cc5 tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:14:37.078477 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.wsgi [None req-6c5835e5-a57d-4902-8ebb-15de513a9cc5 tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] HTTP exception thrown: Instance 59e81a58-9400-4cea-aa38-b24b394e33d7 could not be found. Oct 13 13:14:37.080138 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-6c5835e5-a57d-4902-8ebb-15de513a9cc5 tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Request method failure captured: Oct 13 13:14:37.080138 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: request: GET /compute/v2.1/servers/59e81a58-9400-4cea-aa38-b24b394e33d7 HTTP/1.1 Oct 13 13:14:37.080138 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: Accept: application/json Oct 13 13:14:37.080138 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: Accept-Encoding: identity Oct 13 13:14:37.080138 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: Connection: close Oct 13 13:14:37.080138 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: Content-Length: 0 Oct 13 13:14:37.080138 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: Content-Type: application/json Oct 13 13:14:37.080138 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: Host: 10.222.0.23 Oct 13 13:14:37.080138 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: Openstack-System-Scope: None Oct 13 13:14:37.080138 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: User-Agent: python-urllib3/1.26.12 Oct 13 13:14:37.080138 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Auth-Token: gAAAAABjSA6YzzwKnsiw5C4YwB7d1iykFt7gUG5rL-k-8VmRKCkSryi3JvIochgftCQGgPbOoN2OVeUh3m9xKE3lONjNldXpMZT_PzUeJWKMmASvaanv4XYPLy_Ux1eMWxdR32kuv9dEm6uFo6viWqq-MAA3_95iI_HpWk2kE_bb5TRe55tqg9A Oct 13 13:14:37.080138 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Domain-Id: None Oct 13 13:14:37.080138 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Domain-Name: None Oct 13 13:14:37.080138 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Identity-Status: Confirmed Oct 13 13:14:37.080138 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Is-Admin-Project: True Oct 13 13:14:37.080138 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Project-Domain-Id: default Oct 13 13:14:37.080138 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Project-Domain-Name: Default Oct 13 13:14:37.080138 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Project-Id: 3ed5038c799342d48edc980983f1d996 Oct 13 13:14:37.080138 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Project-Name: tempest-TestMinimumBasicScenario-366179387 Oct 13 13:14:37.080138 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Role: reader,member Oct 13 13:14:37.080138 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Roles: reader,member Oct 13 13:14:37.081642 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_3ed5038c799342d48edc980983f1d996"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/3ed5038c799342d48edc980983f1d996"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/3ed5038c799342d48edc980983f1d996"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/3ed5038c799342d48edc980983f1d996"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}] Oct 13 13:14:37.081642 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Tenant: tempest-TestMinimumBasicScenario-366179387 Oct 13 13:14:37.081642 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Tenant-Id: 3ed5038c799342d48edc980983f1d996 Oct 13 13:14:37.081642 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Tenant-Name: tempest-TestMinimumBasicScenario-366179387 Oct 13 13:14:37.081642 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-User: tempest-TestMinimumBasicScenario-366179387-project Oct 13 13:14:37.081642 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-User-Domain-Id: default Oct 13 13:14:37.081642 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-User-Domain-Name: Default Oct 13 13:14:37.081642 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-User-Id: 7d89667e52b24295ba619203c02c7bd4 Oct 13 13:14:37.081642 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-User-Name: tempest-TestMinimumBasicScenario-366179387-project Oct 13 13:14:37.081642 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: method: > Oct 13 13:14:37.081642 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: exception: Instance 59e81a58-9400-4cea-aa38-b24b394e33d7 could not be found. Oct 13 13:14:37.081642 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: action_args: {'id': '59e81a58-9400-4cea-aa38-b24b394e33d7'} Oct 13 13:14:37.082532 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 13:14:37.082532 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 13:14:37.082532 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 13 13:14:37.082532 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 13 13:14:37.082532 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 13 13:14:37.082532 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 13 13:14:37.082532 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 13 13:14:37.082532 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 13 13:14:37.082532 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 13 13:14:37.082532 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 13 13:14:37.082532 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 59e81a58-9400-4cea-aa38-b24b394e33d7 could not be found. Oct 13 13:14:37.082532 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi Oct 13 13:14:37.082532 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 13:14:37.082532 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi Oct 13 13:14:37.082532 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 13:14:37.082532 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 13:14:37.082532 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 13:14:37.082532 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 13:14:37.082532 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 13:14:37.082532 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 13:14:37.085099 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 13:14:37.085099 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 13 13:14:37.085099 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 13 13:14:37.085099 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 13 13:14:37.085099 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 13 13:14:37.085099 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 13 13:14:37.085099 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 13 13:14:37.085099 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 59e81a58-9400-4cea-aa38-b24b394e33d7 could not be found. Oct 13 13:14:37.085099 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi Oct 13 13:14:37.085099 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 13:14:37.085099 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi Oct 13 13:14:37.085099 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 13:14:37.085099 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 13:14:37.085099 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 13:14:37.085099 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 13:14:37.085099 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 13:14:37.085099 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 59e81a58-9400-4cea-aa38-b24b394e33d7 could not be found. Oct 13 13:14:37.085099 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi Oct 13 13:14:37.086441 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-6c5835e5-a57d-4902-8ebb-15de513a9cc5 tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Returning 404 to user: Instance 59e81a58-9400-4cea-aa38-b24b394e33d7 could not be found. {{(pid=118815) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 13:14:37.086441 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-6c5835e5-a57d-4902-8ebb-15de513a9cc5 tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] 10.222.0.23 "GET /compute/v2.1/servers/59e81a58-9400-4cea-aa38-b24b394e33d7" status: 404 len: 111 microversion: 2.1 time: 0.030216 Oct 13 13:14:37.086441 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 306/627] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:14:37 2022] GET /compute/v2.1/servers/59e81a58-9400-4cea-aa38-b24b394e33d7 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 13 13:14:37.090937 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-4ad51130-f7f5-43a9-b403-ca4f16ca7889 tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] Calling method '.version_select at 0x7f5093d96b80>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:14:37.111946 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-4ad51130-f7f5-43a9-b403-ca4f16ca7889 tempest-TestMinimumBasicScenario-366179387 tempest-TestMinimumBasicScenario-366179387-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-80445656" status: 202 len: 0 microversion: 2.1 time: 0.025046 Oct 13 13:14:37.112518 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 322/628] 10.222.0.23 () {58 vars in 1266 bytes} [Thu Oct 13 13:14:37 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-80445656 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 13 13:14:43.040760 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-01aa1b7e-b3ab-4b63-b863-a54859976676 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Calling method '>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:14:43.041251 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-01aa1b7e-b3ab-4b63-b863-a54859976676 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] [instance: b4ba0fd3-eb17-4e05-acaa-5570c1e364d7] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:14:43.050260 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-01aa1b7e-b3ab-4b63-b863-a54859976676 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:14:43.050756 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-01aa1b7e-b3ab-4b63-b863-a54859976676 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:14:43.051240 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-01aa1b7e-b3ab-4b63-b863-a54859976676 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:14:43.051952 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-01aa1b7e-b3ab-4b63-b863-a54859976676 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:14:43.052412 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-01aa1b7e-b3ab-4b63-b863-a54859976676 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:14:43.052852 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-01aa1b7e-b3ab-4b63-b863-a54859976676 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:14:43.161132 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.objects.instance [None req-01aa1b7e-b3ab-4b63-b863-a54859976676 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lazy-loading 'services' on Instance uuid b4ba0fd3-eb17-4e05-acaa-5570c1e364d7 {{(pid=118815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 13 13:14:43.251963 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-01aa1b7e-b3ab-4b63-b863-a54859976676 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] 10.222.0.23 "DELETE /compute/v2.1/servers/b4ba0fd3-eb17-4e05-acaa-5570c1e364d7/os-volume_attachments/515371e1-4f2e-44c4-b36f-ac2cfdfced9b" status: 202 len: 0 microversion: 2.1 time: 0.215148 Oct 13 13:14:43.252577 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 307/629] 10.222.0.23 () {58 vars in 1416 bytes} [Thu Oct 13 13:14:43 2022] DELETE /compute/v2.1/servers/b4ba0fd3-eb17-4e05-acaa-5570c1e364d7/os-volume_attachments/515371e1-4f2e-44c4-b36f-ac2cfdfced9b => generated 0 bytes in 217 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 13 13:14:43.261892 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-c285bc05-18ac-4e9c-bce4-1964a54c2771 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Calling method '>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:14:43.265092 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-c285bc05-18ac-4e9c-bce4-1964a54c2771 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] [instance: b4ba0fd3-eb17-4e05-acaa-5570c1e364d7] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:14:43.268024 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG dbcounter [-] [118814] Writing DB stats nova_api:SELECT=78,nova_api:UPDATE=2,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=118814) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:14:43.274405 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-c285bc05-18ac-4e9c-bce4-1964a54c2771 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:14:43.275216 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-c285bc05-18ac-4e9c-bce4-1964a54c2771 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:14:43.275862 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-c285bc05-18ac-4e9c-bce4-1964a54c2771 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:14:43.276700 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-c285bc05-18ac-4e9c-bce4-1964a54c2771 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:14:43.277005 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-c285bc05-18ac-4e9c-bce4-1964a54c2771 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:14:43.277425 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-c285bc05-18ac-4e9c-bce4-1964a54c2771 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:14:43.319698 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-c285bc05-18ac-4e9c-bce4-1964a54c2771 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] 10.222.0.23 "GET /compute/v2.1/servers/b4ba0fd3-eb17-4e05-acaa-5570c1e364d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059467 Oct 13 13:14:43.319698 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 323/630] 10.222.0.23 () {58 vars in 1302 bytes} [Thu Oct 13 13:14:43 2022] GET /compute/v2.1/servers/b4ba0fd3-eb17-4e05-acaa-5570c1e364d7/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 13:14:44.330976 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-d2451625-6ae3-4428-bf76-d4eba0c5d33a tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Calling method '>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:14:44.333328 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-d2451625-6ae3-4428-bf76-d4eba0c5d33a tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] [instance: b4ba0fd3-eb17-4e05-acaa-5570c1e364d7] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:14:44.339370 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-d2451625-6ae3-4428-bf76-d4eba0c5d33a tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:14:44.339893 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-d2451625-6ae3-4428-bf76-d4eba0c5d33a tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:14:44.340286 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-d2451625-6ae3-4428-bf76-d4eba0c5d33a tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:14:44.341020 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-d2451625-6ae3-4428-bf76-d4eba0c5d33a tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:14:44.341407 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-d2451625-6ae3-4428-bf76-d4eba0c5d33a tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:14:44.341831 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-d2451625-6ae3-4428-bf76-d4eba0c5d33a tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:14:44.371255 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-d2451625-6ae3-4428-bf76-d4eba0c5d33a tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] 10.222.0.23 "GET /compute/v2.1/servers/b4ba0fd3-eb17-4e05-acaa-5570c1e364d7/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045618 Oct 13 13:14:44.375212 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 308/631] 10.222.0.23 () {58 vars in 1302 bytes} [Thu Oct 13 13:14:44 2022] GET /compute/v2.1/servers/b4ba0fd3-eb17-4e05-acaa-5570c1e364d7/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 13 13:14:44.450872 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-7d99510b-17a4-46fa-ae79-f4c3739747bf tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Calling method '>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:14:44.451446 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-7d99510b-17a4-46fa-ae79-f4c3739747bf tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] [instance: b4ba0fd3-eb17-4e05-acaa-5570c1e364d7] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:14:44.458056 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-7d99510b-17a4-46fa-ae79-f4c3739747bf tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:14:44.458614 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-7d99510b-17a4-46fa-ae79-f4c3739747bf tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:14:44.459101 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-7d99510b-17a4-46fa-ae79-f4c3739747bf tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:14:44.459791 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-7d99510b-17a4-46fa-ae79-f4c3739747bf tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:14:44.460244 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-7d99510b-17a4-46fa-ae79-f4c3739747bf tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:14:44.460665 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-7d99510b-17a4-46fa-ae79-f4c3739747bf tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:14:44.486394 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-7d99510b-17a4-46fa-ae79-f4c3739747bf tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] [instance: b4ba0fd3-eb17-4e05-acaa-5570c1e364d7] Going to try to terminate instance {{(pid=118814) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 13 13:14:44.568310 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-7d99510b-17a4-46fa-ae79-f4c3739747bf tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] 10.222.0.23 "DELETE /compute/v2.1/servers/b4ba0fd3-eb17-4e05-acaa-5570c1e364d7" status: 204 len: 0 microversion: 2.1 time: 0.120886 Oct 13 13:14:44.568961 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 324/632] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Oct 13 13:14:44 2022] DELETE /compute/v2.1/servers/b4ba0fd3-eb17-4e05-acaa-5570c1e364d7 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 13 13:14:44.577597 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-f09b99eb-6a2b-48f0-9efb-f5bc991fb35d tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Calling method '>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:14:44.578426 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-f09b99eb-6a2b-48f0-9efb-f5bc991fb35d tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] [instance: b4ba0fd3-eb17-4e05-acaa-5570c1e364d7] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:14:44.584628 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-f09b99eb-6a2b-48f0-9efb-f5bc991fb35d tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:14:44.585115 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-f09b99eb-6a2b-48f0-9efb-f5bc991fb35d tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:14:44.585562 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-f09b99eb-6a2b-48f0-9efb-f5bc991fb35d tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:14:44.586258 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-f09b99eb-6a2b-48f0-9efb-f5bc991fb35d tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:14:44.586714 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-f09b99eb-6a2b-48f0-9efb-f5bc991fb35d tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:14:44.587191 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-f09b99eb-6a2b-48f0-9efb-f5bc991fb35d tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:14:44.942173 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-f09b99eb-6a2b-48f0-9efb-f5bc991fb35d tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '454203f47b434cca952a1cef56de559f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7312d0ac9248f2bfbece5611913ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:14:44.950225 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-f09b99eb-6a2b-48f0-9efb-f5bc991fb35d tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] 10.222.0.23 "GET /compute/v2.1/servers/b4ba0fd3-eb17-4e05-acaa-5570c1e364d7" status: 200 len: 1691 microversion: 2.1 time: 0.376650 Oct 13 13:14:44.963271 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 309/633] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:14:44 2022] GET /compute/v2.1/servers/b4ba0fd3-eb17-4e05-acaa-5570c1e364d7 => generated 1691 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:14:45.974223 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-41588967-c5fc-4be2-beb4-479f8f81283a tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Calling method '>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:14:45.974914 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-41588967-c5fc-4be2-beb4-479f8f81283a tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] [instance: b4ba0fd3-eb17-4e05-acaa-5570c1e364d7] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:14:45.981411 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-41588967-c5fc-4be2-beb4-479f8f81283a tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:14:45.981888 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-41588967-c5fc-4be2-beb4-479f8f81283a tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:14:45.982316 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-41588967-c5fc-4be2-beb4-479f8f81283a tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:14:45.983538 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-41588967-c5fc-4be2-beb4-479f8f81283a tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:14:45.983982 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-41588967-c5fc-4be2-beb4-479f8f81283a tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:14:45.984416 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-41588967-c5fc-4be2-beb4-479f8f81283a tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:14:46.270274 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-41588967-c5fc-4be2-beb4-479f8f81283a tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '454203f47b434cca952a1cef56de559f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7312d0ac9248f2bfbece5611913ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:14:46.278775 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-41588967-c5fc-4be2-beb4-479f8f81283a tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] 10.222.0.23 "GET /compute/v2.1/servers/b4ba0fd3-eb17-4e05-acaa-5570c1e364d7" status: 200 len: 1691 microversion: 2.1 time: 0.308779 Oct 13 13:14:46.280230 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 325/634] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:14:45 2022] GET /compute/v2.1/servers/b4ba0fd3-eb17-4e05-acaa-5570c1e364d7 => generated 1691 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:14:47.304134 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-503c1167-2112-4d59-ae17-8ad158984846 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Calling method '>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:14:47.304748 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-503c1167-2112-4d59-ae17-8ad158984846 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] [instance: b4ba0fd3-eb17-4e05-acaa-5570c1e364d7] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:14:47.306803 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG dbcounter [-] [118815] Writing DB stats nova_api:SELECT=68,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=118815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:14:47.312866 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-503c1167-2112-4d59-ae17-8ad158984846 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:14:47.313359 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-503c1167-2112-4d59-ae17-8ad158984846 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:14:47.313804 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-503c1167-2112-4d59-ae17-8ad158984846 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:14:47.314515 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-503c1167-2112-4d59-ae17-8ad158984846 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:14:47.314984 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-503c1167-2112-4d59-ae17-8ad158984846 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:14:47.315574 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-503c1167-2112-4d59-ae17-8ad158984846 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:14:47.333191 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG dbcounter [-] [118815] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=2 {{(pid=118815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:14:47.456852 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-503c1167-2112-4d59-ae17-8ad158984846 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '454203f47b434cca952a1cef56de559f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7312d0ac9248f2bfbece5611913ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:14:47.464835 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-503c1167-2112-4d59-ae17-8ad158984846 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] 10.222.0.23 "GET /compute/v2.1/servers/b4ba0fd3-eb17-4e05-acaa-5570c1e364d7" status: 200 len: 1691 microversion: 2.1 time: 0.165016 Oct 13 13:14:47.465480 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 310/635] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:14:47 2022] GET /compute/v2.1/servers/b4ba0fd3-eb17-4e05-acaa-5570c1e364d7 => generated 1691 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:14:48.487569 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-b917b0d0-9ce5-4f05-b739-131b1767194e tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Calling method '>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:14:48.488075 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-b917b0d0-9ce5-4f05-b739-131b1767194e tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] [instance: b4ba0fd3-eb17-4e05-acaa-5570c1e364d7] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:14:48.494475 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-b917b0d0-9ce5-4f05-b739-131b1767194e tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:14:48.494963 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-b917b0d0-9ce5-4f05-b739-131b1767194e tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:14:48.495576 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-b917b0d0-9ce5-4f05-b739-131b1767194e tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:14:48.496272 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-b917b0d0-9ce5-4f05-b739-131b1767194e tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:14:48.496902 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-b917b0d0-9ce5-4f05-b739-131b1767194e tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:14:48.497330 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-b917b0d0-9ce5-4f05-b739-131b1767194e tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:14:48.632358 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-b917b0d0-9ce5-4f05-b739-131b1767194e tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '454203f47b434cca952a1cef56de559f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7312d0ac9248f2bfbece5611913ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:14:48.641718 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-b917b0d0-9ce5-4f05-b739-131b1767194e tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] 10.222.0.23 "GET /compute/v2.1/servers/b4ba0fd3-eb17-4e05-acaa-5570c1e364d7" status: 200 len: 1691 microversion: 2.1 time: 0.158123 Oct 13 13:14:48.642536 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 326/636] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:14:48 2022] GET /compute/v2.1/servers/b4ba0fd3-eb17-4e05-acaa-5570c1e364d7 => generated 1691 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:14:49.666331 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-d34d6e81-6214-42b4-b67d-09bb139c7778 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Calling method '>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:14:49.666930 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-d34d6e81-6214-42b4-b67d-09bb139c7778 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] [instance: b4ba0fd3-eb17-4e05-acaa-5570c1e364d7] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:14:49.679155 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-d34d6e81-6214-42b4-b67d-09bb139c7778 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:14:49.684561 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-d34d6e81-6214-42b4-b67d-09bb139c7778 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:14:49.685014 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-d34d6e81-6214-42b4-b67d-09bb139c7778 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:14:49.685815 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-d34d6e81-6214-42b4-b67d-09bb139c7778 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:14:49.686269 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-d34d6e81-6214-42b4-b67d-09bb139c7778 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:14:49.686692 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-d34d6e81-6214-42b4-b67d-09bb139c7778 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:14:49.766014 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [req-9a0898c5-33f3-48c1-8281-555cd2850dfd req-e74bc57a-7261-4e97-b2dd-759d4859c43d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b4ba0fd3-eb17-4e05-acaa-5570c1e364d7", "name": "network-vif-deleted", "tag": "feb1b7b8-f5e8-4310-8e6d-7eb1841b5c04"}]} {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 13:14:49.777087 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-d34d6e81-6214-42b4-b67d-09bb139c7778 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '454203f47b434cca952a1cef56de559f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7312d0ac9248f2bfbece5611913ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:14:49.790016 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [req-9a0898c5-33f3-48c1-8281-555cd2850dfd req-e74bc57a-7261-4e97-b2dd-759d4859c43d service nova] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:14:49.791626 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [req-9a0898c5-33f3-48c1-8281-555cd2850dfd req-e74bc57a-7261-4e97-b2dd-759d4859c43d service nova] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:14:49.791747 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-d34d6e81-6214-42b4-b67d-09bb139c7778 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] 10.222.0.23 "GET /compute/v2.1/servers/b4ba0fd3-eb17-4e05-acaa-5570c1e364d7" status: 200 len: 1623 microversion: 2.1 time: 0.129299 Oct 13 13:14:49.792246 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [req-9a0898c5-33f3-48c1-8281-555cd2850dfd req-e74bc57a-7261-4e97-b2dd-759d4859c43d service nova] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:14:49.794857 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 311/637] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:14:49 2022] GET /compute/v2.1/servers/b4ba0fd3-eb17-4e05-acaa-5570c1e364d7 => generated 1623 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:14:49.835534 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.compute.server_external_events [req-9a0898c5-33f3-48c1-8281-555cd2850dfd req-e74bc57a-7261-4e97-b2dd-759d4859c43d service nova] Creating event network-vif-deleted:feb1b7b8-f5e8-4310-8e6d-7eb1841b5c04 for instance b4ba0fd3-eb17-4e05-acaa-5570c1e364d7 on hv-cinder-82660 Oct 13 13:14:49.842341 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [req-9a0898c5-33f3-48c1-8281-555cd2850dfd req-e74bc57a-7261-4e97-b2dd-759d4859c43d service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081761 Oct 13 13:14:49.843253 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 327/638] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 13:14:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 13 13:14:50.818049 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-9bf6f49a-347e-44f7-8ceb-e197bcb58622 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Calling method '>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:14:50.818794 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-9bf6f49a-347e-44f7-8ceb-e197bcb58622 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] [instance: b4ba0fd3-eb17-4e05-acaa-5570c1e364d7] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:14:50.826734 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-9bf6f49a-347e-44f7-8ceb-e197bcb58622 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:14:50.827604 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-9bf6f49a-347e-44f7-8ceb-e197bcb58622 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:14:50.828118 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-9bf6f49a-347e-44f7-8ceb-e197bcb58622 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:14:50.828898 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-9bf6f49a-347e-44f7-8ceb-e197bcb58622 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:14:50.829584 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-9bf6f49a-347e-44f7-8ceb-e197bcb58622 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:14:50.830320 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-9bf6f49a-347e-44f7-8ceb-e197bcb58622 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:14:50.844679 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.wsgi [None req-9bf6f49a-347e-44f7-8ceb-e197bcb58622 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] HTTP exception thrown: Instance b4ba0fd3-eb17-4e05-acaa-5570c1e364d7 could not be found. Oct 13 13:14:50.846337 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-9bf6f49a-347e-44f7-8ceb-e197bcb58622 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Request method failure captured: Oct 13 13:14:50.846337 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: request: GET /compute/v2.1/servers/b4ba0fd3-eb17-4e05-acaa-5570c1e364d7 HTTP/1.1 Oct 13 13:14:50.846337 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: Accept: application/json Oct 13 13:14:50.846337 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: Accept-Encoding: identity Oct 13 13:14:50.846337 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: Connection: close Oct 13 13:14:50.846337 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: Content-Length: 0 Oct 13 13:14:50.846337 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: Content-Type: application/json Oct 13 13:14:50.846337 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: Host: 10.222.0.23 Oct 13 13:14:50.846337 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: Openstack-System-Scope: None Oct 13 13:14:50.846337 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: User-Agent: python-urllib3/1.26.12 Oct 13 13:14:50.846337 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Auth-Token: gAAAAABjSA4svM9mETgfaOiuUXJIEReF5lLu9fPZCd8DzHzDMjsgoKCuGBBfmSl0ftubwAnibGB2dnB8E_e8xQKe1PCHs7Ng4fH6y7rFwijiKdlg3jwpLv7Ts_hAoMDCd_X3SSeHFWudl61mtpIoaIAJsH8UQKtB4J3uZqOXyPx22DWeiRT4uVg Oct 13 13:14:50.846337 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Domain-Id: None Oct 13 13:14:50.846337 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Domain-Name: None Oct 13 13:14:50.846337 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Identity-Status: Confirmed Oct 13 13:14:50.846337 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Is-Admin-Project: True Oct 13 13:14:50.846337 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Project-Domain-Id: default Oct 13 13:14:50.846337 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Project-Domain-Name: Default Oct 13 13:14:50.846337 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Project-Id: 5e7312d0ac9248f2bfbece5611913ab2 Oct 13 13:14:50.846337 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-633823286 Oct 13 13:14:50.846337 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Role: reader,member Oct 13 13:14:50.846337 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Roles: reader,member Oct 13 13:14:50.847816 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_5e7312d0ac9248f2bfbece5611913ab2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/5e7312d0ac9248f2bfbece5611913ab2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/5e7312d0ac9248f2bfbece5611913ab2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/5e7312d0ac9248f2bfbece5611913ab2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}] Oct 13 13:14:50.847816 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Tenant: tempest-ServerRescueNegativeTestJSON-633823286 Oct 13 13:14:50.847816 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Tenant-Id: 5e7312d0ac9248f2bfbece5611913ab2 Oct 13 13:14:50.847816 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-633823286 Oct 13 13:14:50.847816 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-User: tempest-ServerRescueNegativeTestJSON-633823286-project Oct 13 13:14:50.847816 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-User-Domain-Id: default Oct 13 13:14:50.847816 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-User-Domain-Name: Default Oct 13 13:14:50.847816 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-User-Id: 454203f47b434cca952a1cef56de559f Oct 13 13:14:50.847816 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-User-Name: tempest-ServerRescueNegativeTestJSON-633823286-project Oct 13 13:14:50.847816 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: method: > Oct 13 13:14:50.847816 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: exception: Instance b4ba0fd3-eb17-4e05-acaa-5570c1e364d7 could not be found. Oct 13 13:14:50.847816 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: action_args: {'id': 'b4ba0fd3-eb17-4e05-acaa-5570c1e364d7'} Oct 13 13:14:50.848536 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 13:14:50.848536 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 13:14:50.848536 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 13 13:14:50.848536 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 13 13:14:50.848536 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 13 13:14:50.848536 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 13 13:14:50.848536 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 13 13:14:50.848536 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 13 13:14:50.848536 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 13 13:14:50.848536 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 13 13:14:50.848536 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b4ba0fd3-eb17-4e05-acaa-5570c1e364d7 could not be found. Oct 13 13:14:50.848536 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi Oct 13 13:14:50.848536 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 13:14:50.848536 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi Oct 13 13:14:50.848536 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 13:14:50.848536 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 13:14:50.848536 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 13:14:50.848536 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 13:14:50.848536 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 13:14:50.848536 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 13:14:50.849674 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 13:14:50.849674 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 13 13:14:50.849674 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 13 13:14:50.849674 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 13 13:14:50.849674 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 13 13:14:50.849674 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 13 13:14:50.849674 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 13 13:14:50.849674 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b4ba0fd3-eb17-4e05-acaa-5570c1e364d7 could not be found. Oct 13 13:14:50.849674 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi Oct 13 13:14:50.849674 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 13:14:50.849674 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi Oct 13 13:14:50.849674 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 13:14:50.849674 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 13:14:50.849674 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 13:14:50.849674 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 13:14:50.849674 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 13:14:50.849674 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b4ba0fd3-eb17-4e05-acaa-5570c1e364d7 could not be found. Oct 13 13:14:50.849674 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi Oct 13 13:14:50.850799 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-9bf6f49a-347e-44f7-8ceb-e197bcb58622 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Returning 404 to user: Instance b4ba0fd3-eb17-4e05-acaa-5570c1e364d7 could not be found. {{(pid=118815) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 13:14:50.850799 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-9bf6f49a-347e-44f7-8ceb-e197bcb58622 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] 10.222.0.23 "GET /compute/v2.1/servers/b4ba0fd3-eb17-4e05-acaa-5570c1e364d7" status: 404 len: 111 microversion: 2.1 time: 0.033987 Oct 13 13:14:50.850799 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 312/639] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:14:50 2022] GET /compute/v2.1/servers/b4ba0fd3-eb17-4e05-acaa-5570c1e364d7 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 13 13:14:50.857437 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-b68f981f-7705-4f3c-b407-87083f3a2119 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Calling method '.version_select at 0x7f5093d695e0>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:14:50.877832 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-b68f981f-7705-4f3c-b407-87083f3a2119 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-352459096" status: 202 len: 0 microversion: 2.1 time: 0.024436 Oct 13 13:14:50.878360 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 328/640] 10.222.0.23 () {58 vars in 1218 bytes} [Thu Oct 13 13:14:50 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-352459096 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 13 13:14:54.061119 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-bd4247b3-3ba1-4fba-870a-5c2f73ae1170 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Calling method '>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:14:54.062433 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-bd4247b3-3ba1-4fba-870a-5c2f73ae1170 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] [instance: 96c829cb-4dde-467c-b50f-b2f666bdab0b] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:14:54.070387 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-bd4247b3-3ba1-4fba-870a-5c2f73ae1170 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:14:54.071172 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-bd4247b3-3ba1-4fba-870a-5c2f73ae1170 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:14:54.071950 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-bd4247b3-3ba1-4fba-870a-5c2f73ae1170 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:14:54.073026 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-bd4247b3-3ba1-4fba-870a-5c2f73ae1170 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:14:54.073653 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-bd4247b3-3ba1-4fba-870a-5c2f73ae1170 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:14:54.074241 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-bd4247b3-3ba1-4fba-870a-5c2f73ae1170 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:14:54.103414 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-bd4247b3-3ba1-4fba-870a-5c2f73ae1170 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] [instance: 96c829cb-4dde-467c-b50f-b2f666bdab0b] Going to try to terminate instance {{(pid=118815) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 13 13:14:54.255360 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-bd4247b3-3ba1-4fba-870a-5c2f73ae1170 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] 10.222.0.23 "DELETE /compute/v2.1/servers/96c829cb-4dde-467c-b50f-b2f666bdab0b" status: 204 len: 0 microversion: 2.1 time: 0.197793 Oct 13 13:14:54.256701 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 313/641] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Oct 13 13:14:54 2022] DELETE /compute/v2.1/servers/96c829cb-4dde-467c-b50f-b2f666bdab0b => generated 0 bytes in 200 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 13 13:14:54.270154 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-8b62f2ce-11d4-4f40-a5cb-d8898c6795d1 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Calling method '>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:14:54.275109 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-8b62f2ce-11d4-4f40-a5cb-d8898c6795d1 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] [instance: 96c829cb-4dde-467c-b50f-b2f666bdab0b] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:14:54.284758 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-8b62f2ce-11d4-4f40-a5cb-d8898c6795d1 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:14:54.289685 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-8b62f2ce-11d4-4f40-a5cb-d8898c6795d1 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:14:54.292773 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-8b62f2ce-11d4-4f40-a5cb-d8898c6795d1 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:14:54.293553 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-8b62f2ce-11d4-4f40-a5cb-d8898c6795d1 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:14:54.294037 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-8b62f2ce-11d4-4f40-a5cb-d8898c6795d1 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:14:54.294580 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-8b62f2ce-11d4-4f40-a5cb-d8898c6795d1 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:14:54.544062 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-8b62f2ce-11d4-4f40-a5cb-d8898c6795d1 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '454203f47b434cca952a1cef56de559f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7312d0ac9248f2bfbece5611913ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:14:54.552409 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-8b62f2ce-11d4-4f40-a5cb-d8898c6795d1 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] 10.222.0.23 "GET /compute/v2.1/servers/96c829cb-4dde-467c-b50f-b2f666bdab0b" status: 200 len: 1508 microversion: 2.1 time: 0.289755 Oct 13 13:14:54.557145 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 329/642] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:14:54 2022] GET /compute/v2.1/servers/96c829cb-4dde-467c-b50f-b2f666bdab0b => generated 1508 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:14:55.585049 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-37f47157-3ab4-49c7-914b-e18b3d5fe1a8 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Calling method '>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:14:55.585945 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-37f47157-3ab4-49c7-914b-e18b3d5fe1a8 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] [instance: 96c829cb-4dde-467c-b50f-b2f666bdab0b] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:14:55.593335 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-37f47157-3ab4-49c7-914b-e18b3d5fe1a8 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:14:55.593827 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-37f47157-3ab4-49c7-914b-e18b3d5fe1a8 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:14:55.594265 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-37f47157-3ab4-49c7-914b-e18b3d5fe1a8 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:14:55.595193 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-37f47157-3ab4-49c7-914b-e18b3d5fe1a8 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:14:55.595957 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-37f47157-3ab4-49c7-914b-e18b3d5fe1a8 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:14:55.596603 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-37f47157-3ab4-49c7-914b-e18b3d5fe1a8 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:14:55.821884 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-37f47157-3ab4-49c7-914b-e18b3d5fe1a8 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '454203f47b434cca952a1cef56de559f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7312d0ac9248f2bfbece5611913ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:14:55.831597 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-37f47157-3ab4-49c7-914b-e18b3d5fe1a8 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] 10.222.0.23 "GET /compute/v2.1/servers/96c829cb-4dde-467c-b50f-b2f666bdab0b" status: 200 len: 1508 microversion: 2.1 time: 0.254557 Oct 13 13:14:55.848149 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 314/643] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:14:55 2022] GET /compute/v2.1/servers/96c829cb-4dde-467c-b50f-b2f666bdab0b => generated 1508 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:14:56.098350 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-6b381024-44f7-487a-8798-c47359fb1f1c tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Action: 'create', calling method: .version_select at 0x7f5093e2bb80>, body: {"keypair": {"name": "tempest-TestShelveInstance-369055949", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJrmz0L3qU8qstEAqSZh7ZXxDvo5iRZltnPfrpnAk+hZhQ5uqvJTv1XQ4BXnsP8L+GZPSQzu+pDuZDq11QZOwpU+JaRqbNv3pE4KvLzI2hpGDwLrlkCz3eQY6Fl8zmYSsQ=="}} {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 13:14:56.114045 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.quota [None req-6b381024-44f7-487a-8798-c47359fb1f1c tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Getting quotas for project aff81c38c17b4e82864854ceac6587df. Resources: {'key_pairs'} {{(pid=118814) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 13 13:14:56.118024 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.quota [None req-6b381024-44f7-487a-8798-c47359fb1f1c tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Getting quotas for user 6723d3c8aa144452b46564649cf38ee3 and project aff81c38c17b4e82864854ceac6587df. Resources: {'key_pairs'} {{(pid=118814) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 13 13:14:56.141976 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-6b381024-44f7-487a-8798-c47359fb1f1c tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.213733 Oct 13 13:14:56.142665 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 330/644] 10.222.0.23 () {60 vars in 1159 bytes} [Thu Oct 13 13:14:55 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 13:14:56.856497 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-dca06779-1844-499b-b966-bdea1b5ac83b tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Calling method '>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:14:56.857649 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-dca06779-1844-499b-b966-bdea1b5ac83b tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] [instance: 96c829cb-4dde-467c-b50f-b2f666bdab0b] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:14:56.864275 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-dca06779-1844-499b-b966-bdea1b5ac83b tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:14:56.864777 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-dca06779-1844-499b-b966-bdea1b5ac83b tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:14:56.865211 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-dca06779-1844-499b-b966-bdea1b5ac83b tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:14:56.865911 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-dca06779-1844-499b-b966-bdea1b5ac83b tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:14:56.866367 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-dca06779-1844-499b-b966-bdea1b5ac83b tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:14:56.866795 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-dca06779-1844-499b-b966-bdea1b5ac83b tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:14:57.089037 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-dca06779-1844-499b-b966-bdea1b5ac83b tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '454203f47b434cca952a1cef56de559f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7312d0ac9248f2bfbece5611913ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:14:57.098582 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-dca06779-1844-499b-b966-bdea1b5ac83b tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] 10.222.0.23 "GET /compute/v2.1/servers/96c829cb-4dde-467c-b50f-b2f666bdab0b" status: 200 len: 1508 microversion: 2.1 time: 0.246070 Oct 13 13:14:57.099733 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 315/645] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:14:56 2022] GET /compute/v2.1/servers/96c829cb-4dde-467c-b50f-b2f666bdab0b => generated 1508 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:14:57.476302 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [req-966dfce3-3bdc-4827-a7e9-1de8b583b3ca req-84ea4860-775c-497b-a8c5-219ab51ccd99 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "96c829cb-4dde-467c-b50f-b2f666bdab0b", "name": "network-vif-deleted", "tag": "68ffba56-b1dd-4e82-b93a-56dd6b99c0b9"}]} {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 13:14:57.503027 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [req-966dfce3-3bdc-4827-a7e9-1de8b583b3ca req-84ea4860-775c-497b-a8c5-219ab51ccd99 service nova] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:14:57.503683 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [req-966dfce3-3bdc-4827-a7e9-1de8b583b3ca req-84ea4860-775c-497b-a8c5-219ab51ccd99 service nova] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:14:57.504313 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [req-966dfce3-3bdc-4827-a7e9-1de8b583b3ca req-84ea4860-775c-497b-a8c5-219ab51ccd99 service nova] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:14:57.519356 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.compute.server_external_events [req-966dfce3-3bdc-4827-a7e9-1de8b583b3ca req-84ea4860-775c-497b-a8c5-219ab51ccd99 service nova] Creating event network-vif-deleted:68ffba56-b1dd-4e82-b93a-56dd6b99c0b9 for instance 96c829cb-4dde-467c-b50f-b2f666bdab0b on hv-cinder-82660 Oct 13 13:14:57.524750 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [req-966dfce3-3bdc-4827-a7e9-1de8b583b3ca req-84ea4860-775c-497b-a8c5-219ab51ccd99 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053134 Oct 13 13:14:57.526515 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 331/646] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 13:14:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 13:14:57.729640 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-d5bef31f-264a-482d-b246-18fe884ce358 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Calling method '>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:14:57.730190 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-d5bef31f-264a-482d-b246-18fe884ce358 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] [instance: c3478cd4-e4ab-4a7d-9f4d-65323c450348] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:14:57.738647 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-d5bef31f-264a-482d-b246-18fe884ce358 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:14:57.739787 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-d5bef31f-264a-482d-b246-18fe884ce358 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:14:57.740817 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-d5bef31f-264a-482d-b246-18fe884ce358 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:14:57.741666 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-d5bef31f-264a-482d-b246-18fe884ce358 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:14:57.742318 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-d5bef31f-264a-482d-b246-18fe884ce358 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:14:57.742820 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-d5bef31f-264a-482d-b246-18fe884ce358 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:14:57.775850 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-d5bef31f-264a-482d-b246-18fe884ce358 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] 10.222.0.23 "GET /compute/v2.1/servers/c3478cd4-e4ab-4a7d-9f4d-65323c450348/ips" status: 200 len: 151 microversion: 2.20 time: 0.050951 Oct 13 13:14:57.776964 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 316/647] 10.222.0.23 () {60 vars in 1289 bytes} [Thu Oct 13 13:14:57 2022] GET /compute/v2.1/servers/c3478cd4-e4ab-4a7d-9f4d-65323c450348/ips => generated 151 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 13 13:14:58.125448 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-42d5e30d-0c7c-4d13-b7ec-0b2455158586 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Calling method '>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:14:58.126162 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-42d5e30d-0c7c-4d13-b7ec-0b2455158586 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] [instance: 96c829cb-4dde-467c-b50f-b2f666bdab0b] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:14:58.143102 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-42d5e30d-0c7c-4d13-b7ec-0b2455158586 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:14:58.146561 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-42d5e30d-0c7c-4d13-b7ec-0b2455158586 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:14:58.147421 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-42d5e30d-0c7c-4d13-b7ec-0b2455158586 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:14:58.148495 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-42d5e30d-0c7c-4d13-b7ec-0b2455158586 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:14:58.149511 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-42d5e30d-0c7c-4d13-b7ec-0b2455158586 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:14:58.151744 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-42d5e30d-0c7c-4d13-b7ec-0b2455158586 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:14:58.201596 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-42d5e30d-0c7c-4d13-b7ec-0b2455158586 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:14:58.202330 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-42d5e30d-0c7c-4d13-b7ec-0b2455158586 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:14:58.203047 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-42d5e30d-0c7c-4d13-b7ec-0b2455158586 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:14:58.203838 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.objects.instance [None req-42d5e30d-0c7c-4d13-b7ec-0b2455158586 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lazy-loading 'fault' on Instance uuid 96c829cb-4dde-467c-b50f-b2f666bdab0b {{(pid=118814) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 13 13:14:58.254846 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-42d5e30d-0c7c-4d13-b7ec-0b2455158586 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '454203f47b434cca952a1cef56de559f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7312d0ac9248f2bfbece5611913ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:14:58.262478 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-42d5e30d-0c7c-4d13-b7ec-0b2455158586 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] 10.222.0.23 "GET /compute/v2.1/servers/96c829cb-4dde-467c-b50f-b2f666bdab0b" status: 200 len: 1312 microversion: 2.1 time: 0.144158 Oct 13 13:14:58.263104 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 332/648] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:14:58 2022] GET /compute/v2.1/servers/96c829cb-4dde-467c-b50f-b2f666bdab0b => generated 1312 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:14:59.290151 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-66f6f476-78a5-4d47-85fe-8a6cd59f8645 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Calling method '>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:14:59.291406 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-66f6f476-78a5-4d47-85fe-8a6cd59f8645 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] [instance: 96c829cb-4dde-467c-b50f-b2f666bdab0b] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:14:59.298109 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-66f6f476-78a5-4d47-85fe-8a6cd59f8645 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:14:59.298580 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-66f6f476-78a5-4d47-85fe-8a6cd59f8645 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:14:59.299010 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-66f6f476-78a5-4d47-85fe-8a6cd59f8645 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:14:59.301293 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-66f6f476-78a5-4d47-85fe-8a6cd59f8645 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:14:59.302090 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-66f6f476-78a5-4d47-85fe-8a6cd59f8645 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:14:59.305936 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-66f6f476-78a5-4d47-85fe-8a6cd59f8645 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:14:59.325164 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.wsgi [None req-66f6f476-78a5-4d47-85fe-8a6cd59f8645 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] HTTP exception thrown: Instance 96c829cb-4dde-467c-b50f-b2f666bdab0b could not be found. Oct 13 13:14:59.327410 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-66f6f476-78a5-4d47-85fe-8a6cd59f8645 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Request method failure captured: Oct 13 13:14:59.327410 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: request: GET /compute/v2.1/servers/96c829cb-4dde-467c-b50f-b2f666bdab0b HTTP/1.1 Oct 13 13:14:59.327410 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: Accept: application/json Oct 13 13:14:59.327410 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: Accept-Encoding: identity Oct 13 13:14:59.327410 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: Connection: close Oct 13 13:14:59.327410 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: Content-Length: 0 Oct 13 13:14:59.327410 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: Content-Type: application/json Oct 13 13:14:59.327410 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: Host: 10.222.0.23 Oct 13 13:14:59.327410 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: Openstack-System-Scope: None Oct 13 13:14:59.327410 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: User-Agent: python-urllib3/1.26.12 Oct 13 13:14:59.327410 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Auth-Token: gAAAAABjSA4svM9mETgfaOiuUXJIEReF5lLu9fPZCd8DzHzDMjsgoKCuGBBfmSl0ftubwAnibGB2dnB8E_e8xQKe1PCHs7Ng4fH6y7rFwijiKdlg3jwpLv7Ts_hAoMDCd_X3SSeHFWudl61mtpIoaIAJsH8UQKtB4J3uZqOXyPx22DWeiRT4uVg Oct 13 13:14:59.327410 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Domain-Id: None Oct 13 13:14:59.327410 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Domain-Name: None Oct 13 13:14:59.327410 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Identity-Status: Confirmed Oct 13 13:14:59.327410 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Is-Admin-Project: True Oct 13 13:14:59.327410 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Project-Domain-Id: default Oct 13 13:14:59.327410 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Project-Domain-Name: Default Oct 13 13:14:59.327410 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Project-Id: 5e7312d0ac9248f2bfbece5611913ab2 Oct 13 13:14:59.327410 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-633823286 Oct 13 13:14:59.327410 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Role: reader,member Oct 13 13:14:59.327410 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Roles: reader,member Oct 13 13:14:59.328882 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_5e7312d0ac9248f2bfbece5611913ab2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/5e7312d0ac9248f2bfbece5611913ab2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/5e7312d0ac9248f2bfbece5611913ab2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/5e7312d0ac9248f2bfbece5611913ab2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}] Oct 13 13:14:59.328882 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Tenant: tempest-ServerRescueNegativeTestJSON-633823286 Oct 13 13:14:59.328882 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Tenant-Id: 5e7312d0ac9248f2bfbece5611913ab2 Oct 13 13:14:59.328882 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-633823286 Oct 13 13:14:59.328882 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-User: tempest-ServerRescueNegativeTestJSON-633823286-project Oct 13 13:14:59.328882 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-User-Domain-Id: default Oct 13 13:14:59.328882 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-User-Domain-Name: Default Oct 13 13:14:59.328882 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-User-Id: 454203f47b434cca952a1cef56de559f Oct 13 13:14:59.328882 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-User-Name: tempest-ServerRescueNegativeTestJSON-633823286-project Oct 13 13:14:59.328882 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: method: > Oct 13 13:14:59.328882 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: exception: Instance 96c829cb-4dde-467c-b50f-b2f666bdab0b could not be found. Oct 13 13:14:59.328882 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: action_args: {'id': '96c829cb-4dde-467c-b50f-b2f666bdab0b'} Oct 13 13:14:59.329632 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 13:14:59.329632 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 13:14:59.329632 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 13 13:14:59.329632 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 13 13:14:59.329632 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 13 13:14:59.329632 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 13 13:14:59.329632 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 13 13:14:59.329632 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 13 13:14:59.329632 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 13 13:14:59.329632 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 13 13:14:59.329632 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 96c829cb-4dde-467c-b50f-b2f666bdab0b could not be found. Oct 13 13:14:59.329632 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi Oct 13 13:14:59.329632 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 13:14:59.329632 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi Oct 13 13:14:59.329632 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 13:14:59.329632 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 13:14:59.329632 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 13:14:59.329632 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 13:14:59.329632 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 13:14:59.329632 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 13:14:59.331018 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 13:14:59.331018 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 13 13:14:59.331018 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 13 13:14:59.331018 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 13 13:14:59.331018 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 13 13:14:59.331018 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 13 13:14:59.331018 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 13 13:14:59.331018 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 96c829cb-4dde-467c-b50f-b2f666bdab0b could not be found. Oct 13 13:14:59.331018 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi Oct 13 13:14:59.331018 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 13:14:59.331018 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi Oct 13 13:14:59.331018 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 13:14:59.331018 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 13:14:59.331018 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 13:14:59.331018 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 13:14:59.331018 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 13:14:59.331018 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 96c829cb-4dde-467c-b50f-b2f666bdab0b could not be found. Oct 13 13:14:59.331018 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi Oct 13 13:14:59.332613 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-66f6f476-78a5-4d47-85fe-8a6cd59f8645 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Returning 404 to user: Instance 96c829cb-4dde-467c-b50f-b2f666bdab0b could not be found. {{(pid=118815) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 13:14:59.332613 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-66f6f476-78a5-4d47-85fe-8a6cd59f8645 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] 10.222.0.23 "GET /compute/v2.1/servers/96c829cb-4dde-467c-b50f-b2f666bdab0b" status: 404 len: 111 microversion: 2.1 time: 0.043682 Oct 13 13:14:59.332613 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 317/649] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:14:59 2022] GET /compute/v2.1/servers/96c829cb-4dde-467c-b50f-b2f666bdab0b => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 13 13:14:59.338203 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-855480eb-d507-44c1-aa17-8fc904fc1378 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Calling method '>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:14:59.338757 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-855480eb-d507-44c1-aa17-8fc904fc1378 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] [instance: 0548a3eb-e119-482c-ac70-04fbc6f83bf7] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:14:59.346932 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-855480eb-d507-44c1-aa17-8fc904fc1378 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:14:59.347606 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-855480eb-d507-44c1-aa17-8fc904fc1378 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:14:59.348038 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-855480eb-d507-44c1-aa17-8fc904fc1378 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:14:59.348731 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-855480eb-d507-44c1-aa17-8fc904fc1378 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:14:59.349178 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-855480eb-d507-44c1-aa17-8fc904fc1378 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:14:59.349618 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-855480eb-d507-44c1-aa17-8fc904fc1378 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:14:59.389227 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-855480eb-d507-44c1-aa17-8fc904fc1378 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] [instance: 0548a3eb-e119-482c-ac70-04fbc6f83bf7] Going to try to terminate instance {{(pid=118814) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 13 13:14:59.472548 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-855480eb-d507-44c1-aa17-8fc904fc1378 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] 10.222.0.23 "DELETE /compute/v2.1/servers/0548a3eb-e119-482c-ac70-04fbc6f83bf7" status: 204 len: 0 microversion: 2.1 time: 0.138141 Oct 13 13:14:59.473408 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 333/650] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Oct 13 13:14:59 2022] DELETE /compute/v2.1/servers/0548a3eb-e119-482c-ac70-04fbc6f83bf7 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 13 13:14:59.481371 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-8f97de19-53d3-4745-abe7-4c48c2060ac1 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Calling method '>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:14:59.482600 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-8f97de19-53d3-4745-abe7-4c48c2060ac1 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] [instance: 0548a3eb-e119-482c-ac70-04fbc6f83bf7] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:14:59.489029 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-8f97de19-53d3-4745-abe7-4c48c2060ac1 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:14:59.489188 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-8f97de19-53d3-4745-abe7-4c48c2060ac1 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:14:59.489569 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-8f97de19-53d3-4745-abe7-4c48c2060ac1 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:14:59.490271 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-8f97de19-53d3-4745-abe7-4c48c2060ac1 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:14:59.490722 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-8f97de19-53d3-4745-abe7-4c48c2060ac1 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:14:59.491256 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-8f97de19-53d3-4745-abe7-4c48c2060ac1 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:14:59.635735 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-8f97de19-53d3-4745-abe7-4c48c2060ac1 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '454203f47b434cca952a1cef56de559f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7312d0ac9248f2bfbece5611913ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:14:59.643874 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-8f97de19-53d3-4745-abe7-4c48c2060ac1 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] 10.222.0.23 "GET /compute/v2.1/servers/0548a3eb-e119-482c-ac70-04fbc6f83bf7" status: 200 len: 1522 microversion: 2.1 time: 0.166346 Oct 13 13:14:59.644440 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 318/651] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:14:59 2022] GET /compute/v2.1/servers/0548a3eb-e119-482c-ac70-04fbc6f83bf7 => generated 1522 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:15:00.667044 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-798deecb-dcc0-43cb-a4f5-ffa62e230a09 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Calling method '>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:15:00.667965 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-798deecb-dcc0-43cb-a4f5-ffa62e230a09 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] [instance: 0548a3eb-e119-482c-ac70-04fbc6f83bf7] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:15:00.675526 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-798deecb-dcc0-43cb-a4f5-ffa62e230a09 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:15:00.676107 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-798deecb-dcc0-43cb-a4f5-ffa62e230a09 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:15:00.676704 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-798deecb-dcc0-43cb-a4f5-ffa62e230a09 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:15:00.677409 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-798deecb-dcc0-43cb-a4f5-ffa62e230a09 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:15:00.677868 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-798deecb-dcc0-43cb-a4f5-ffa62e230a09 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:15:00.678296 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-798deecb-dcc0-43cb-a4f5-ffa62e230a09 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:15:00.734799 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-9d0df053-2dc7-4cf9-93e5-704ab7342bdb tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 13:15:00.735642 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-9d0df053-2dc7-4cf9-93e5-704ab7342bdb tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] [instance: c3478cd4-e4ab-4a7d-9f4d-65323c450348] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:15:00.742642 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-9d0df053-2dc7-4cf9-93e5-704ab7342bdb tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:15:00.743169 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-9d0df053-2dc7-4cf9-93e5-704ab7342bdb tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:15:00.743586 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-9d0df053-2dc7-4cf9-93e5-704ab7342bdb tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:15:00.744283 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-9d0df053-2dc7-4cf9-93e5-704ab7342bdb tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:15:00.744733 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-9d0df053-2dc7-4cf9-93e5-704ab7342bdb tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:15:00.745193 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-9d0df053-2dc7-4cf9-93e5-704ab7342bdb tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:15:00.769750 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.objects.instance [None req-9d0df053-2dc7-4cf9-93e5-704ab7342bdb tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lazy-loading 'flavor' on Instance uuid c3478cd4-e4ab-4a7d-9f4d-65323c450348 {{(pid=118815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 13 13:15:00.831254 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-798deecb-dcc0-43cb-a4f5-ffa62e230a09 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '454203f47b434cca952a1cef56de559f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7312d0ac9248f2bfbece5611913ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:15:00.843851 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-798deecb-dcc0-43cb-a4f5-ffa62e230a09 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] 10.222.0.23 "GET /compute/v2.1/servers/0548a3eb-e119-482c-ac70-04fbc6f83bf7" status: 200 len: 1522 microversion: 2.1 time: 0.181279 Oct 13 13:15:00.844785 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 334/652] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:15:00 2022] GET /compute/v2.1/servers/0548a3eb-e119-482c-ac70-04fbc6f83bf7 => generated 1522 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:15:00.986263 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-9d0df053-2dc7-4cf9-93e5-704ab7342bdb tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] 10.222.0.23 "POST /compute/v2.1/servers/c3478cd4-e4ab-4a7d-9f4d-65323c450348/action" status: 202 len: 0 microversion: 2.20 time: 0.255272 Oct 13 13:15:00.987173 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 319/653] 10.222.0.23 () {62 vars in 1319 bytes} [Thu Oct 13 13:15:00 2022] POST /compute/v2.1/servers/c3478cd4-e4ab-4a7d-9f4d-65323c450348/action => generated 0 bytes in 258 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 13 13:15:00.999935 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-6ba1f891-ffcd-4e4e-a36e-05bf00cb57d7 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Calling method '>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:15:01.001035 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-6ba1f891-ffcd-4e4e-a36e-05bf00cb57d7 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] [instance: c3478cd4-e4ab-4a7d-9f4d-65323c450348] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:15:01.010696 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-6ba1f891-ffcd-4e4e-a36e-05bf00cb57d7 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:15:01.011881 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-6ba1f891-ffcd-4e4e-a36e-05bf00cb57d7 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:15:01.012668 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-6ba1f891-ffcd-4e4e-a36e-05bf00cb57d7 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:15:01.014402 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-6ba1f891-ffcd-4e4e-a36e-05bf00cb57d7 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:15:01.015270 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-6ba1f891-ffcd-4e4e-a36e-05bf00cb57d7 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:15:01.021810 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-6ba1f891-ffcd-4e4e-a36e-05bf00cb57d7 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:15:01.175939 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-6ba1f891-ffcd-4e4e-a36e-05bf00cb57d7 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:15:01.184117 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-6ba1f891-ffcd-4e4e-a36e-05bf00cb57d7 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:15:01.186132 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-6ba1f891-ffcd-4e4e-a36e-05bf00cb57d7 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:15:01.187314 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-6ba1f891-ffcd-4e4e-a36e-05bf00cb57d7 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] 10.222.0.23 "GET /compute/v2.1/servers/c3478cd4-e4ab-4a7d-9f4d-65323c450348" status: 200 len: 1723 microversion: 2.20 time: 0.194447 Oct 13 13:15:01.187875 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 335/654] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 13:15:00 2022] GET /compute/v2.1/servers/c3478cd4-e4ab-4a7d-9f4d-65323c450348 => generated 1723 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 13:15:01.867950 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-a59cfa8a-135a-4e1a-ada4-7eee070a0976 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Calling method '>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:15:01.868647 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-a59cfa8a-135a-4e1a-ada4-7eee070a0976 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] [instance: 0548a3eb-e119-482c-ac70-04fbc6f83bf7] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:15:01.875492 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-a59cfa8a-135a-4e1a-ada4-7eee070a0976 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:15:01.875972 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-a59cfa8a-135a-4e1a-ada4-7eee070a0976 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:15:01.876411 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-a59cfa8a-135a-4e1a-ada4-7eee070a0976 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:15:01.877097 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-a59cfa8a-135a-4e1a-ada4-7eee070a0976 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:15:01.877547 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-a59cfa8a-135a-4e1a-ada4-7eee070a0976 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:15:01.877968 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-a59cfa8a-135a-4e1a-ada4-7eee070a0976 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:15:02.009456 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-a59cfa8a-135a-4e1a-ada4-7eee070a0976 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '454203f47b434cca952a1cef56de559f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7312d0ac9248f2bfbece5611913ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:15:02.017122 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-a59cfa8a-135a-4e1a-ada4-7eee070a0976 tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] 10.222.0.23 "GET /compute/v2.1/servers/0548a3eb-e119-482c-ac70-04fbc6f83bf7" status: 200 len: 1522 microversion: 2.1 time: 0.153893 Oct 13 13:15:02.017725 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 320/655] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:15:01 2022] GET /compute/v2.1/servers/0548a3eb-e119-482c-ac70-04fbc6f83bf7 => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:15:02.216621 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-fa723e9b-00a1-4c1e-b09b-4dccfbffc233 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Calling method '>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:15:02.218500 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-fa723e9b-00a1-4c1e-b09b-4dccfbffc233 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] [instance: c3478cd4-e4ab-4a7d-9f4d-65323c450348] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:15:02.226578 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-fa723e9b-00a1-4c1e-b09b-4dccfbffc233 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:15:02.227082 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-fa723e9b-00a1-4c1e-b09b-4dccfbffc233 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:15:02.227521 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-fa723e9b-00a1-4c1e-b09b-4dccfbffc233 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:15:02.228412 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-fa723e9b-00a1-4c1e-b09b-4dccfbffc233 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:15:02.229014 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-fa723e9b-00a1-4c1e-b09b-4dccfbffc233 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:15:02.229605 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-fa723e9b-00a1-4c1e-b09b-4dccfbffc233 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:15:02.362759 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-fa723e9b-00a1-4c1e-b09b-4dccfbffc233 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:15:02.385070 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-fa723e9b-00a1-4c1e-b09b-4dccfbffc233 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:15:02.386528 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-fa723e9b-00a1-4c1e-b09b-4dccfbffc233 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:15:02.387742 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-fa723e9b-00a1-4c1e-b09b-4dccfbffc233 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] 10.222.0.23 "GET /compute/v2.1/servers/c3478cd4-e4ab-4a7d-9f4d-65323c450348" status: 200 len: 1723 microversion: 2.20 time: 0.178843 Oct 13 13:15:02.388992 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 336/656] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 13:15:02 2022] GET /compute/v2.1/servers/c3478cd4-e4ab-4a7d-9f4d-65323c450348 => generated 1723 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 13:15:03.040385 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-99764f89-f447-4c2f-a6c4-6978887fc60c tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Calling method '>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:15:03.041003 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-99764f89-f447-4c2f-a6c4-6978887fc60c tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] [instance: 0548a3eb-e119-482c-ac70-04fbc6f83bf7] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:15:03.048014 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-99764f89-f447-4c2f-a6c4-6978887fc60c tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:15:03.048506 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-99764f89-f447-4c2f-a6c4-6978887fc60c tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:15:03.048948 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-99764f89-f447-4c2f-a6c4-6978887fc60c tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:15:03.049912 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-99764f89-f447-4c2f-a6c4-6978887fc60c tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:15:03.050365 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-99764f89-f447-4c2f-a6c4-6978887fc60c tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:15:03.050790 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-99764f89-f447-4c2f-a6c4-6978887fc60c tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:15:03.182210 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-99764f89-f447-4c2f-a6c4-6978887fc60c tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '454203f47b434cca952a1cef56de559f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7312d0ac9248f2bfbece5611913ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:15:03.190562 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-99764f89-f447-4c2f-a6c4-6978887fc60c tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] 10.222.0.23 "GET /compute/v2.1/servers/0548a3eb-e119-482c-ac70-04fbc6f83bf7" status: 200 len: 1522 microversion: 2.1 time: 0.154035 Oct 13 13:15:03.191139 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 321/657] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:15:03 2022] GET /compute/v2.1/servers/0548a3eb-e119-482c-ac70-04fbc6f83bf7 => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:15:03.414080 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-763c116c-1182-4c3a-9f0b-50310b175242 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Calling method '>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:15:03.414811 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-763c116c-1182-4c3a-9f0b-50310b175242 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] [instance: c3478cd4-e4ab-4a7d-9f4d-65323c450348] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:15:03.421442 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-763c116c-1182-4c3a-9f0b-50310b175242 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:15:03.421932 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-763c116c-1182-4c3a-9f0b-50310b175242 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:15:03.422371 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-763c116c-1182-4c3a-9f0b-50310b175242 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:15:03.423076 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-763c116c-1182-4c3a-9f0b-50310b175242 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:15:03.423530 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-763c116c-1182-4c3a-9f0b-50310b175242 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:15:03.423954 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-763c116c-1182-4c3a-9f0b-50310b175242 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:15:03.444831 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG dbcounter [-] [118814] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=118814) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:15:03.577154 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-763c116c-1182-4c3a-9f0b-50310b175242 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:15:03.588525 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-763c116c-1182-4c3a-9f0b-50310b175242 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:15:03.590665 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-763c116c-1182-4c3a-9f0b-50310b175242 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:15:03.592668 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-763c116c-1182-4c3a-9f0b-50310b175242 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] 10.222.0.23 "GET /compute/v2.1/servers/c3478cd4-e4ab-4a7d-9f4d-65323c450348" status: 200 len: 1723 microversion: 2.20 time: 0.182499 Oct 13 13:15:03.593454 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 337/658] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 13:15:03 2022] GET /compute/v2.1/servers/c3478cd4-e4ab-4a7d-9f4d-65323c450348 => generated 1723 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 13:15:03.646783 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [req-1c74ab7a-6f2e-48c8-8245-133cbadb7f7a req-4600a1f9-567a-4d06-81ed-f837e1a57ca2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0548a3eb-e119-482c-ac70-04fbc6f83bf7", "name": "network-vif-deleted", "tag": "8c64ab27-53ec-48f6-92d8-9ce773dd02d8"}]} {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 13:15:03.662520 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [req-1c74ab7a-6f2e-48c8-8245-133cbadb7f7a req-4600a1f9-567a-4d06-81ed-f837e1a57ca2 service nova] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:15:03.663186 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [req-1c74ab7a-6f2e-48c8-8245-133cbadb7f7a req-4600a1f9-567a-4d06-81ed-f837e1a57ca2 service nova] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:15:03.663760 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [req-1c74ab7a-6f2e-48c8-8245-133cbadb7f7a req-4600a1f9-567a-4d06-81ed-f837e1a57ca2 service nova] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:15:03.677182 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.compute.server_external_events [req-1c74ab7a-6f2e-48c8-8245-133cbadb7f7a req-4600a1f9-567a-4d06-81ed-f837e1a57ca2 service nova] Creating event network-vif-deleted:8c64ab27-53ec-48f6-92d8-9ce773dd02d8 for instance 0548a3eb-e119-482c-ac70-04fbc6f83bf7 on hv-cinder-82660 Oct 13 13:15:03.681971 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [req-1c74ab7a-6f2e-48c8-8245-133cbadb7f7a req-4600a1f9-567a-4d06-81ed-f837e1a57ca2 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039548 Oct 13 13:15:03.682726 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 322/659] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 13:15:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 13:15:04.213810 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-94da1a7d-5c55-4eff-9916-db933445617d tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Calling method '>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:15:04.214307 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-94da1a7d-5c55-4eff-9916-db933445617d tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] [instance: 0548a3eb-e119-482c-ac70-04fbc6f83bf7] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:15:04.220898 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-94da1a7d-5c55-4eff-9916-db933445617d tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:15:04.221383 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-94da1a7d-5c55-4eff-9916-db933445617d tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:15:04.221834 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-94da1a7d-5c55-4eff-9916-db933445617d tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:15:04.222524 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-94da1a7d-5c55-4eff-9916-db933445617d tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:15:04.222978 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-94da1a7d-5c55-4eff-9916-db933445617d tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:15:04.223437 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-94da1a7d-5c55-4eff-9916-db933445617d tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:15:04.236810 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.wsgi [None req-94da1a7d-5c55-4eff-9916-db933445617d tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] HTTP exception thrown: Instance 0548a3eb-e119-482c-ac70-04fbc6f83bf7 could not be found. Oct 13 13:15:04.238512 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-94da1a7d-5c55-4eff-9916-db933445617d tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Request method failure captured: Oct 13 13:15:04.238512 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: request: GET /compute/v2.1/servers/0548a3eb-e119-482c-ac70-04fbc6f83bf7 HTTP/1.1 Oct 13 13:15:04.238512 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: Accept: application/json Oct 13 13:15:04.238512 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: Accept-Encoding: identity Oct 13 13:15:04.238512 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: Connection: close Oct 13 13:15:04.238512 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: Content-Length: 0 Oct 13 13:15:04.238512 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: Content-Type: application/json Oct 13 13:15:04.238512 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: Host: 10.222.0.23 Oct 13 13:15:04.238512 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: Openstack-System-Scope: None Oct 13 13:15:04.238512 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: User-Agent: python-urllib3/1.26.12 Oct 13 13:15:04.238512 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Auth-Token: gAAAAABjSA4svM9mETgfaOiuUXJIEReF5lLu9fPZCd8DzHzDMjsgoKCuGBBfmSl0ftubwAnibGB2dnB8E_e8xQKe1PCHs7Ng4fH6y7rFwijiKdlg3jwpLv7Ts_hAoMDCd_X3SSeHFWudl61mtpIoaIAJsH8UQKtB4J3uZqOXyPx22DWeiRT4uVg Oct 13 13:15:04.238512 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Domain-Id: None Oct 13 13:15:04.238512 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Domain-Name: None Oct 13 13:15:04.238512 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Identity-Status: Confirmed Oct 13 13:15:04.238512 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Is-Admin-Project: True Oct 13 13:15:04.238512 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Project-Domain-Id: default Oct 13 13:15:04.238512 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Project-Domain-Name: Default Oct 13 13:15:04.238512 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Project-Id: 5e7312d0ac9248f2bfbece5611913ab2 Oct 13 13:15:04.238512 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-633823286 Oct 13 13:15:04.238512 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Role: reader,member Oct 13 13:15:04.238512 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Roles: reader,member Oct 13 13:15:04.240130 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_5e7312d0ac9248f2bfbece5611913ab2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/5e7312d0ac9248f2bfbece5611913ab2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/5e7312d0ac9248f2bfbece5611913ab2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/5e7312d0ac9248f2bfbece5611913ab2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}] Oct 13 13:15:04.240130 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Tenant: tempest-ServerRescueNegativeTestJSON-633823286 Oct 13 13:15:04.240130 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Tenant-Id: 5e7312d0ac9248f2bfbece5611913ab2 Oct 13 13:15:04.240130 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-633823286 Oct 13 13:15:04.240130 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-User: tempest-ServerRescueNegativeTestJSON-633823286-project Oct 13 13:15:04.240130 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-User-Domain-Id: default Oct 13 13:15:04.240130 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-User-Domain-Name: Default Oct 13 13:15:04.240130 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-User-Id: 454203f47b434cca952a1cef56de559f Oct 13 13:15:04.240130 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-User-Name: tempest-ServerRescueNegativeTestJSON-633823286-project Oct 13 13:15:04.240130 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: method: > Oct 13 13:15:04.240130 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: exception: Instance 0548a3eb-e119-482c-ac70-04fbc6f83bf7 could not be found. Oct 13 13:15:04.240130 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: action_args: {'id': '0548a3eb-e119-482c-ac70-04fbc6f83bf7'} Oct 13 13:15:04.240899 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 13:15:04.240899 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 13:15:04.240899 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 13 13:15:04.240899 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 13 13:15:04.240899 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 13 13:15:04.240899 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 13 13:15:04.240899 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 13 13:15:04.240899 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 13 13:15:04.240899 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 13 13:15:04.240899 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 13 13:15:04.240899 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0548a3eb-e119-482c-ac70-04fbc6f83bf7 could not be found. Oct 13 13:15:04.240899 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi Oct 13 13:15:04.240899 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 13:15:04.240899 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi Oct 13 13:15:04.240899 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 13:15:04.240899 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 13:15:04.240899 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 13:15:04.240899 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 13:15:04.240899 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 13:15:04.240899 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 13:15:04.242060 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 13:15:04.242060 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 13 13:15:04.242060 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 13 13:15:04.242060 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 13 13:15:04.242060 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 13 13:15:04.242060 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 13 13:15:04.242060 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 13 13:15:04.242060 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0548a3eb-e119-482c-ac70-04fbc6f83bf7 could not be found. Oct 13 13:15:04.242060 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi Oct 13 13:15:04.242060 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 13:15:04.242060 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi Oct 13 13:15:04.242060 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 13:15:04.242060 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 13:15:04.242060 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 13:15:04.242060 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 13:15:04.242060 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 13:15:04.242060 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0548a3eb-e119-482c-ac70-04fbc6f83bf7 could not be found. Oct 13 13:15:04.242060 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi Oct 13 13:15:04.243100 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-94da1a7d-5c55-4eff-9916-db933445617d tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] Returning 404 to user: Instance 0548a3eb-e119-482c-ac70-04fbc6f83bf7 could not be found. {{(pid=118814) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 13:15:04.243100 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-94da1a7d-5c55-4eff-9916-db933445617d tempest-ServerRescueNegativeTestJSON-633823286 tempest-ServerRescueNegativeTestJSON-633823286-project] 10.222.0.23 "GET /compute/v2.1/servers/0548a3eb-e119-482c-ac70-04fbc6f83bf7" status: 404 len: 111 microversion: 2.1 time: 0.030216 Oct 13 13:15:04.243100 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 338/660] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:15:04 2022] GET /compute/v2.1/servers/0548a3eb-e119-482c-ac70-04fbc6f83bf7 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 13 13:15:04.619075 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-62971599-20b0-4457-ae85-dd9500e5b036 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Calling method '>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:15:04.620648 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-62971599-20b0-4457-ae85-dd9500e5b036 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] [instance: c3478cd4-e4ab-4a7d-9f4d-65323c450348] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:15:04.628823 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-62971599-20b0-4457-ae85-dd9500e5b036 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:15:04.629313 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-62971599-20b0-4457-ae85-dd9500e5b036 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:15:04.629750 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-62971599-20b0-4457-ae85-dd9500e5b036 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:15:04.630463 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-62971599-20b0-4457-ae85-dd9500e5b036 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:15:04.630952 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-62971599-20b0-4457-ae85-dd9500e5b036 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:15:04.631399 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-62971599-20b0-4457-ae85-dd9500e5b036 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:15:05.017535 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-62971599-20b0-4457-ae85-dd9500e5b036 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:15:05.025546 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-62971599-20b0-4457-ae85-dd9500e5b036 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:15:05.027000 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-62971599-20b0-4457-ae85-dd9500e5b036 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:15:05.028183 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-62971599-20b0-4457-ae85-dd9500e5b036 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] 10.222.0.23 "GET /compute/v2.1/servers/c3478cd4-e4ab-4a7d-9f4d-65323c450348" status: 200 len: 1723 microversion: 2.20 time: 0.414012 Oct 13 13:15:05.029255 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 323/661] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 13:15:04 2022] GET /compute/v2.1/servers/c3478cd4-e4ab-4a7d-9f4d-65323c450348 => generated 1723 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 13:15:06.054125 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-a39619d6-cdf9-4117-9366-2f916c2ceab0 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Calling method '>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:15:06.054851 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-a39619d6-cdf9-4117-9366-2f916c2ceab0 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] [instance: c3478cd4-e4ab-4a7d-9f4d-65323c450348] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:15:06.077731 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-a39619d6-cdf9-4117-9366-2f916c2ceab0 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:15:06.078306 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-a39619d6-cdf9-4117-9366-2f916c2ceab0 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:15:06.078765 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-a39619d6-cdf9-4117-9366-2f916c2ceab0 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:15:06.079524 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-a39619d6-cdf9-4117-9366-2f916c2ceab0 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:15:06.079988 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-a39619d6-cdf9-4117-9366-2f916c2ceab0 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:15:06.080422 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-a39619d6-cdf9-4117-9366-2f916c2ceab0 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:15:06.128459 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG dbcounter [-] [118814] Writing DB stats nova_cell0:SELECT=4 {{(pid=118814) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:15:06.248716 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-a39619d6-cdf9-4117-9366-2f916c2ceab0 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:15:06.258083 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-a39619d6-cdf9-4117-9366-2f916c2ceab0 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:15:06.259585 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-a39619d6-cdf9-4117-9366-2f916c2ceab0 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:15:06.260798 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-a39619d6-cdf9-4117-9366-2f916c2ceab0 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] 10.222.0.23 "GET /compute/v2.1/servers/c3478cd4-e4ab-4a7d-9f4d-65323c450348" status: 200 len: 1723 microversion: 2.20 time: 0.210708 Oct 13 13:15:06.268388 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 339/662] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 13:15:06 2022] GET /compute/v2.1/servers/c3478cd4-e4ab-4a7d-9f4d-65323c450348 => generated 1723 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 13:15:07.401750 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-73e39aa4-af1f-43a9-84a2-2b15a837ae6f tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Calling method '>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:15:07.402925 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-73e39aa4-af1f-43a9-84a2-2b15a837ae6f tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] [instance: c3478cd4-e4ab-4a7d-9f4d-65323c450348] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:15:07.411841 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-73e39aa4-af1f-43a9-84a2-2b15a837ae6f tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:15:07.412857 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-73e39aa4-af1f-43a9-84a2-2b15a837ae6f tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:15:07.414061 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-73e39aa4-af1f-43a9-84a2-2b15a837ae6f tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:15:07.415046 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-73e39aa4-af1f-43a9-84a2-2b15a837ae6f tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:15:07.416033 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-73e39aa4-af1f-43a9-84a2-2b15a837ae6f tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:15:07.416627 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-73e39aa4-af1f-43a9-84a2-2b15a837ae6f tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:15:07.422040 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 13 13:15:07.422305 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: Thu Oct 13 13:15:07 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/c3478cd4-e4ab-4a7d-9f4d-65323c450348 (ip 10.222.0.23) !!! Oct 13 13:15:07.677818 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-73e39aa4-af1f-43a9-84a2-2b15a837ae6f tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:15:07.689662 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-73e39aa4-af1f-43a9-84a2-2b15a837ae6f tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:15:07.691565 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-73e39aa4-af1f-43a9-84a2-2b15a837ae6f tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:15:07.692745 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-73e39aa4-af1f-43a9-84a2-2b15a837ae6f tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] 10.222.0.23 "GET /compute/v2.1/servers/c3478cd4-e4ab-4a7d-9f4d-65323c450348" status: 200 len: 1723 microversion: 2.20 time: 0.408796 Oct 13 13:15:07.693849 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 324/663] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 13:15:07 2022] GET /compute/v2.1/servers/c3478cd4-e4ab-4a7d-9f4d-65323c450348 => generated 1723 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 13:15:08.721318 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-65d03d95-e854-4685-ac90-5da43aeaf823 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Calling method '>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:15:08.722578 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-65d03d95-e854-4685-ac90-5da43aeaf823 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] [instance: c3478cd4-e4ab-4a7d-9f4d-65323c450348] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:15:08.728725 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-65d03d95-e854-4685-ac90-5da43aeaf823 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:15:08.729214 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-65d03d95-e854-4685-ac90-5da43aeaf823 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:15:08.729654 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-65d03d95-e854-4685-ac90-5da43aeaf823 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:15:08.730378 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-65d03d95-e854-4685-ac90-5da43aeaf823 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:15:08.730840 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-65d03d95-e854-4685-ac90-5da43aeaf823 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:15:08.731409 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-65d03d95-e854-4685-ac90-5da43aeaf823 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:15:08.868964 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-65d03d95-e854-4685-ac90-5da43aeaf823 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:15:08.877594 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-65d03d95-e854-4685-ac90-5da43aeaf823 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:15:08.879075 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-65d03d95-e854-4685-ac90-5da43aeaf823 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:15:08.880254 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-65d03d95-e854-4685-ac90-5da43aeaf823 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] 10.222.0.23 "GET /compute/v2.1/servers/c3478cd4-e4ab-4a7d-9f4d-65323c450348" status: 200 len: 1723 microversion: 2.20 time: 0.163076 Oct 13 13:15:08.880806 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 340/664] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 13:15:08 2022] GET /compute/v2.1/servers/c3478cd4-e4ab-4a7d-9f4d-65323c450348 => generated 1723 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 13:15:09.906797 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-884c3807-fa25-46b2-ae10-16b2155ef47f tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Calling method '>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:15:09.907465 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-884c3807-fa25-46b2-ae10-16b2155ef47f tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] [instance: c3478cd4-e4ab-4a7d-9f4d-65323c450348] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:15:09.914447 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-884c3807-fa25-46b2-ae10-16b2155ef47f tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:15:09.914950 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-884c3807-fa25-46b2-ae10-16b2155ef47f tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:15:09.915422 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-884c3807-fa25-46b2-ae10-16b2155ef47f tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:15:09.916126 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-884c3807-fa25-46b2-ae10-16b2155ef47f tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:15:09.916754 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-884c3807-fa25-46b2-ae10-16b2155ef47f tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:15:09.917185 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-884c3807-fa25-46b2-ae10-16b2155ef47f tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:15:10.066244 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-884c3807-fa25-46b2-ae10-16b2155ef47f tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:15:10.068762 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG dbcounter [-] [118815] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=118815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:15:10.078776 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-884c3807-fa25-46b2-ae10-16b2155ef47f tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:15:10.080380 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-884c3807-fa25-46b2-ae10-16b2155ef47f tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:15:10.081661 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-884c3807-fa25-46b2-ae10-16b2155ef47f tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] 10.222.0.23 "GET /compute/v2.1/servers/c3478cd4-e4ab-4a7d-9f4d-65323c450348" status: 200 len: 1723 microversion: 2.20 time: 0.179380 Oct 13 13:15:10.087006 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 325/665] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 13:15:09 2022] GET /compute/v2.1/servers/c3478cd4-e4ab-4a7d-9f4d-65323c450348 => generated 1723 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 13:15:11.109042 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-1ce3523c-ba08-4d1d-a167-76f2ff36cca9 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Calling method '>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:15:11.109683 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-1ce3523c-ba08-4d1d-a167-76f2ff36cca9 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] [instance: c3478cd4-e4ab-4a7d-9f4d-65323c450348] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:15:11.116466 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-1ce3523c-ba08-4d1d-a167-76f2ff36cca9 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:15:11.116927 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-1ce3523c-ba08-4d1d-a167-76f2ff36cca9 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:15:11.117419 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-1ce3523c-ba08-4d1d-a167-76f2ff36cca9 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:15:11.118108 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-1ce3523c-ba08-4d1d-a167-76f2ff36cca9 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:15:11.118563 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-1ce3523c-ba08-4d1d-a167-76f2ff36cca9 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:15:11.118981 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-1ce3523c-ba08-4d1d-a167-76f2ff36cca9 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:15:11.251690 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-1ce3523c-ba08-4d1d-a167-76f2ff36cca9 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:15:11.260064 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-1ce3523c-ba08-4d1d-a167-76f2ff36cca9 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:15:11.261510 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-1ce3523c-ba08-4d1d-a167-76f2ff36cca9 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:15:11.262701 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-1ce3523c-ba08-4d1d-a167-76f2ff36cca9 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] 10.222.0.23 "GET /compute/v2.1/servers/c3478cd4-e4ab-4a7d-9f4d-65323c450348" status: 200 len: 1723 microversion: 2.20 time: 0.158579 Oct 13 13:15:11.263283 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 341/666] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 13:15:11 2022] GET /compute/v2.1/servers/c3478cd4-e4ab-4a7d-9f4d-65323c450348 => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 13:15:12.290187 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-e8a4329f-d754-4fbf-8919-4a58dcfddc38 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Calling method '>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:15:12.290794 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-e8a4329f-d754-4fbf-8919-4a58dcfddc38 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] [instance: c3478cd4-e4ab-4a7d-9f4d-65323c450348] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:15:12.298439 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-e8a4329f-d754-4fbf-8919-4a58dcfddc38 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:15:12.298919 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-e8a4329f-d754-4fbf-8919-4a58dcfddc38 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:15:12.299647 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-e8a4329f-d754-4fbf-8919-4a58dcfddc38 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:15:12.300331 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-e8a4329f-d754-4fbf-8919-4a58dcfddc38 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:15:12.300778 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-e8a4329f-d754-4fbf-8919-4a58dcfddc38 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:15:12.301210 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-e8a4329f-d754-4fbf-8919-4a58dcfddc38 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:15:12.434958 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-e8a4329f-d754-4fbf-8919-4a58dcfddc38 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:15:12.444370 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-e8a4329f-d754-4fbf-8919-4a58dcfddc38 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:15:12.445801 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-e8a4329f-d754-4fbf-8919-4a58dcfddc38 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:15:12.446947 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-e8a4329f-d754-4fbf-8919-4a58dcfddc38 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] 10.222.0.23 "GET /compute/v2.1/servers/c3478cd4-e4ab-4a7d-9f4d-65323c450348" status: 200 len: 1723 microversion: 2.20 time: 0.160882 Oct 13 13:15:12.447556 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 326/667] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 13:15:12 2022] GET /compute/v2.1/servers/c3478cd4-e4ab-4a7d-9f4d-65323c450348 => generated 1723 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 13:15:13.061172 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-2036a8fe-d6e6-43a4-ad3d-d8ca8620a2b9 tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1568761974", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-369055949", "security_groups": [{"name": "tempest-secgroup-smoke-792963870"}], "networks": [{"uuid": "1e6e7eef-fa07-4671-a605-5b0b3a4c317a"}], "block_device_mapping_v2": [{"uuid": "baecf4ad-ad27-4a0b-9407-5b422ef9a356", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 13:15:13.175849 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.network.neutron [None req-2036a8fe-d6e6-43a4-ad3d-d8ca8620a2b9 tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] validate_networks() for [('1e6e7eef-fa07-4671-a605-5b0b3a4c317a', None, None, None, None, None)] {{(pid=118814) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 13 13:15:13.352729 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG dbcounter [-] [118814] Writing DB stats nova_api:SELECT=62,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=118814) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:15:13.472092 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-ddaa535a-a116-409a-9798-d60ff7d00ee9 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Calling method '>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:15:13.472712 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-ddaa535a-a116-409a-9798-d60ff7d00ee9 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] [instance: c3478cd4-e4ab-4a7d-9f4d-65323c450348] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:15:13.478980 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-ddaa535a-a116-409a-9798-d60ff7d00ee9 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:15:13.479514 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-ddaa535a-a116-409a-9798-d60ff7d00ee9 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:15:13.479952 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-ddaa535a-a116-409a-9798-d60ff7d00ee9 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:15:13.480638 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-ddaa535a-a116-409a-9798-d60ff7d00ee9 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:15:13.481092 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-ddaa535a-a116-409a-9798-d60ff7d00ee9 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:15:13.481685 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-ddaa535a-a116-409a-9798-d60ff7d00ee9 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:15:13.681438 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-ddaa535a-a116-409a-9798-d60ff7d00ee9 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:15:13.690563 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-ddaa535a-a116-409a-9798-d60ff7d00ee9 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:15:13.692169 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-ddaa535a-a116-409a-9798-d60ff7d00ee9 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:15:13.693413 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-ddaa535a-a116-409a-9798-d60ff7d00ee9 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] 10.222.0.23 "GET /compute/v2.1/servers/c3478cd4-e4ab-4a7d-9f4d-65323c450348" status: 200 len: 1744 microversion: 2.20 time: 0.225199 Oct 13 13:15:13.694047 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 327/668] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 13:15:13 2022] GET /compute/v2.1/servers/c3478cd4-e4ab-4a7d-9f4d-65323c450348 => generated 1744 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 13 13:15:13.710481 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.virt.hardware [None req-2036a8fe-d6e6-43a4-ad3d-d8ca8620a2b9 tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Flavor limits 0:0:0 {{(pid=118814) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 13 13:15:13.710910 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.virt.hardware [None req-2036a8fe-d6e6-43a4-ad3d-d8ca8620a2b9 tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Image limits 0:0:0 {{(pid=118814) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 13 13:15:13.711427 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.virt.hardware [None req-2036a8fe-d6e6-43a4-ad3d-d8ca8620a2b9 tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Flavor pref 0:0:0 {{(pid=118814) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 13 13:15:13.711839 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.virt.hardware [None req-2036a8fe-d6e6-43a4-ad3d-d8ca8620a2b9 tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Image pref 0:0:0 {{(pid=118814) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 13 13:15:13.712253 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.virt.hardware [None req-2036a8fe-d6e6-43a4-ad3d-d8ca8620a2b9 tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118814) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 13 13:15:13.721076 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-2036a8fe-d6e6-43a4-ad3d-d8ca8620a2b9 tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:15:13.721558 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-2036a8fe-d6e6-43a4-ad3d-d8ca8620a2b9 tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:15:13.721995 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-2036a8fe-d6e6-43a4-ad3d-d8ca8620a2b9 tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:15:13.722718 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-2036a8fe-d6e6-43a4-ad3d-d8ca8620a2b9 tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:15:13.723212 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-2036a8fe-d6e6-43a4-ad3d-d8ca8620a2b9 tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:15:13.723639 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-2036a8fe-d6e6-43a4-ad3d-d8ca8620a2b9 tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:15:13.740440 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.quota [None req-2036a8fe-d6e6-43a4-ad3d-d8ca8620a2b9 tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Getting quotas for project aff81c38c17b4e82864854ceac6587df. Resources: {'instances', 'cores', 'ram'} {{(pid=118814) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 13 13:15:13.744389 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.quota [None req-2036a8fe-d6e6-43a4-ad3d-d8ca8620a2b9 tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Getting quotas for user 6723d3c8aa144452b46564649cf38ee3 and project aff81c38c17b4e82864854ceac6587df. Resources: {'instances', 'cores', 'ram'} {{(pid=118814) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 13 13:15:13.800446 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-2036a8fe-d6e6-43a4-ad3d-d8ca8620a2b9 tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Going to run 1 instances... {{(pid=118814) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 13 13:15:13.802589 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-2036a8fe-d6e6-43a4-ad3d-d8ca8620a2b9 tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] [instance: 5c481e0e-37eb-4457-813e-eb8a84932582] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='baecf4ad-ad27-4a0b-9407-5b422ef9a356',volume_size=None,volume_type=None)] {{(pid=118814) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 13 13:15:13.940029 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-2036a8fe-d6e6-43a4-ad3d-d8ca8620a2b9 tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.883374 Oct 13 13:15:13.940844 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 342/669] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Oct 13 13:15:13 2022] POST /compute/v2.1/servers => generated 405 bytes in 885 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 13 13:15:13.951828 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-8e16bae4-34ab-48b3-be85-27439154c8cf tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Calling method '>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:15:13.952437 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-8e16bae4-34ab-48b3-be85-27439154c8cf tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] [instance: 5c481e0e-37eb-4457-813e-eb8a84932582] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:15:14.018939 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-8e16bae4-34ab-48b3-be85-27439154c8cf tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6723d3c8aa144452b46564649cf38ee3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aff81c38c17b4e82864854ceac6587df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:15:14.026791 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-8e16bae4-34ab-48b3-be85-27439154c8cf tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] 10.222.0.23 "GET /compute/v2.1/servers/5c481e0e-37eb-4457-813e-eb8a84932582" status: 200 len: 1088 microversion: 2.1 time: 0.078904 Oct 13 13:15:14.031237 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 328/670] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:15:13 2022] GET /compute/v2.1/servers/5c481e0e-37eb-4457-813e-eb8a84932582 => generated 1088 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 13:15:14.720826 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-6fa442cf-b3f3-4edc-938e-dbdcf64d376a tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Calling method '>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:15:14.721714 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-6fa442cf-b3f3-4edc-938e-dbdcf64d376a tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] [instance: c3478cd4-e4ab-4a7d-9f4d-65323c450348] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:15:14.729387 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-6fa442cf-b3f3-4edc-938e-dbdcf64d376a tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:15:14.730021 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-6fa442cf-b3f3-4edc-938e-dbdcf64d376a tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:15:14.730698 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-6fa442cf-b3f3-4edc-938e-dbdcf64d376a tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:15:14.731700 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-6fa442cf-b3f3-4edc-938e-dbdcf64d376a tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:15:14.732163 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-6fa442cf-b3f3-4edc-938e-dbdcf64d376a tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:15:14.732606 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-6fa442cf-b3f3-4edc-938e-dbdcf64d376a tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:15:14.869919 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-6fa442cf-b3f3-4edc-938e-dbdcf64d376a tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:15:14.878574 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-6fa442cf-b3f3-4edc-938e-dbdcf64d376a tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:15:14.880109 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-6fa442cf-b3f3-4edc-938e-dbdcf64d376a tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:15:14.881227 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-6fa442cf-b3f3-4edc-938e-dbdcf64d376a tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] 10.222.0.23 "GET /compute/v2.1/servers/c3478cd4-e4ab-4a7d-9f4d-65323c450348" status: 200 len: 1744 microversion: 2.20 time: 0.165446 Oct 13 13:15:14.881766 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 343/671] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 13:15:14 2022] GET /compute/v2.1/servers/c3478cd4-e4ab-4a7d-9f4d-65323c450348 => generated 1744 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 13 13:15:15.050002 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-4061d4b1-960b-42f6-98cc-5724f25c7cdf tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Calling method '>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:15:15.050610 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-4061d4b1-960b-42f6-98cc-5724f25c7cdf tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] [instance: 5c481e0e-37eb-4457-813e-eb8a84932582] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:15:15.057582 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-4061d4b1-960b-42f6-98cc-5724f25c7cdf tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:15:15.058058 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-4061d4b1-960b-42f6-98cc-5724f25c7cdf tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:15:15.058492 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-4061d4b1-960b-42f6-98cc-5724f25c7cdf tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:15:15.059193 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-4061d4b1-960b-42f6-98cc-5724f25c7cdf tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:15:15.059643 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-4061d4b1-960b-42f6-98cc-5724f25c7cdf tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:15:15.060063 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-4061d4b1-960b-42f6-98cc-5724f25c7cdf tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:15:15.121597 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-4061d4b1-960b-42f6-98cc-5724f25c7cdf tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6723d3c8aa144452b46564649cf38ee3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aff81c38c17b4e82864854ceac6587df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:15:15.129970 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-4061d4b1-960b-42f6-98cc-5724f25c7cdf tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] 10.222.0.23 "GET /compute/v2.1/servers/5c481e0e-37eb-4457-813e-eb8a84932582" status: 200 len: 1186 microversion: 2.1 time: 0.084034 Oct 13 13:15:15.130639 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 329/672] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:15:15 2022] GET /compute/v2.1/servers/5c481e0e-37eb-4457-813e-eb8a84932582 => generated 1186 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:15:15.910980 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-cdd668d1-3ae0-45fd-a521-ce9dfad3901a tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Calling method '>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:15:15.911637 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-cdd668d1-3ae0-45fd-a521-ce9dfad3901a tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] [instance: c3478cd4-e4ab-4a7d-9f4d-65323c450348] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:15:15.917867 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-cdd668d1-3ae0-45fd-a521-ce9dfad3901a tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:15:15.918372 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-cdd668d1-3ae0-45fd-a521-ce9dfad3901a tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:15:15.926005 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-cdd668d1-3ae0-45fd-a521-ce9dfad3901a tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:15:15.927192 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-cdd668d1-3ae0-45fd-a521-ce9dfad3901a tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:15:15.927830 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-cdd668d1-3ae0-45fd-a521-ce9dfad3901a tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:15:15.928424 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-cdd668d1-3ae0-45fd-a521-ce9dfad3901a tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:15:16.145559 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-cdd668d1-3ae0-45fd-a521-ce9dfad3901a tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:15:16.153648 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-8c7143d5-7caf-41f4-8ff2-99d99865b8eb tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Calling method '>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:15:16.155883 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-8c7143d5-7caf-41f4-8ff2-99d99865b8eb tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] [instance: 5c481e0e-37eb-4457-813e-eb8a84932582] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:15:16.158511 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-cdd668d1-3ae0-45fd-a521-ce9dfad3901a tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:15:16.163530 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-cdd668d1-3ae0-45fd-a521-ce9dfad3901a tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:15:16.165055 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-8c7143d5-7caf-41f4-8ff2-99d99865b8eb tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:15:16.165928 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-cdd668d1-3ae0-45fd-a521-ce9dfad3901a tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] 10.222.0.23 "GET /compute/v2.1/servers/c3478cd4-e4ab-4a7d-9f4d-65323c450348" status: 200 len: 1739 microversion: 2.20 time: 0.259211 Oct 13 13:15:16.168892 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-8c7143d5-7caf-41f4-8ff2-99d99865b8eb tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:15:16.169459 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-8c7143d5-7caf-41f4-8ff2-99d99865b8eb tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:15:16.170363 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-8c7143d5-7caf-41f4-8ff2-99d99865b8eb tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:15:16.171710 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-8c7143d5-7caf-41f4-8ff2-99d99865b8eb tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:15:16.172316 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-8c7143d5-7caf-41f4-8ff2-99d99865b8eb tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:15:16.189447 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 344/673] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 13:15:15 2022] GET /compute/v2.1/servers/c3478cd4-e4ab-4a7d-9f4d-65323c450348 => generated 1739 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 13:15:16.440576 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-8c7143d5-7caf-41f4-8ff2-99d99865b8eb tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6723d3c8aa144452b46564649cf38ee3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aff81c38c17b4e82864854ceac6587df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:15:16.452619 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-8c7143d5-7caf-41f4-8ff2-99d99865b8eb tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] 10.222.0.23 "GET /compute/v2.1/servers/5c481e0e-37eb-4457-813e-eb8a84932582" status: 200 len: 1259 microversion: 2.1 time: 0.302830 Oct 13 13:15:16.455291 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 330/674] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:15:16 2022] GET /compute/v2.1/servers/5c481e0e-37eb-4457-813e-eb8a84932582 => generated 1259 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 13:15:17.138930 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [req-d94ea81f-0f75-49dc-ba9f-95ab0247910c req-e67d02f5-98d4-449d-aa1f-3fc0a6dac0f0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5c481e0e-37eb-4457-813e-eb8a84932582", "tag": "386e505c-fee6-4a1d-9fa8-236b241cf782"}]} {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 13:15:17.152693 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [req-d94ea81f-0f75-49dc-ba9f-95ab0247910c req-e67d02f5-98d4-449d-aa1f-3fc0a6dac0f0 service nova] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:15:17.153434 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [req-d94ea81f-0f75-49dc-ba9f-95ab0247910c req-e67d02f5-98d4-449d-aa1f-3fc0a6dac0f0 service nova] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:15:17.154075 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [req-d94ea81f-0f75-49dc-ba9f-95ab0247910c req-e67d02f5-98d4-449d-aa1f-3fc0a6dac0f0 service nova] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:15:17.171462 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.compute.server_external_events [req-d94ea81f-0f75-49dc-ba9f-95ab0247910c req-e67d02f5-98d4-449d-aa1f-3fc0a6dac0f0 service nova] Creating event network-changed:386e505c-fee6-4a1d-9fa8-236b241cf782 for instance 5c481e0e-37eb-4457-813e-eb8a84932582 on hv-cinder-82660 Oct 13 13:15:17.177492 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [req-d94ea81f-0f75-49dc-ba9f-95ab0247910c req-e67d02f5-98d4-449d-aa1f-3fc0a6dac0f0 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042230 Oct 13 13:15:17.178636 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 345/675] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 13:15:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 13:15:17.195037 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-03654ed4-f49f-46b9-ae9f-f997e3a3bcf5 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Calling method '>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:15:17.196229 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-03654ed4-f49f-46b9-ae9f-f997e3a3bcf5 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] [instance: c3478cd4-e4ab-4a7d-9f4d-65323c450348] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:15:17.203437 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-03654ed4-f49f-46b9-ae9f-f997e3a3bcf5 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:15:17.204345 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-03654ed4-f49f-46b9-ae9f-f997e3a3bcf5 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:15:17.204978 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-03654ed4-f49f-46b9-ae9f-f997e3a3bcf5 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:15:17.206084 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-03654ed4-f49f-46b9-ae9f-f997e3a3bcf5 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:15:17.206897 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-03654ed4-f49f-46b9-ae9f-f997e3a3bcf5 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:15:17.207531 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-03654ed4-f49f-46b9-ae9f-f997e3a3bcf5 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:15:17.414345 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-03654ed4-f49f-46b9-ae9f-f997e3a3bcf5 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:15:17.448615 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-03654ed4-f49f-46b9-ae9f-f997e3a3bcf5 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:15:17.453019 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-03654ed4-f49f-46b9-ae9f-f997e3a3bcf5 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:15:17.458810 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-03654ed4-f49f-46b9-ae9f-f997e3a3bcf5 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] 10.222.0.23 "GET /compute/v2.1/servers/c3478cd4-e4ab-4a7d-9f4d-65323c450348" status: 200 len: 1739 microversion: 2.20 time: 0.268779 Oct 13 13:15:17.462897 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 331/676] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 13:15:17 2022] GET /compute/v2.1/servers/c3478cd4-e4ab-4a7d-9f4d-65323c450348 => generated 1739 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 13:15:17.486674 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-934e1909-c63c-4b90-9172-4729ae3fd58c tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Calling method '>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:15:17.487917 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-934e1909-c63c-4b90-9172-4729ae3fd58c tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] [instance: 5c481e0e-37eb-4457-813e-eb8a84932582] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:15:17.504252 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-934e1909-c63c-4b90-9172-4729ae3fd58c tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:15:17.506170 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-934e1909-c63c-4b90-9172-4729ae3fd58c tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:15:17.507086 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-934e1909-c63c-4b90-9172-4729ae3fd58c tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:15:17.509474 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-934e1909-c63c-4b90-9172-4729ae3fd58c tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:15:17.511622 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-934e1909-c63c-4b90-9172-4729ae3fd58c tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:15:17.513057 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-934e1909-c63c-4b90-9172-4729ae3fd58c tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:15:17.529978 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [req-5c165ff2-dd7f-4234-8af5-7591977a839b req-13584c1f-a513-451b-ba6d-e9b39363c1ad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c3478cd4-e4ab-4a7d-9f4d-65323c450348", "name": "network-vif-plugged", "status": "completed", "tag": "ff57ee79-9921-43ed-817d-5ba082c97343"}]} {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 13:15:17.547201 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG dbcounter [-] [118815] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=1 {{(pid=118815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:15:17.549260 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [req-5c165ff2-dd7f-4234-8af5-7591977a839b req-13584c1f-a513-451b-ba6d-e9b39363c1ad service nova] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:15:17.550020 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [req-5c165ff2-dd7f-4234-8af5-7591977a839b req-13584c1f-a513-451b-ba6d-e9b39363c1ad service nova] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:15:17.550449 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [req-5c165ff2-dd7f-4234-8af5-7591977a839b req-13584c1f-a513-451b-ba6d-e9b39363c1ad service nova] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:15:17.583934 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.compute.server_external_events [req-5c165ff2-dd7f-4234-8af5-7591977a839b req-13584c1f-a513-451b-ba6d-e9b39363c1ad service nova] Creating event network-vif-plugged:ff57ee79-9921-43ed-817d-5ba082c97343 for instance c3478cd4-e4ab-4a7d-9f4d-65323c450348 on hv-cinder-82660 Oct 13 13:15:17.589135 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [req-5c165ff2-dd7f-4234-8af5-7591977a839b req-13584c1f-a513-451b-ba6d-e9b39363c1ad service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063308 Oct 13 13:15:17.598466 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 332/677] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 13:15:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 13:15:17.745936 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-934e1909-c63c-4b90-9172-4729ae3fd58c tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6723d3c8aa144452b46564649cf38ee3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aff81c38c17b4e82864854ceac6587df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:15:17.760771 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-934e1909-c63c-4b90-9172-4729ae3fd58c tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] 10.222.0.23 "GET /compute/v2.1/servers/5c481e0e-37eb-4457-813e-eb8a84932582" status: 200 len: 1259 microversion: 2.1 time: 0.284101 Oct 13 13:15:17.772356 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 346/678] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:15:17 2022] GET /compute/v2.1/servers/5c481e0e-37eb-4457-813e-eb8a84932582 => generated 1259 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:15:18.493251 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-9fed0930-5d49-4614-8e27-774ea4a808bd tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Calling method '>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:15:18.494622 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-9fed0930-5d49-4614-8e27-774ea4a808bd tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] [instance: c3478cd4-e4ab-4a7d-9f4d-65323c450348] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:15:18.501166 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-9fed0930-5d49-4614-8e27-774ea4a808bd tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:15:18.501658 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-9fed0930-5d49-4614-8e27-774ea4a808bd tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:15:18.502316 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-9fed0930-5d49-4614-8e27-774ea4a808bd tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:15:18.503279 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-9fed0930-5d49-4614-8e27-774ea4a808bd tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:15:18.503800 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-9fed0930-5d49-4614-8e27-774ea4a808bd tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:15:18.504531 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-9fed0930-5d49-4614-8e27-774ea4a808bd tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:15:18.659243 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-9fed0930-5d49-4614-8e27-774ea4a808bd tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:15:18.668266 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-9fed0930-5d49-4614-8e27-774ea4a808bd tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:15:18.670037 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-9fed0930-5d49-4614-8e27-774ea4a808bd tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:15:18.671448 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-9fed0930-5d49-4614-8e27-774ea4a808bd tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] 10.222.0.23 "GET /compute/v2.1/servers/c3478cd4-e4ab-4a7d-9f4d-65323c450348" status: 200 len: 1739 microversion: 2.20 time: 0.183088 Oct 13 13:15:18.673004 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 333/679] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 13:15:18 2022] GET /compute/v2.1/servers/c3478cd4-e4ab-4a7d-9f4d-65323c450348 => generated 1739 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 13:15:18.797050 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-0fe2bf40-0fde-4dd5-8e9c-09c1e9908583 tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Calling method '>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:15:18.798368 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-0fe2bf40-0fde-4dd5-8e9c-09c1e9908583 tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] [instance: 5c481e0e-37eb-4457-813e-eb8a84932582] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:15:18.805323 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-0fe2bf40-0fde-4dd5-8e9c-09c1e9908583 tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:15:18.806023 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-0fe2bf40-0fde-4dd5-8e9c-09c1e9908583 tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:15:18.806464 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-0fe2bf40-0fde-4dd5-8e9c-09c1e9908583 tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:15:18.807198 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-0fe2bf40-0fde-4dd5-8e9c-09c1e9908583 tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:15:18.807656 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-0fe2bf40-0fde-4dd5-8e9c-09c1e9908583 tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:15:18.808081 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-0fe2bf40-0fde-4dd5-8e9c-09c1e9908583 tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:15:18.997941 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-0fe2bf40-0fde-4dd5-8e9c-09c1e9908583 tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6723d3c8aa144452b46564649cf38ee3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aff81c38c17b4e82864854ceac6587df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:15:19.007698 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-0fe2bf40-0fde-4dd5-8e9c-09c1e9908583 tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] 10.222.0.23 "GET /compute/v2.1/servers/5c481e0e-37eb-4457-813e-eb8a84932582" status: 200 len: 1259 microversion: 2.1 time: 0.214722 Oct 13 13:15:19.008870 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 347/680] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:15:18 2022] GET /compute/v2.1/servers/5c481e0e-37eb-4457-813e-eb8a84932582 => generated 1259 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:15:19.700016 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-5133f126-17d6-47dc-9e74-2e4de1a65c15 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Calling method '>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:15:19.701484 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-5133f126-17d6-47dc-9e74-2e4de1a65c15 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] [instance: c3478cd4-e4ab-4a7d-9f4d-65323c450348] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:15:19.709419 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-5133f126-17d6-47dc-9e74-2e4de1a65c15 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:15:19.709930 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-5133f126-17d6-47dc-9e74-2e4de1a65c15 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:15:19.710424 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-5133f126-17d6-47dc-9e74-2e4de1a65c15 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:15:19.711380 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-5133f126-17d6-47dc-9e74-2e4de1a65c15 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:15:19.712018 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-5133f126-17d6-47dc-9e74-2e4de1a65c15 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:15:19.712604 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-5133f126-17d6-47dc-9e74-2e4de1a65c15 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:15:19.867998 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-5133f126-17d6-47dc-9e74-2e4de1a65c15 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:15:19.877898 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-5133f126-17d6-47dc-9e74-2e4de1a65c15 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:15:19.879510 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-5133f126-17d6-47dc-9e74-2e4de1a65c15 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:15:19.880958 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-5133f126-17d6-47dc-9e74-2e4de1a65c15 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] 10.222.0.23 "GET /compute/v2.1/servers/c3478cd4-e4ab-4a7d-9f4d-65323c450348" status: 200 len: 1739 microversion: 2.20 time: 0.186977 Oct 13 13:15:19.881736 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 334/681] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 13:15:19 2022] GET /compute/v2.1/servers/c3478cd4-e4ab-4a7d-9f4d-65323c450348 => generated 1739 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 13:15:20.038816 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-61e62d42-b2c2-4f43-bcba-f0810a930f35 tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Calling method '>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:15:20.039608 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-61e62d42-b2c2-4f43-bcba-f0810a930f35 tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] [instance: 5c481e0e-37eb-4457-813e-eb8a84932582] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:15:20.049917 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-61e62d42-b2c2-4f43-bcba-f0810a930f35 tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:15:20.050398 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-61e62d42-b2c2-4f43-bcba-f0810a930f35 tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:15:20.051027 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-61e62d42-b2c2-4f43-bcba-f0810a930f35 tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:15:20.051933 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-61e62d42-b2c2-4f43-bcba-f0810a930f35 tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:15:20.052640 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-61e62d42-b2c2-4f43-bcba-f0810a930f35 tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:15:20.053062 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-61e62d42-b2c2-4f43-bcba-f0810a930f35 tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:15:20.223648 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-61e62d42-b2c2-4f43-bcba-f0810a930f35 tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6723d3c8aa144452b46564649cf38ee3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aff81c38c17b4e82864854ceac6587df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:15:20.233818 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-61e62d42-b2c2-4f43-bcba-f0810a930f35 tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] 10.222.0.23 "GET /compute/v2.1/servers/5c481e0e-37eb-4457-813e-eb8a84932582" status: 200 len: 1259 microversion: 2.1 time: 0.201556 Oct 13 13:15:20.234601 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 348/682] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:15:20 2022] GET /compute/v2.1/servers/5c481e0e-37eb-4457-813e-eb8a84932582 => generated 1259 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:15:20.822973 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-2a87db82-6c63-47fc-b0fb-7f91eb6b835e tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Calling method '>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:15:20.823509 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-2a87db82-6c63-47fc-b0fb-7f91eb6b835e tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] [instance: 2aa89397-329a-494c-8b4b-fa7e513d3171] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:15:20.831572 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-2a87db82-6c63-47fc-b0fb-7f91eb6b835e tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:15:20.832448 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-2a87db82-6c63-47fc-b0fb-7f91eb6b835e tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:15:20.832894 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-2a87db82-6c63-47fc-b0fb-7f91eb6b835e tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:15:20.833615 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-2a87db82-6c63-47fc-b0fb-7f91eb6b835e tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:15:20.834073 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-2a87db82-6c63-47fc-b0fb-7f91eb6b835e tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:15:20.834502 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-2a87db82-6c63-47fc-b0fb-7f91eb6b835e tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:15:20.864498 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-2a87db82-6c63-47fc-b0fb-7f91eb6b835e tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] 10.222.0.23 "GET /compute/v2.1/servers/2aa89397-329a-494c-8b4b-fa7e513d3171/ips" status: 200 len: 147 microversion: 2.1 time: 0.376631 Oct 13 13:15:20.865785 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 335/683] 10.222.0.23 () {58 vars in 1248 bytes} [Thu Oct 13 13:15:20 2022] GET /compute/v2.1/servers/2aa89397-329a-494c-8b4b-fa7e513d3171/ips => generated 147 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 13:15:20.908298 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-ea41cdb4-7b7e-459a-8410-cd536884166a tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Calling method '>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:15:20.909157 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-ea41cdb4-7b7e-459a-8410-cd536884166a tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] [instance: c3478cd4-e4ab-4a7d-9f4d-65323c450348] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:15:20.926763 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-ea41cdb4-7b7e-459a-8410-cd536884166a tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:15:20.927493 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-ea41cdb4-7b7e-459a-8410-cd536884166a tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:15:20.928102 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-ea41cdb4-7b7e-459a-8410-cd536884166a tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:15:20.928999 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-ea41cdb4-7b7e-459a-8410-cd536884166a tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:15:20.929463 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-ea41cdb4-7b7e-459a-8410-cd536884166a tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:15:20.929894 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-ea41cdb4-7b7e-459a-8410-cd536884166a tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:15:21.145949 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-ea41cdb4-7b7e-459a-8410-cd536884166a tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:15:21.159284 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-ea41cdb4-7b7e-459a-8410-cd536884166a tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:15:21.161957 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-ea41cdb4-7b7e-459a-8410-cd536884166a tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:15:21.163323 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-ea41cdb4-7b7e-459a-8410-cd536884166a tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] 10.222.0.23 "GET /compute/v2.1/servers/c3478cd4-e4ab-4a7d-9f4d-65323c450348" status: 200 len: 1739 microversion: 2.20 time: 0.259367 Oct 13 13:15:21.179855 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 349/684] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 13:15:20 2022] GET /compute/v2.1/servers/c3478cd4-e4ab-4a7d-9f4d-65323c450348 => generated 1739 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 13:15:21.256956 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-8aa7456d-985b-42da-b000-960ab6eba47e tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Calling method '>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:15:21.258087 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-8aa7456d-985b-42da-b000-960ab6eba47e tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] [instance: 5c481e0e-37eb-4457-813e-eb8a84932582] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:15:21.269561 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-8aa7456d-985b-42da-b000-960ab6eba47e tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:15:21.270472 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-8aa7456d-985b-42da-b000-960ab6eba47e tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:15:21.272705 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-8aa7456d-985b-42da-b000-960ab6eba47e tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:15:21.273621 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-8aa7456d-985b-42da-b000-960ab6eba47e tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:15:21.276555 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-8aa7456d-985b-42da-b000-960ab6eba47e tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:15:21.277169 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-8aa7456d-985b-42da-b000-960ab6eba47e tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:15:21.468959 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-8aa7456d-985b-42da-b000-960ab6eba47e tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6723d3c8aa144452b46564649cf38ee3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aff81c38c17b4e82864854ceac6587df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:15:21.478876 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-8aa7456d-985b-42da-b000-960ab6eba47e tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] 10.222.0.23 "GET /compute/v2.1/servers/5c481e0e-37eb-4457-813e-eb8a84932582" status: 200 len: 1259 microversion: 2.1 time: 0.225800 Oct 13 13:15:21.479497 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 336/685] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:15:21 2022] GET /compute/v2.1/servers/5c481e0e-37eb-4457-813e-eb8a84932582 => generated 1259 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:15:22.191418 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-8b810762-93dd-4711-8968-9d6aa73310b9 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Calling method '>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:15:22.192743 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-8b810762-93dd-4711-8968-9d6aa73310b9 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] [instance: c3478cd4-e4ab-4a7d-9f4d-65323c450348] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:15:22.199787 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-8b810762-93dd-4711-8968-9d6aa73310b9 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:15:22.201585 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-8b810762-93dd-4711-8968-9d6aa73310b9 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:15:22.202255 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-8b810762-93dd-4711-8968-9d6aa73310b9 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:15:22.203398 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-8b810762-93dd-4711-8968-9d6aa73310b9 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:15:22.204252 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-8b810762-93dd-4711-8968-9d6aa73310b9 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:15:22.204868 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-8b810762-93dd-4711-8968-9d6aa73310b9 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:15:22.372826 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-8b810762-93dd-4711-8968-9d6aa73310b9 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:15:22.382888 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-8b810762-93dd-4711-8968-9d6aa73310b9 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:15:22.384519 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-8b810762-93dd-4711-8968-9d6aa73310b9 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:15:22.385940 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-8b810762-93dd-4711-8968-9d6aa73310b9 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] 10.222.0.23 "GET /compute/v2.1/servers/c3478cd4-e4ab-4a7d-9f4d-65323c450348" status: 200 len: 1739 microversion: 2.20 time: 0.198900 Oct 13 13:15:22.399085 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 350/686] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 13:15:22 2022] GET /compute/v2.1/servers/c3478cd4-e4ab-4a7d-9f4d-65323c450348 => generated 1739 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 13:15:22.425908 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-ff6c4a1c-e192-4758-ae42-ac0a8625cffa tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d3c3c539-229e-4b11-9dcd-305163fc9b31"}} {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 13:15:22.429617 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-ff6c4a1c-e192-4758-ae42-ac0a8625cffa tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] [instance: 2aa89397-329a-494c-8b4b-fa7e513d3171] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:15:22.436274 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-ff6c4a1c-e192-4758-ae42-ac0a8625cffa tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:15:22.436811 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-ff6c4a1c-e192-4758-ae42-ac0a8625cffa tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:15:22.437252 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-ff6c4a1c-e192-4758-ae42-ac0a8625cffa tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:15:22.437956 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-ff6c4a1c-e192-4758-ae42-ac0a8625cffa tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:15:22.438415 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-ff6c4a1c-e192-4758-ae42-ac0a8625cffa tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:15:22.438847 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-ff6c4a1c-e192-4758-ae42-ac0a8625cffa tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:15:22.511220 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-95618a0c-f4d2-4036-9716-1cb6cf08040d tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Calling method '>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:15:22.512021 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-95618a0c-f4d2-4036-9716-1cb6cf08040d tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] [instance: 5c481e0e-37eb-4457-813e-eb8a84932582] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:15:22.525391 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-95618a0c-f4d2-4036-9716-1cb6cf08040d tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:15:22.525943 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-95618a0c-f4d2-4036-9716-1cb6cf08040d tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:15:22.526438 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-95618a0c-f4d2-4036-9716-1cb6cf08040d tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:15:22.527321 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-95618a0c-f4d2-4036-9716-1cb6cf08040d tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:15:22.527921 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-95618a0c-f4d2-4036-9716-1cb6cf08040d tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:15:22.528491 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-95618a0c-f4d2-4036-9716-1cb6cf08040d tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:15:22.788083 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-95618a0c-f4d2-4036-9716-1cb6cf08040d tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6723d3c8aa144452b46564649cf38ee3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aff81c38c17b4e82864854ceac6587df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:15:22.798477 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-95618a0c-f4d2-4036-9716-1cb6cf08040d tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] 10.222.0.23 "GET /compute/v2.1/servers/5c481e0e-37eb-4457-813e-eb8a84932582" status: 200 len: 1259 microversion: 2.1 time: 0.297475 Oct 13 13:15:22.800543 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 351/687] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:15:22 2022] GET /compute/v2.1/servers/5c481e0e-37eb-4457-813e-eb8a84932582 => generated 1259 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:15:22.828974 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-ff6c4a1c-e192-4758-ae42-ac0a8625cffa tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] 10.222.0.23 "POST /compute/v2.1/servers/2aa89397-329a-494c-8b4b-fa7e513d3171/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.407489 Oct 13 13:15:22.831707 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 337/688] 10.222.0.23 () {60 vars in 1323 bytes} [Thu Oct 13 13:15:22 2022] POST /compute/v2.1/servers/2aa89397-329a-494c-8b4b-fa7e513d3171/os-volume_attachments => generated 194 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 13:15:23.417160 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-fb7214f4-a3e8-4334-be7a-2300216b8c10 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Calling method '>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:15:23.418058 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-fb7214f4-a3e8-4334-be7a-2300216b8c10 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] [instance: c3478cd4-e4ab-4a7d-9f4d-65323c450348] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:15:23.429458 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-fb7214f4-a3e8-4334-be7a-2300216b8c10 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:15:23.431370 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-fb7214f4-a3e8-4334-be7a-2300216b8c10 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:15:23.432215 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-fb7214f4-a3e8-4334-be7a-2300216b8c10 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:15:23.433668 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-fb7214f4-a3e8-4334-be7a-2300216b8c10 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:15:23.434322 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-fb7214f4-a3e8-4334-be7a-2300216b8c10 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:15:23.435450 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-fb7214f4-a3e8-4334-be7a-2300216b8c10 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:15:23.679827 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-fb7214f4-a3e8-4334-be7a-2300216b8c10 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:15:23.690225 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-fb7214f4-a3e8-4334-be7a-2300216b8c10 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:15:23.691681 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-fb7214f4-a3e8-4334-be7a-2300216b8c10 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:15:23.693619 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-fb7214f4-a3e8-4334-be7a-2300216b8c10 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] 10.222.0.23 "GET /compute/v2.1/servers/c3478cd4-e4ab-4a7d-9f4d-65323c450348" status: 200 len: 1739 microversion: 2.20 time: 0.281451 Oct 13 13:15:23.696219 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 352/689] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 13:15:23 2022] GET /compute/v2.1/servers/c3478cd4-e4ab-4a7d-9f4d-65323c450348 => generated 1739 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 13:15:23.827310 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-0521e139-399c-42da-8eef-d1e936c069ac tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Calling method '>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:15:23.828775 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-0521e139-399c-42da-8eef-d1e936c069ac tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] [instance: 5c481e0e-37eb-4457-813e-eb8a84932582] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:15:23.836118 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-0521e139-399c-42da-8eef-d1e936c069ac tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:15:23.837065 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-0521e139-399c-42da-8eef-d1e936c069ac tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:15:23.837751 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-0521e139-399c-42da-8eef-d1e936c069ac tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:15:23.839502 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-0521e139-399c-42da-8eef-d1e936c069ac tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:15:23.840197 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-0521e139-399c-42da-8eef-d1e936c069ac tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:15:23.841195 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-0521e139-399c-42da-8eef-d1e936c069ac tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:15:24.026175 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG dbcounter [-] [118815] Writing DB stats nova_cell0:SELECT=2 {{(pid=118815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:15:24.049138 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-0521e139-399c-42da-8eef-d1e936c069ac tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6723d3c8aa144452b46564649cf38ee3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aff81c38c17b4e82864854ceac6587df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:15:24.059733 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-0521e139-399c-42da-8eef-d1e936c069ac tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] 10.222.0.23 "GET /compute/v2.1/servers/5c481e0e-37eb-4457-813e-eb8a84932582" status: 200 len: 1259 microversion: 2.1 time: 0.238088 Oct 13 13:15:24.077661 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 338/690] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:15:23 2022] GET /compute/v2.1/servers/5c481e0e-37eb-4457-813e-eb8a84932582 => generated 1259 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:15:24.724819 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-0feed8c0-1571-45ed-9702-e34a2926b280 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Calling method '>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:15:24.726858 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-0feed8c0-1571-45ed-9702-e34a2926b280 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] [instance: c3478cd4-e4ab-4a7d-9f4d-65323c450348] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:15:24.729359 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG dbcounter [-] [118814] Writing DB stats nova_cell0:SELECT=2 {{(pid=118814) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:15:24.730202 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG dbcounter [-] [118814] Writing DB stats nova_cell0:SELECT=6 {{(pid=118814) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:15:24.737336 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-0feed8c0-1571-45ed-9702-e34a2926b280 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:15:24.737822 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-0feed8c0-1571-45ed-9702-e34a2926b280 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:15:24.738435 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-0feed8c0-1571-45ed-9702-e34a2926b280 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:15:24.739159 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-0feed8c0-1571-45ed-9702-e34a2926b280 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:15:24.739614 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-0feed8c0-1571-45ed-9702-e34a2926b280 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:15:24.740035 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-0feed8c0-1571-45ed-9702-e34a2926b280 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:15:24.888066 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-0feed8c0-1571-45ed-9702-e34a2926b280 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:15:24.897886 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-0feed8c0-1571-45ed-9702-e34a2926b280 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:15:24.899851 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-0feed8c0-1571-45ed-9702-e34a2926b280 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:15:24.901565 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-0feed8c0-1571-45ed-9702-e34a2926b280 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] 10.222.0.23 "GET /compute/v2.1/servers/c3478cd4-e4ab-4a7d-9f4d-65323c450348" status: 200 len: 1739 microversion: 2.20 time: 0.181722 Oct 13 13:15:24.902317 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 353/691] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 13:15:24 2022] GET /compute/v2.1/servers/c3478cd4-e4ab-4a7d-9f4d-65323c450348 => generated 1739 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 13 13:15:25.086213 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-89b4aaf3-18db-4ff1-b852-6774aa573fca tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Calling method '>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:15:25.087121 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-89b4aaf3-18db-4ff1-b852-6774aa573fca tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] [instance: 5c481e0e-37eb-4457-813e-eb8a84932582] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:15:25.094866 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-89b4aaf3-18db-4ff1-b852-6774aa573fca tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:15:25.095960 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-89b4aaf3-18db-4ff1-b852-6774aa573fca tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:15:25.096808 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-89b4aaf3-18db-4ff1-b852-6774aa573fca tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:15:25.098207 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-89b4aaf3-18db-4ff1-b852-6774aa573fca tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:15:25.098907 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-89b4aaf3-18db-4ff1-b852-6774aa573fca tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:15:25.099587 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-89b4aaf3-18db-4ff1-b852-6774aa573fca tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:15:25.260871 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-89b4aaf3-18db-4ff1-b852-6774aa573fca tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6723d3c8aa144452b46564649cf38ee3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aff81c38c17b4e82864854ceac6587df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:15:25.270058 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-89b4aaf3-18db-4ff1-b852-6774aa573fca tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] 10.222.0.23 "GET /compute/v2.1/servers/5c481e0e-37eb-4457-813e-eb8a84932582" status: 200 len: 1259 microversion: 2.1 time: 0.188114 Oct 13 13:15:25.270866 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 339/692] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:15:25 2022] GET /compute/v2.1/servers/5c481e0e-37eb-4457-813e-eb8a84932582 => generated 1259 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 13:15:25.533767 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-54b89a20-b6fe-4c29-a2d6-d389ceba6021 tempest-VolumesActionsTest-194871335 tempest-VolumesActionsTest-194871335-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1298475427", "imageRef": "e2cdd20b-2540-48bc-a05c-d6a2e7e9a66e", "flavorRef": "452", "networks": [{"uuid": "fa9f61a0-af15-4e66-81ab-796b27386471"}]}} {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 13:15:25.594969 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.network.neutron [None req-54b89a20-b6fe-4c29-a2d6-d389ceba6021 tempest-VolumesActionsTest-194871335 tempest-VolumesActionsTest-194871335-project] validate_networks() for [('fa9f61a0-af15-4e66-81ab-796b27386471', None, None, None, None, None)] {{(pid=118814) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 13 13:15:25.930836 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-24e23b62-eab2-4a06-94c9-37c039a733e9 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Calling method '>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:15:25.931544 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-24e23b62-eab2-4a06-94c9-37c039a733e9 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] [instance: c3478cd4-e4ab-4a7d-9f4d-65323c450348] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:15:25.938651 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-24e23b62-eab2-4a06-94c9-37c039a733e9 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:15:25.939164 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-24e23b62-eab2-4a06-94c9-37c039a733e9 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:15:25.939600 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-24e23b62-eab2-4a06-94c9-37c039a733e9 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:15:25.940291 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-24e23b62-eab2-4a06-94c9-37c039a733e9 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:15:25.941195 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-24e23b62-eab2-4a06-94c9-37c039a733e9 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:15:25.941784 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-24e23b62-eab2-4a06-94c9-37c039a733e9 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:15:26.114643 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.virt.hardware [None req-54b89a20-b6fe-4c29-a2d6-d389ceba6021 tempest-VolumesActionsTest-194871335 tempest-VolumesActionsTest-194871335-project] Flavor limits 0:0:0 {{(pid=118814) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 13 13:15:26.116946 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.virt.hardware [None req-54b89a20-b6fe-4c29-a2d6-d389ceba6021 tempest-VolumesActionsTest-194871335 tempest-VolumesActionsTest-194871335-project] Image limits 0:0:0 {{(pid=118814) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 13 13:15:26.116946 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.virt.hardware [None req-54b89a20-b6fe-4c29-a2d6-d389ceba6021 tempest-VolumesActionsTest-194871335 tempest-VolumesActionsTest-194871335-project] Flavor pref 0:0:0 {{(pid=118814) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 13 13:15:26.116946 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.virt.hardware [None req-54b89a20-b6fe-4c29-a2d6-d389ceba6021 tempest-VolumesActionsTest-194871335 tempest-VolumesActionsTest-194871335-project] Image pref 0:0:0 {{(pid=118814) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 13 13:15:26.116946 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.virt.hardware [None req-54b89a20-b6fe-4c29-a2d6-d389ceba6021 tempest-VolumesActionsTest-194871335 tempest-VolumesActionsTest-194871335-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118814) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 13 13:15:26.131458 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-54b89a20-b6fe-4c29-a2d6-d389ceba6021 tempest-VolumesActionsTest-194871335 tempest-VolumesActionsTest-194871335-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:15:26.132922 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-54b89a20-b6fe-4c29-a2d6-d389ceba6021 tempest-VolumesActionsTest-194871335 tempest-VolumesActionsTest-194871335-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:15:26.133707 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-54b89a20-b6fe-4c29-a2d6-d389ceba6021 tempest-VolumesActionsTest-194871335 tempest-VolumesActionsTest-194871335-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:15:26.134706 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-54b89a20-b6fe-4c29-a2d6-d389ceba6021 tempest-VolumesActionsTest-194871335 tempest-VolumesActionsTest-194871335-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:15:26.135530 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-54b89a20-b6fe-4c29-a2d6-d389ceba6021 tempest-VolumesActionsTest-194871335 tempest-VolumesActionsTest-194871335-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:15:26.136288 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-54b89a20-b6fe-4c29-a2d6-d389ceba6021 tempest-VolumesActionsTest-194871335 tempest-VolumesActionsTest-194871335-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:15:26.159014 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.quota [None req-54b89a20-b6fe-4c29-a2d6-d389ceba6021 tempest-VolumesActionsTest-194871335 tempest-VolumesActionsTest-194871335-project] Getting quotas for project 12163a99662b48759b3fd7da51445ecf. Resources: {'instances', 'cores', 'ram'} {{(pid=118814) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 13 13:15:26.160155 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-24e23b62-eab2-4a06-94c9-37c039a733e9 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:15:26.165096 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.quota [None req-54b89a20-b6fe-4c29-a2d6-d389ceba6021 tempest-VolumesActionsTest-194871335 tempest-VolumesActionsTest-194871335-project] Getting quotas for user 18920ad97e6946df9689bd6d4abd50b0 and project 12163a99662b48759b3fd7da51445ecf. Resources: {'instances', 'cores', 'ram'} {{(pid=118814) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 13 13:15:26.169345 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-24e23b62-eab2-4a06-94c9-37c039a733e9 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:15:26.171358 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-24e23b62-eab2-4a06-94c9-37c039a733e9 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:15:26.172856 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-24e23b62-eab2-4a06-94c9-37c039a733e9 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] 10.222.0.23 "GET /compute/v2.1/servers/c3478cd4-e4ab-4a7d-9f4d-65323c450348" status: 200 len: 1739 microversion: 2.20 time: 0.248411 Oct 13 13:15:26.174049 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 340/693] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 13:15:25 2022] GET /compute/v2.1/servers/c3478cd4-e4ab-4a7d-9f4d-65323c450348 => generated 1739 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 13:15:26.179189 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-54b89a20-b6fe-4c29-a2d6-d389ceba6021 tempest-VolumesActionsTest-194871335 tempest-VolumesActionsTest-194871335-project] Going to run 1 instances... {{(pid=118814) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 13 13:15:26.182856 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-54b89a20-b6fe-4c29-a2d6-d389ceba6021 tempest-VolumesActionsTest-194871335 tempest-VolumesActionsTest-194871335-project] [instance: 8496d8ca-0305-4d1e-ab85-3ab7bd3ed9c6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e2cdd20b-2540-48bc-a05c-d6a2e7e9a66e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118814) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 13 13:15:26.248117 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-54b89a20-b6fe-4c29-a2d6-d389ceba6021 tempest-VolumesActionsTest-194871335 tempest-VolumesActionsTest-194871335-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.718072 Oct 13 13:15:26.248781 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 354/694] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Oct 13 13:15:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 720 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 13 13:15:26.259854 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-6326036c-8bc0-47a2-9ab1-70c53c035d4f tempest-VolumesActionsTest-194871335 tempest-VolumesActionsTest-194871335-project] Calling method '>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:15:26.261816 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-6326036c-8bc0-47a2-9ab1-70c53c035d4f tempest-VolumesActionsTest-194871335 tempest-VolumesActionsTest-194871335-project] [instance: 8496d8ca-0305-4d1e-ab85-3ab7bd3ed9c6] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:15:26.292246 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-a7be07dc-65dc-49aa-9fbc-92980a4a6f56 tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Calling method '>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:15:26.292885 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-a7be07dc-65dc-49aa-9fbc-92980a4a6f56 tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] [instance: 5c481e0e-37eb-4457-813e-eb8a84932582] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:15:26.313897 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-a7be07dc-65dc-49aa-9fbc-92980a4a6f56 tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:15:26.320207 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-a7be07dc-65dc-49aa-9fbc-92980a4a6f56 tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:15:26.324729 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-6326036c-8bc0-47a2-9ab1-70c53c035d4f tempest-VolumesActionsTest-194871335 tempest-VolumesActionsTest-194871335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18920ad97e6946df9689bd6d4abd50b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12163a99662b48759b3fd7da51445ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:15:26.327400 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-a7be07dc-65dc-49aa-9fbc-92980a4a6f56 tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:15:26.328210 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-a7be07dc-65dc-49aa-9fbc-92980a4a6f56 tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:15:26.328849 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-a7be07dc-65dc-49aa-9fbc-92980a4a6f56 tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:15:26.329294 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-a7be07dc-65dc-49aa-9fbc-92980a4a6f56 tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:15:26.333373 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-6326036c-8bc0-47a2-9ab1-70c53c035d4f tempest-VolumesActionsTest-194871335 tempest-VolumesActionsTest-194871335-project] 10.222.0.23 "GET /compute/v2.1/servers/8496d8ca-0305-4d1e-ab85-3ab7bd3ed9c6" status: 200 len: 1214 microversion: 2.1 time: 0.076245 Oct 13 13:15:26.334371 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 341/695] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:15:26 2022] GET /compute/v2.1/servers/8496d8ca-0305-4d1e-ab85-3ab7bd3ed9c6 => generated 1214 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 13:15:26.535337 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-a7be07dc-65dc-49aa-9fbc-92980a4a6f56 tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6723d3c8aa144452b46564649cf38ee3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aff81c38c17b4e82864854ceac6587df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:15:26.544729 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-a7be07dc-65dc-49aa-9fbc-92980a4a6f56 tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] 10.222.0.23 "GET /compute/v2.1/servers/5c481e0e-37eb-4457-813e-eb8a84932582" status: 200 len: 1259 microversion: 2.1 time: 0.256212 Oct 13 13:15:26.551563 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 355/696] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:15:26 2022] GET /compute/v2.1/servers/5c481e0e-37eb-4457-813e-eb8a84932582 => generated 1259 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 13:15:27.202028 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-71f024e1-94c0-4eae-977f-cb4c0a36deec tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Calling method '>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:15:27.202568 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-71f024e1-94c0-4eae-977f-cb4c0a36deec tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] [instance: c3478cd4-e4ab-4a7d-9f4d-65323c450348] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:15:27.208890 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-71f024e1-94c0-4eae-977f-cb4c0a36deec tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:15:27.209372 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-71f024e1-94c0-4eae-977f-cb4c0a36deec tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:15:27.209805 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-71f024e1-94c0-4eae-977f-cb4c0a36deec tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:15:27.210518 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-71f024e1-94c0-4eae-977f-cb4c0a36deec tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:15:27.210977 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-71f024e1-94c0-4eae-977f-cb4c0a36deec tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:15:27.211563 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-71f024e1-94c0-4eae-977f-cb4c0a36deec tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:15:27.355776 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-71f024e1-94c0-4eae-977f-cb4c0a36deec tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:15:27.363566 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-677a367b-be81-4c78-ba64-67dff0ae8879 tempest-VolumesActionsTest-194871335 tempest-VolumesActionsTest-194871335-project] Calling method '>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:15:27.364774 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-677a367b-be81-4c78-ba64-67dff0ae8879 tempest-VolumesActionsTest-194871335 tempest-VolumesActionsTest-194871335-project] [instance: 8496d8ca-0305-4d1e-ab85-3ab7bd3ed9c6] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:15:27.365202 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-71f024e1-94c0-4eae-977f-cb4c0a36deec tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:15:27.366650 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-71f024e1-94c0-4eae-977f-cb4c0a36deec tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:15:27.367839 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-71f024e1-94c0-4eae-977f-cb4c0a36deec tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] 10.222.0.23 "GET /compute/v2.1/servers/c3478cd4-e4ab-4a7d-9f4d-65323c450348" status: 200 len: 1739 microversion: 2.20 time: 0.169724 Oct 13 13:15:27.368707 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 342/697] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 13:15:27 2022] GET /compute/v2.1/servers/c3478cd4-e4ab-4a7d-9f4d-65323c450348 => generated 1739 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 13:15:27.375168 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-677a367b-be81-4c78-ba64-67dff0ae8879 tempest-VolumesActionsTest-194871335 tempest-VolumesActionsTest-194871335-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:15:27.375656 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-677a367b-be81-4c78-ba64-67dff0ae8879 tempest-VolumesActionsTest-194871335 tempest-VolumesActionsTest-194871335-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:15:27.376090 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-677a367b-be81-4c78-ba64-67dff0ae8879 tempest-VolumesActionsTest-194871335 tempest-VolumesActionsTest-194871335-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:15:27.376789 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-677a367b-be81-4c78-ba64-67dff0ae8879 tempest-VolumesActionsTest-194871335 tempest-VolumesActionsTest-194871335-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:15:27.377308 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-677a367b-be81-4c78-ba64-67dff0ae8879 tempest-VolumesActionsTest-194871335 tempest-VolumesActionsTest-194871335-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:15:27.377916 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-677a367b-be81-4c78-ba64-67dff0ae8879 tempest-VolumesActionsTest-194871335 tempest-VolumesActionsTest-194871335-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:15:27.444703 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-677a367b-be81-4c78-ba64-67dff0ae8879 tempest-VolumesActionsTest-194871335 tempest-VolumesActionsTest-194871335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18920ad97e6946df9689bd6d4abd50b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12163a99662b48759b3fd7da51445ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:15:27.448171 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG dbcounter [-] [118814] Writing DB stats nova_cell1:SELECT=100 {{(pid=118814) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:15:27.453250 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-677a367b-be81-4c78-ba64-67dff0ae8879 tempest-VolumesActionsTest-194871335 tempest-VolumesActionsTest-194871335-project] 10.222.0.23 "GET /compute/v2.1/servers/8496d8ca-0305-4d1e-ab85-3ab7bd3ed9c6" status: 200 len: 1266 microversion: 2.1 time: 0.099252 Oct 13 13:15:27.453754 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 356/698] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:15:27 2022] GET /compute/v2.1/servers/8496d8ca-0305-4d1e-ab85-3ab7bd3ed9c6 => generated 1266 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:15:27.508209 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [req-711f5a38-a95f-41e7-b15e-e33497043bd6 req-acb779ff-eba0-4973-9748-68e0c1eca0ba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5c481e0e-37eb-4457-813e-eb8a84932582", "name": "network-vif-plugged", "status": "completed", "tag": "386e505c-fee6-4a1d-9fa8-236b241cf782"}]} {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 13:15:27.519473 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [req-711f5a38-a95f-41e7-b15e-e33497043bd6 req-acb779ff-eba0-4973-9748-68e0c1eca0ba service nova] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:15:27.519956 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [req-711f5a38-a95f-41e7-b15e-e33497043bd6 req-acb779ff-eba0-4973-9748-68e0c1eca0ba service nova] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:15:27.520532 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [req-711f5a38-a95f-41e7-b15e-e33497043bd6 req-acb779ff-eba0-4973-9748-68e0c1eca0ba service nova] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:15:27.533100 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.compute.server_external_events [req-711f5a38-a95f-41e7-b15e-e33497043bd6 req-acb779ff-eba0-4973-9748-68e0c1eca0ba service nova] Creating event network-vif-plugged:386e505c-fee6-4a1d-9fa8-236b241cf782 for instance 5c481e0e-37eb-4457-813e-eb8a84932582 on hv-cinder-82660 Oct 13 13:15:27.538280 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [req-711f5a38-a95f-41e7-b15e-e33497043bd6 req-acb779ff-eba0-4973-9748-68e0c1eca0ba service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034174 Oct 13 13:15:27.538861 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 343/699] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 13:15:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 13:15:27.570574 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-31135e1a-a36c-4a4a-a3c1-dd468b5769ec tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Calling method '>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:15:27.571598 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-31135e1a-a36c-4a4a-a3c1-dd468b5769ec tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] [instance: 5c481e0e-37eb-4457-813e-eb8a84932582] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:15:27.588721 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-31135e1a-a36c-4a4a-a3c1-dd468b5769ec tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:15:27.589531 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-31135e1a-a36c-4a4a-a3c1-dd468b5769ec tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:15:27.590188 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-31135e1a-a36c-4a4a-a3c1-dd468b5769ec tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:15:27.591080 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-31135e1a-a36c-4a4a-a3c1-dd468b5769ec tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:15:27.592062 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-31135e1a-a36c-4a4a-a3c1-dd468b5769ec tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:15:27.592555 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-31135e1a-a36c-4a4a-a3c1-dd468b5769ec tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:15:27.738988 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-31135e1a-a36c-4a4a-a3c1-dd468b5769ec tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6723d3c8aa144452b46564649cf38ee3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aff81c38c17b4e82864854ceac6587df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:15:27.747415 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-31135e1a-a36c-4a4a-a3c1-dd468b5769ec tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] 10.222.0.23 "GET /compute/v2.1/servers/5c481e0e-37eb-4457-813e-eb8a84932582" status: 200 len: 1259 microversion: 2.1 time: 0.181301 Oct 13 13:15:27.747997 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 357/700] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:15:27 2022] GET /compute/v2.1/servers/5c481e0e-37eb-4457-813e-eb8a84932582 => generated 1259 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:15:28.394828 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-b75cf089-f9e5-419c-ac4d-4231841ce2db tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Calling method '>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:15:28.395679 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-b75cf089-f9e5-419c-ac4d-4231841ce2db tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] [instance: c3478cd4-e4ab-4a7d-9f4d-65323c450348] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:15:28.402278 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-b75cf089-f9e5-419c-ac4d-4231841ce2db tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:15:28.402699 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-b75cf089-f9e5-419c-ac4d-4231841ce2db tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:15:28.403159 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-b75cf089-f9e5-419c-ac4d-4231841ce2db tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:15:28.404345 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-b75cf089-f9e5-419c-ac4d-4231841ce2db tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:15:28.404798 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-b75cf089-f9e5-419c-ac4d-4231841ce2db tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:15:28.405218 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-b75cf089-f9e5-419c-ac4d-4231841ce2db tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:15:28.477330 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-9978273c-e97f-40cb-9b5c-296366efc332 tempest-VolumesActionsTest-194871335 tempest-VolumesActionsTest-194871335-project] Calling method '>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:15:28.477951 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-9978273c-e97f-40cb-9b5c-296366efc332 tempest-VolumesActionsTest-194871335 tempest-VolumesActionsTest-194871335-project] [instance: 8496d8ca-0305-4d1e-ab85-3ab7bd3ed9c6] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:15:28.485353 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-9978273c-e97f-40cb-9b5c-296366efc332 tempest-VolumesActionsTest-194871335 tempest-VolumesActionsTest-194871335-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:15:28.485848 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-9978273c-e97f-40cb-9b5c-296366efc332 tempest-VolumesActionsTest-194871335 tempest-VolumesActionsTest-194871335-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:15:28.486286 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-9978273c-e97f-40cb-9b5c-296366efc332 tempest-VolumesActionsTest-194871335 tempest-VolumesActionsTest-194871335-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:15:28.486989 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-9978273c-e97f-40cb-9b5c-296366efc332 tempest-VolumesActionsTest-194871335 tempest-VolumesActionsTest-194871335-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:15:28.487475 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-9978273c-e97f-40cb-9b5c-296366efc332 tempest-VolumesActionsTest-194871335 tempest-VolumesActionsTest-194871335-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:15:28.487905 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-9978273c-e97f-40cb-9b5c-296366efc332 tempest-VolumesActionsTest-194871335 tempest-VolumesActionsTest-194871335-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:15:28.561950 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-9978273c-e97f-40cb-9b5c-296366efc332 tempest-VolumesActionsTest-194871335 tempest-VolumesActionsTest-194871335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18920ad97e6946df9689bd6d4abd50b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12163a99662b48759b3fd7da51445ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:15:28.566097 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-b75cf089-f9e5-419c-ac4d-4231841ce2db tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:15:28.568988 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG dbcounter [-] [118815] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:15:28.571096 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-9978273c-e97f-40cb-9b5c-296366efc332 tempest-VolumesActionsTest-194871335 tempest-VolumesActionsTest-194871335-project] 10.222.0.23 "GET /compute/v2.1/servers/8496d8ca-0305-4d1e-ab85-3ab7bd3ed9c6" status: 200 len: 1272 microversion: 2.1 time: 0.098290 Oct 13 13:15:28.572603 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 358/701] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:15:28 2022] GET /compute/v2.1/servers/8496d8ca-0305-4d1e-ab85-3ab7bd3ed9c6 => generated 1272 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:15:28.585878 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-b75cf089-f9e5-419c-ac4d-4231841ce2db tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:15:28.587939 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-b75cf089-f9e5-419c-ac4d-4231841ce2db tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:15:28.590913 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-b75cf089-f9e5-419c-ac4d-4231841ce2db tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] 10.222.0.23 "GET /compute/v2.1/servers/c3478cd4-e4ab-4a7d-9f4d-65323c450348" status: 200 len: 1721 microversion: 2.20 time: 0.199686 Oct 13 13:15:28.592343 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 344/702] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 13:15:28 2022] GET /compute/v2.1/servers/c3478cd4-e4ab-4a7d-9f4d-65323c450348 => generated 1721 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 13:15:28.769746 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-89f625b1-5ee5-469e-ad68-bc2f5123078e tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Calling method '>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:15:28.770363 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-89f625b1-5ee5-469e-ad68-bc2f5123078e tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] [instance: 5c481e0e-37eb-4457-813e-eb8a84932582] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:15:28.776259 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-89f625b1-5ee5-469e-ad68-bc2f5123078e tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:15:28.776746 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-89f625b1-5ee5-469e-ad68-bc2f5123078e tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:15:28.777181 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-89f625b1-5ee5-469e-ad68-bc2f5123078e tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:15:28.777870 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-89f625b1-5ee5-469e-ad68-bc2f5123078e tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:15:28.778320 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-89f625b1-5ee5-469e-ad68-bc2f5123078e tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:15:28.778738 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-89f625b1-5ee5-469e-ad68-bc2f5123078e tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:15:28.923022 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-89f625b1-5ee5-469e-ad68-bc2f5123078e tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6723d3c8aa144452b46564649cf38ee3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aff81c38c17b4e82864854ceac6587df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:15:28.932038 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-89f625b1-5ee5-469e-ad68-bc2f5123078e tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] 10.222.0.23 "GET /compute/v2.1/servers/5c481e0e-37eb-4457-813e-eb8a84932582" status: 200 len: 1259 microversion: 2.1 time: 0.166133 Oct 13 13:15:28.932629 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 359/703] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:15:28 2022] GET /compute/v2.1/servers/5c481e0e-37eb-4457-813e-eb8a84932582 => generated 1259 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:15:29.594964 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-1b7dff19-c0af-4a50-8a0f-dfdc9c7bc272 tempest-VolumesActionsTest-194871335 tempest-VolumesActionsTest-194871335-project] Calling method '>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:15:29.595607 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-1b7dff19-c0af-4a50-8a0f-dfdc9c7bc272 tempest-VolumesActionsTest-194871335 tempest-VolumesActionsTest-194871335-project] [instance: 8496d8ca-0305-4d1e-ab85-3ab7bd3ed9c6] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:15:29.602799 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-1b7dff19-c0af-4a50-8a0f-dfdc9c7bc272 tempest-VolumesActionsTest-194871335 tempest-VolumesActionsTest-194871335-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:15:29.603313 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-1b7dff19-c0af-4a50-8a0f-dfdc9c7bc272 tempest-VolumesActionsTest-194871335 tempest-VolumesActionsTest-194871335-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:15:29.603755 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-1b7dff19-c0af-4a50-8a0f-dfdc9c7bc272 tempest-VolumesActionsTest-194871335 tempest-VolumesActionsTest-194871335-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:15:29.604444 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-1b7dff19-c0af-4a50-8a0f-dfdc9c7bc272 tempest-VolumesActionsTest-194871335 tempest-VolumesActionsTest-194871335-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:15:29.604902 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-1b7dff19-c0af-4a50-8a0f-dfdc9c7bc272 tempest-VolumesActionsTest-194871335 tempest-VolumesActionsTest-194871335-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:15:29.605328 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-1b7dff19-c0af-4a50-8a0f-dfdc9c7bc272 tempest-VolumesActionsTest-194871335 tempest-VolumesActionsTest-194871335-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:15:29.617668 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-a582ea14-a760-4504-999e-a0046dec64ec tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Calling method '>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:15:29.618279 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-a582ea14-a760-4504-999e-a0046dec64ec tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] [instance: c3478cd4-e4ab-4a7d-9f4d-65323c450348] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:15:29.624541 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-a582ea14-a760-4504-999e-a0046dec64ec tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:15:29.625020 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-a582ea14-a760-4504-999e-a0046dec64ec tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:15:29.625454 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-a582ea14-a760-4504-999e-a0046dec64ec tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:15:29.626138 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-a582ea14-a760-4504-999e-a0046dec64ec tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:15:29.626590 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-a582ea14-a760-4504-999e-a0046dec64ec tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:15:29.627013 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-a582ea14-a760-4504-999e-a0046dec64ec tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:15:29.798426 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-1b7dff19-c0af-4a50-8a0f-dfdc9c7bc272 tempest-VolumesActionsTest-194871335 tempest-VolumesActionsTest-194871335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18920ad97e6946df9689bd6d4abd50b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12163a99662b48759b3fd7da51445ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:15:29.805315 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-a582ea14-a760-4504-999e-a0046dec64ec tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:15:29.806417 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-1b7dff19-c0af-4a50-8a0f-dfdc9c7bc272 tempest-VolumesActionsTest-194871335 tempest-VolumesActionsTest-194871335-project] 10.222.0.23 "GET /compute/v2.1/servers/8496d8ca-0305-4d1e-ab85-3ab7bd3ed9c6" status: 200 len: 1314 microversion: 2.1 time: 0.216205 Oct 13 13:15:29.806986 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 345/704] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:15:29 2022] GET /compute/v2.1/servers/8496d8ca-0305-4d1e-ab85-3ab7bd3ed9c6 => generated 1314 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:15:29.813975 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-a582ea14-a760-4504-999e-a0046dec64ec tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:15:29.815453 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-a582ea14-a760-4504-999e-a0046dec64ec tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:15:29.816661 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-a582ea14-a760-4504-999e-a0046dec64ec tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] 10.222.0.23 "GET /compute/v2.1/servers/c3478cd4-e4ab-4a7d-9f4d-65323c450348" status: 200 len: 1721 microversion: 2.20 time: 0.202881 Oct 13 13:15:29.817212 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 360/705] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 13:15:29 2022] GET /compute/v2.1/servers/c3478cd4-e4ab-4a7d-9f4d-65323c450348 => generated 1721 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 13 13:15:29.955851 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-2dda2063-833b-4029-bcda-aa896c3ccb7b tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Calling method '>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:15:29.956454 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-2dda2063-833b-4029-bcda-aa896c3ccb7b tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] [instance: 5c481e0e-37eb-4457-813e-eb8a84932582] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:15:29.962264 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-2dda2063-833b-4029-bcda-aa896c3ccb7b tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:15:29.962740 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-2dda2063-833b-4029-bcda-aa896c3ccb7b tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:15:29.963192 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-2dda2063-833b-4029-bcda-aa896c3ccb7b tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:15:29.963868 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-2dda2063-833b-4029-bcda-aa896c3ccb7b tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:15:29.964314 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-2dda2063-833b-4029-bcda-aa896c3ccb7b tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:15:29.964728 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-2dda2063-833b-4029-bcda-aa896c3ccb7b tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:15:30.096901 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-2dda2063-833b-4029-bcda-aa896c3ccb7b tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6723d3c8aa144452b46564649cf38ee3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aff81c38c17b4e82864854ceac6587df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:15:30.104513 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-2dda2063-833b-4029-bcda-aa896c3ccb7b tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] 10.222.0.23 "GET /compute/v2.1/servers/5c481e0e-37eb-4457-813e-eb8a84932582" status: 200 len: 1443 microversion: 2.1 time: 0.152604 Oct 13 13:15:30.105074 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 346/706] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:15:29 2022] GET /compute/v2.1/servers/5c481e0e-37eb-4457-813e-eb8a84932582 => generated 1443 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:15:30.127211 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-9e6c291c-6b7b-4681-a63e-2dc4ae7e2ef8 tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Calling method '>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:15:30.127852 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-9e6c291c-6b7b-4681-a63e-2dc4ae7e2ef8 tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] [instance: 5c481e0e-37eb-4457-813e-eb8a84932582] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:15:30.133772 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-9e6c291c-6b7b-4681-a63e-2dc4ae7e2ef8 tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:15:30.134256 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-9e6c291c-6b7b-4681-a63e-2dc4ae7e2ef8 tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:15:30.134698 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-9e6c291c-6b7b-4681-a63e-2dc4ae7e2ef8 tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:15:30.135403 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-9e6c291c-6b7b-4681-a63e-2dc4ae7e2ef8 tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:15:30.135855 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-9e6c291c-6b7b-4681-a63e-2dc4ae7e2ef8 tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:15:30.136280 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-9e6c291c-6b7b-4681-a63e-2dc4ae7e2ef8 tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:15:30.266730 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-9e6c291c-6b7b-4681-a63e-2dc4ae7e2ef8 tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6723d3c8aa144452b46564649cf38ee3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aff81c38c17b4e82864854ceac6587df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:15:30.274456 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-9e6c291c-6b7b-4681-a63e-2dc4ae7e2ef8 tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] 10.222.0.23 "GET /compute/v2.1/servers/5c481e0e-37eb-4457-813e-eb8a84932582" status: 200 len: 1443 microversion: 2.1 time: 0.151812 Oct 13 13:15:30.275017 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 361/707] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:15:30 2022] GET /compute/v2.1/servers/5c481e0e-37eb-4457-813e-eb8a84932582 => generated 1443 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:15:30.832203 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-bc799865-bbe3-44e2-b5aa-145b9272698f tempest-VolumesActionsTest-194871335 tempest-VolumesActionsTest-194871335-project] Calling method '>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:15:30.833107 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-bc799865-bbe3-44e2-b5aa-145b9272698f tempest-VolumesActionsTest-194871335 tempest-VolumesActionsTest-194871335-project] [instance: 8496d8ca-0305-4d1e-ab85-3ab7bd3ed9c6] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:15:30.844211 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-fe9ecc2a-31ae-4b00-a4c6-2a64240a3fa3 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Calling method '>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:15:30.844978 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-fe9ecc2a-31ae-4b00-a4c6-2a64240a3fa3 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] [instance: c3478cd4-e4ab-4a7d-9f4d-65323c450348] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:15:30.859504 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-fe9ecc2a-31ae-4b00-a4c6-2a64240a3fa3 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:15:30.860140 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-fe9ecc2a-31ae-4b00-a4c6-2a64240a3fa3 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:15:30.860607 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-bc799865-bbe3-44e2-b5aa-145b9272698f tempest-VolumesActionsTest-194871335 tempest-VolumesActionsTest-194871335-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:15:30.862100 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-fe9ecc2a-31ae-4b00-a4c6-2a64240a3fa3 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:15:30.862323 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-bc799865-bbe3-44e2-b5aa-145b9272698f tempest-VolumesActionsTest-194871335 tempest-VolumesActionsTest-194871335-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:15:30.863119 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-bc799865-bbe3-44e2-b5aa-145b9272698f tempest-VolumesActionsTest-194871335 tempest-VolumesActionsTest-194871335-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:15:30.863954 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-fe9ecc2a-31ae-4b00-a4c6-2a64240a3fa3 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:15:30.864770 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-bc799865-bbe3-44e2-b5aa-145b9272698f tempest-VolumesActionsTest-194871335 tempest-VolumesActionsTest-194871335-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:15:30.865373 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-fe9ecc2a-31ae-4b00-a4c6-2a64240a3fa3 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:15:30.866005 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-bc799865-bbe3-44e2-b5aa-145b9272698f tempest-VolumesActionsTest-194871335 tempest-VolumesActionsTest-194871335-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:15:30.866719 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-fe9ecc2a-31ae-4b00-a4c6-2a64240a3fa3 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:15:30.868569 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-bc799865-bbe3-44e2-b5aa-145b9272698f tempest-VolumesActionsTest-194871335 tempest-VolumesActionsTest-194871335-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:15:31.254705 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-bc799865-bbe3-44e2-b5aa-145b9272698f tempest-VolumesActionsTest-194871335 tempest-VolumesActionsTest-194871335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18920ad97e6946df9689bd6d4abd50b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12163a99662b48759b3fd7da51445ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:15:31.266385 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-bc799865-bbe3-44e2-b5aa-145b9272698f tempest-VolumesActionsTest-194871335 tempest-VolumesActionsTest-194871335-project] 10.222.0.23 "GET /compute/v2.1/servers/8496d8ca-0305-4d1e-ab85-3ab7bd3ed9c6" status: 200 len: 1314 microversion: 2.1 time: 0.440727 Oct 13 13:15:31.281921 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-fe9ecc2a-31ae-4b00-a4c6-2a64240a3fa3 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:15:31.282700 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 347/708] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:15:30 2022] GET /compute/v2.1/servers/8496d8ca-0305-4d1e-ab85-3ab7bd3ed9c6 => generated 1314 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:15:31.288796 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-fe9ecc2a-31ae-4b00-a4c6-2a64240a3fa3 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:15:31.290358 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-fe9ecc2a-31ae-4b00-a4c6-2a64240a3fa3 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:15:31.292103 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-fe9ecc2a-31ae-4b00-a4c6-2a64240a3fa3 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] 10.222.0.23 "GET /compute/v2.1/servers/c3478cd4-e4ab-4a7d-9f4d-65323c450348" status: 200 len: 1721 microversion: 2.20 time: 0.453227 Oct 13 13:15:31.292777 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 362/709] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 13:15:30 2022] GET /compute/v2.1/servers/c3478cd4-e4ab-4a7d-9f4d-65323c450348 => generated 1721 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 13 13:15:31.544900 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [req-fd9bb08f-d421-4601-a321-38df4eca0055 req-4e96262d-9959-4a07-8082-cc6d5d5aac7b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8496d8ca-0305-4d1e-ab85-3ab7bd3ed9c6", "tag": "62044e46-f508-4225-9482-992ecc2140b1"}]} {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 13:15:31.561678 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [req-fd9bb08f-d421-4601-a321-38df4eca0055 req-4e96262d-9959-4a07-8082-cc6d5d5aac7b service nova] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:15:31.562369 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [req-fd9bb08f-d421-4601-a321-38df4eca0055 req-4e96262d-9959-4a07-8082-cc6d5d5aac7b service nova] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:15:31.563102 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [req-fd9bb08f-d421-4601-a321-38df4eca0055 req-4e96262d-9959-4a07-8082-cc6d5d5aac7b service nova] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:15:31.578065 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.compute.server_external_events [req-fd9bb08f-d421-4601-a321-38df4eca0055 req-4e96262d-9959-4a07-8082-cc6d5d5aac7b service nova] Creating event network-changed:62044e46-f508-4225-9482-992ecc2140b1 for instance 8496d8ca-0305-4d1e-ab85-3ab7bd3ed9c6 on hv-cinder-82660 Oct 13 13:15:31.583159 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [req-fd9bb08f-d421-4601-a321-38df4eca0055 req-4e96262d-9959-4a07-8082-cc6d5d5aac7b service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.248136 Oct 13 13:15:31.584286 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 348/710] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 13:15:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 13:15:31.604204 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [req-baf06c37-8d24-48d6-836a-1bcc1553279b req-cc158882-f85a-4954-b56d-504d74f7b9ff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c3478cd4-e4ab-4a7d-9f4d-65323c450348", "name": "network-vif-unplugged", "status": "completed", "tag": "ff57ee79-9921-43ed-817d-5ba082c97343"}]} {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 13:15:31.627113 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [req-baf06c37-8d24-48d6-836a-1bcc1553279b req-cc158882-f85a-4954-b56d-504d74f7b9ff service nova] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:15:31.627113 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [req-baf06c37-8d24-48d6-836a-1bcc1553279b req-cc158882-f85a-4954-b56d-504d74f7b9ff service nova] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:15:31.627113 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [req-baf06c37-8d24-48d6-836a-1bcc1553279b req-cc158882-f85a-4954-b56d-504d74f7b9ff service nova] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:15:31.640345 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-1dd1375c-2702-4a7a-833b-8b768a799189 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Calling method '>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:15:31.643196 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-1dd1375c-2702-4a7a-833b-8b768a799189 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] [instance: 2aa89397-329a-494c-8b4b-fa7e513d3171] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:15:31.644088 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.compute.server_external_events [req-baf06c37-8d24-48d6-836a-1bcc1553279b req-cc158882-f85a-4954-b56d-504d74f7b9ff service nova] Creating event network-vif-unplugged:ff57ee79-9921-43ed-817d-5ba082c97343 for instance c3478cd4-e4ab-4a7d-9f4d-65323c450348 on hv-cinder-82660 Oct 13 13:15:31.650408 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [req-baf06c37-8d24-48d6-836a-1bcc1553279b req-cc158882-f85a-4954-b56d-504d74f7b9ff service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.052588 Oct 13 13:15:31.651182 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 363/711] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 13:15:31 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 13:15:31.652284 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-1dd1375c-2702-4a7a-833b-8b768a799189 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:15:31.652905 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-1dd1375c-2702-4a7a-833b-8b768a799189 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:15:31.653513 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-1dd1375c-2702-4a7a-833b-8b768a799189 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:15:31.654359 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-1dd1375c-2702-4a7a-833b-8b768a799189 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:15:31.654700 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-1dd1375c-2702-4a7a-833b-8b768a799189 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:15:31.655154 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-1dd1375c-2702-4a7a-833b-8b768a799189 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:15:31.689298 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-1dd1375c-2702-4a7a-833b-8b768a799189 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] 10.222.0.23 "GET /compute/v2.1/servers/2aa89397-329a-494c-8b4b-fa7e513d3171/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053965 Oct 13 13:15:31.689861 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 349/712] 10.222.0.23 () {58 vars in 1302 bytes} [Thu Oct 13 13:15:31 2022] GET /compute/v2.1/servers/2aa89397-329a-494c-8b4b-fa7e513d3171/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 13 13:15:31.701309 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-fae67d1a-355d-4f72-9341-02a738bec23d tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Calling method '>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:15:31.701886 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-fae67d1a-355d-4f72-9341-02a738bec23d tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] [instance: 2aa89397-329a-494c-8b4b-fa7e513d3171] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:15:31.709034 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-fae67d1a-355d-4f72-9341-02a738bec23d tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:15:31.709782 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-fae67d1a-355d-4f72-9341-02a738bec23d tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:15:31.710215 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-fae67d1a-355d-4f72-9341-02a738bec23d tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:15:31.710904 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-fae67d1a-355d-4f72-9341-02a738bec23d tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:15:31.711385 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-fae67d1a-355d-4f72-9341-02a738bec23d tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:15:31.711820 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-fae67d1a-355d-4f72-9341-02a738bec23d tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:15:31.742827 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-fae67d1a-355d-4f72-9341-02a738bec23d tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] 10.222.0.23 "GET /compute/v2.1/servers/2aa89397-329a-494c-8b4b-fa7e513d3171/os-volume_attachments/d3c3c539-229e-4b11-9dcd-305163fc9b31" status: 200 len: 194 microversion: 2.1 time: 0.045846 Oct 13 13:15:31.743911 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 364/713] 10.222.0.23 () {58 vars in 1413 bytes} [Thu Oct 13 13:15:31 2022] GET /compute/v2.1/servers/2aa89397-329a-494c-8b4b-fa7e513d3171/os-volume_attachments/d3c3c539-229e-4b11-9dcd-305163fc9b31 => generated 194 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 13:15:32.289872 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-de519749-b9e6-4b62-b93c-f7fa3a161f73 tempest-VolumesActionsTest-194871335 tempest-VolumesActionsTest-194871335-project] Calling method '>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:15:32.290483 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-de519749-b9e6-4b62-b93c-f7fa3a161f73 tempest-VolumesActionsTest-194871335 tempest-VolumesActionsTest-194871335-project] [instance: 8496d8ca-0305-4d1e-ab85-3ab7bd3ed9c6] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:15:32.298180 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-de519749-b9e6-4b62-b93c-f7fa3a161f73 tempest-VolumesActionsTest-194871335 tempest-VolumesActionsTest-194871335-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:15:32.298653 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-de519749-b9e6-4b62-b93c-f7fa3a161f73 tempest-VolumesActionsTest-194871335 tempest-VolumesActionsTest-194871335-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:15:32.299610 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-de519749-b9e6-4b62-b93c-f7fa3a161f73 tempest-VolumesActionsTest-194871335 tempest-VolumesActionsTest-194871335-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:15:32.300320 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-de519749-b9e6-4b62-b93c-f7fa3a161f73 tempest-VolumesActionsTest-194871335 tempest-VolumesActionsTest-194871335-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:15:32.300778 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-de519749-b9e6-4b62-b93c-f7fa3a161f73 tempest-VolumesActionsTest-194871335 tempest-VolumesActionsTest-194871335-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:15:32.301208 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-de519749-b9e6-4b62-b93c-f7fa3a161f73 tempest-VolumesActionsTest-194871335 tempest-VolumesActionsTest-194871335-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:15:32.323928 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-698c699c-d657-499c-a48f-afce4b739038 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Calling method '>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:15:32.324676 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-698c699c-d657-499c-a48f-afce4b739038 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] [instance: c3478cd4-e4ab-4a7d-9f4d-65323c450348] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:15:32.332349 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-698c699c-d657-499c-a48f-afce4b739038 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:15:32.332981 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-698c699c-d657-499c-a48f-afce4b739038 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:15:32.333673 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-698c699c-d657-499c-a48f-afce4b739038 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:15:32.334453 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-698c699c-d657-499c-a48f-afce4b739038 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:15:32.335102 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-698c699c-d657-499c-a48f-afce4b739038 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:15:32.335540 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-698c699c-d657-499c-a48f-afce4b739038 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:15:32.768323 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-de519749-b9e6-4b62-b93c-f7fa3a161f73 tempest-VolumesActionsTest-194871335 tempest-VolumesActionsTest-194871335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18920ad97e6946df9689bd6d4abd50b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12163a99662b48759b3fd7da51445ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:15:32.772841 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-698c699c-d657-499c-a48f-afce4b739038 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:15:32.787823 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-698c699c-d657-499c-a48f-afce4b739038 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:15:32.789506 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-698c699c-d657-499c-a48f-afce4b739038 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:15:32.791724 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-de519749-b9e6-4b62-b93c-f7fa3a161f73 tempest-VolumesActionsTest-194871335 tempest-VolumesActionsTest-194871335-project] 10.222.0.23 "GET /compute/v2.1/servers/8496d8ca-0305-4d1e-ab85-3ab7bd3ed9c6" status: 200 len: 1314 microversion: 2.1 time: 0.505272 Oct 13 13:15:32.792345 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 350/714] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:15:32 2022] GET /compute/v2.1/servers/8496d8ca-0305-4d1e-ab85-3ab7bd3ed9c6 => generated 1314 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:15:32.803893 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-698c699c-d657-499c-a48f-afce4b739038 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] 10.222.0.23 "GET /compute/v2.1/servers/c3478cd4-e4ab-4a7d-9f4d-65323c450348" status: 200 len: 1664 microversion: 2.20 time: 0.477401 Oct 13 13:15:32.804837 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 365/715] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 13:15:32 2022] GET /compute/v2.1/servers/c3478cd4-e4ab-4a7d-9f4d-65323c450348 => generated 1664 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 13:15:32.835018 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-8a74702d-79b7-45d6-911a-344a6b430934 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a378e42a-164c-4c79-bd0b-7c5d452b638d"}} {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 13:15:32.837346 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-8a74702d-79b7-45d6-911a-344a6b430934 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] [instance: c3478cd4-e4ab-4a7d-9f4d-65323c450348] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:15:32.843390 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-8a74702d-79b7-45d6-911a-344a6b430934 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:15:32.844068 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-8a74702d-79b7-45d6-911a-344a6b430934 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:15:32.844663 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-8a74702d-79b7-45d6-911a-344a6b430934 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:15:32.845510 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-8a74702d-79b7-45d6-911a-344a6b430934 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:15:32.846105 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-8a74702d-79b7-45d6-911a-344a6b430934 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:15:32.846674 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-8a74702d-79b7-45d6-911a-344a6b430934 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:15:32.864207 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [req-cc493fe2-9d24-43c3-a129-388c37b67962 req-28f0715a-23c4-4bf2-b5c3-6dfac7c1729c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5c481e0e-37eb-4457-813e-eb8a84932582", "tag": "386e505c-fee6-4a1d-9fa8-236b241cf782"}]} {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 13:15:32.877692 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [req-cc493fe2-9d24-43c3-a129-388c37b67962 req-28f0715a-23c4-4bf2-b5c3-6dfac7c1729c service nova] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:15:32.878178 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [req-cc493fe2-9d24-43c3-a129-388c37b67962 req-28f0715a-23c4-4bf2-b5c3-6dfac7c1729c service nova] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:15:32.878611 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [req-cc493fe2-9d24-43c3-a129-388c37b67962 req-28f0715a-23c4-4bf2-b5c3-6dfac7c1729c service nova] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:15:32.891528 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.compute.server_external_events [req-cc493fe2-9d24-43c3-a129-388c37b67962 req-28f0715a-23c4-4bf2-b5c3-6dfac7c1729c service nova] Creating event network-changed:386e505c-fee6-4a1d-9fa8-236b241cf782 for instance 5c481e0e-37eb-4457-813e-eb8a84932582 on hv-cinder-82660 Oct 13 13:15:32.896884 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [req-cc493fe2-9d24-43c3-a129-388c37b67962 req-28f0715a-23c4-4bf2-b5c3-6dfac7c1729c service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.103090 Oct 13 13:15:32.900578 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 351/716] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 13:15:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 13:15:33.163188 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-922e105e-82fd-4b3d-8f3c-8d5a35266d02 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "917f300f-8779-444d-86a1-dcf92eed66f2"}} {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 13:15:33.165887 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-922e105e-82fd-4b3d-8f3c-8d5a35266d02 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] [instance: 2aa89397-329a-494c-8b4b-fa7e513d3171] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:15:33.173802 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-922e105e-82fd-4b3d-8f3c-8d5a35266d02 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:15:33.174874 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-922e105e-82fd-4b3d-8f3c-8d5a35266d02 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:15:33.175579 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-922e105e-82fd-4b3d-8f3c-8d5a35266d02 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:15:33.176518 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-922e105e-82fd-4b3d-8f3c-8d5a35266d02 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:15:33.177215 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-922e105e-82fd-4b3d-8f3c-8d5a35266d02 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:15:33.177846 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-922e105e-82fd-4b3d-8f3c-8d5a35266d02 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:15:33.208210 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-8a74702d-79b7-45d6-911a-344a6b430934 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] 10.222.0.23 "POST /compute/v2.1/servers/c3478cd4-e4ab-4a7d-9f4d-65323c450348/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.377055 Oct 13 13:15:33.209211 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 366/717] 10.222.0.23 () {62 vars in 1364 bytes} [Thu Oct 13 13:15:32 2022] POST /compute/v2.1/servers/c3478cd4-e4ab-4a7d-9f4d-65323c450348/os-volume_attachments => generated 188 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 13 13:15:33.404719 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-64ac9947-6ad5-48b1-ba34-be03f434bb67 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Calling method '>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:15:33.405998 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-64ac9947-6ad5-48b1-ba34-be03f434bb67 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] [instance: c3478cd4-e4ab-4a7d-9f4d-65323c450348] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:15:33.414601 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-64ac9947-6ad5-48b1-ba34-be03f434bb67 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:15:33.415481 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-64ac9947-6ad5-48b1-ba34-be03f434bb67 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:15:33.416214 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-64ac9947-6ad5-48b1-ba34-be03f434bb67 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:15:33.417218 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-64ac9947-6ad5-48b1-ba34-be03f434bb67 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:15:33.417890 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-64ac9947-6ad5-48b1-ba34-be03f434bb67 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:15:33.418576 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-64ac9947-6ad5-48b1-ba34-be03f434bb67 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:15:33.491484 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-922e105e-82fd-4b3d-8f3c-8d5a35266d02 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] 10.222.0.23 "POST /compute/v2.1/servers/2aa89397-329a-494c-8b4b-fa7e513d3171/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.331496 Oct 13 13:15:33.493499 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 352/718] 10.222.0.23 () {60 vars in 1323 bytes} [Thu Oct 13 13:15:33 2022] POST /compute/v2.1/servers/2aa89397-329a-494c-8b4b-fa7e513d3171/os-volume_attachments => generated 194 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 13 13:15:33.751764 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-64ac9947-6ad5-48b1-ba34-be03f434bb67 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] 10.222.0.23 "DELETE /compute/v2.1/servers/c3478cd4-e4ab-4a7d-9f4d-65323c450348/os-volume_attachments/a378e42a-164c-4c79-bd0b-7c5d452b638d" status: 202 len: 0 microversion: 2.20 time: 0.357943 Oct 13 13:15:33.752498 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 367/719] 10.222.0.23 () {60 vars in 1457 bytes} [Thu Oct 13 13:15:33 2022] DELETE /compute/v2.1/servers/c3478cd4-e4ab-4a7d-9f4d-65323c450348/os-volume_attachments/a378e42a-164c-4c79-bd0b-7c5d452b638d => generated 0 bytes in 360 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Oct 13 13:15:33.816451 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-799f7331-021a-4043-83a7-4b9c711535b5 tempest-VolumesActionsTest-194871335 tempest-VolumesActionsTest-194871335-project] Calling method '>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:15:33.817141 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-799f7331-021a-4043-83a7-4b9c711535b5 tempest-VolumesActionsTest-194871335 tempest-VolumesActionsTest-194871335-project] [instance: 8496d8ca-0305-4d1e-ab85-3ab7bd3ed9c6] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:15:33.825839 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-618f9133-7507-4efa-a5ca-adb13061e33c tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 13:15:33.826088 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-799f7331-021a-4043-83a7-4b9c711535b5 tempest-VolumesActionsTest-194871335 tempest-VolumesActionsTest-194871335-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:15:33.826629 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-799f7331-021a-4043-83a7-4b9c711535b5 tempest-VolumesActionsTest-194871335 tempest-VolumesActionsTest-194871335-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:15:33.827098 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-799f7331-021a-4043-83a7-4b9c711535b5 tempest-VolumesActionsTest-194871335 tempest-VolumesActionsTest-194871335-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:15:33.827491 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-618f9133-7507-4efa-a5ca-adb13061e33c tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] [instance: c3478cd4-e4ab-4a7d-9f4d-65323c450348] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:15:33.827798 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-799f7331-021a-4043-83a7-4b9c711535b5 tempest-VolumesActionsTest-194871335 tempest-VolumesActionsTest-194871335-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:15:33.828293 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-799f7331-021a-4043-83a7-4b9c711535b5 tempest-VolumesActionsTest-194871335 tempest-VolumesActionsTest-194871335-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:15:33.828717 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-799f7331-021a-4043-83a7-4b9c711535b5 tempest-VolumesActionsTest-194871335 tempest-VolumesActionsTest-194871335-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:15:33.835238 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-618f9133-7507-4efa-a5ca-adb13061e33c tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:15:33.836086 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-618f9133-7507-4efa-a5ca-adb13061e33c tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:15:33.836742 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-618f9133-7507-4efa-a5ca-adb13061e33c tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:15:33.838307 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-618f9133-7507-4efa-a5ca-adb13061e33c tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:15:33.838987 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-618f9133-7507-4efa-a5ca-adb13061e33c tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:15:33.839676 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-618f9133-7507-4efa-a5ca-adb13061e33c tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:15:33.877752 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-618f9133-7507-4efa-a5ca-adb13061e33c tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] [instance: c3478cd4-e4ab-4a7d-9f4d-65323c450348] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=118814) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 13 13:15:33.944316 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG dbcounter [-] [118814] Writing DB stats nova_cell1:SELECT=87,nova_cell1:INSERT=5,nova_cell1:UPDATE=8 {{(pid=118814) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:15:34.000043 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-618f9133-7507-4efa-a5ca-adb13061e33c tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] 10.222.0.23 "POST /compute/v2.1/servers/c3478cd4-e4ab-4a7d-9f4d-65323c450348/action" status: 202 len: 0 microversion: 2.20 time: 0.179052 Oct 13 13:15:34.003146 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 368/720] 10.222.0.23 () {62 vars in 1319 bytes} [Thu Oct 13 13:15:33 2022] POST /compute/v2.1/servers/c3478cd4-e4ab-4a7d-9f4d-65323c450348/action => generated 0 bytes in 181 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 13 13:15:34.010226 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-35629eaa-24b9-411d-9ea2-358a54e22023 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Calling method '>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:15:34.010854 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-35629eaa-24b9-411d-9ea2-358a54e22023 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] [instance: c3478cd4-e4ab-4a7d-9f4d-65323c450348] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:15:34.018175 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-35629eaa-24b9-411d-9ea2-358a54e22023 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:15:34.018852 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-35629eaa-24b9-411d-9ea2-358a54e22023 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:15:34.019966 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-35629eaa-24b9-411d-9ea2-358a54e22023 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:15:34.020727 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-35629eaa-24b9-411d-9ea2-358a54e22023 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:15:34.021186 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-35629eaa-24b9-411d-9ea2-358a54e22023 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:15:34.021611 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-35629eaa-24b9-411d-9ea2-358a54e22023 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:15:34.045206 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-799f7331-021a-4043-83a7-4b9c711535b5 tempest-VolumesActionsTest-194871335 tempest-VolumesActionsTest-194871335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18920ad97e6946df9689bd6d4abd50b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12163a99662b48759b3fd7da51445ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:15:34.057375 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-799f7331-021a-4043-83a7-4b9c711535b5 tempest-VolumesActionsTest-194871335 tempest-VolumesActionsTest-194871335-project] 10.222.0.23 "GET /compute/v2.1/servers/8496d8ca-0305-4d1e-ab85-3ab7bd3ed9c6" status: 200 len: 1314 microversion: 2.1 time: 0.244981 Oct 13 13:15:34.057942 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 353/721] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:15:33 2022] GET /compute/v2.1/servers/8496d8ca-0305-4d1e-ab85-3ab7bd3ed9c6 => generated 1314 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:15:34.207400 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-35629eaa-24b9-411d-9ea2-358a54e22023 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:15:34.218563 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-35629eaa-24b9-411d-9ea2-358a54e22023 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:15:34.220658 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-35629eaa-24b9-411d-9ea2-358a54e22023 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:15:34.222163 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-35629eaa-24b9-411d-9ea2-358a54e22023 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] 10.222.0.23 "GET /compute/v2.1/servers/c3478cd4-e4ab-4a7d-9f4d-65323c450348" status: 200 len: 1672 microversion: 2.20 time: 0.217092 Oct 13 13:15:34.240731 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 369/722] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 13:15:34 2022] GET /compute/v2.1/servers/c3478cd4-e4ab-4a7d-9f4d-65323c450348 => generated 1672 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 13 13:15:35.082019 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-ee705868-c45d-4826-8eec-71c662218855 tempest-VolumesActionsTest-194871335 tempest-VolumesActionsTest-194871335-project] Calling method '>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:15:35.082665 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-ee705868-c45d-4826-8eec-71c662218855 tempest-VolumesActionsTest-194871335 tempest-VolumesActionsTest-194871335-project] [instance: 8496d8ca-0305-4d1e-ab85-3ab7bd3ed9c6] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:15:35.089077 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-ee705868-c45d-4826-8eec-71c662218855 tempest-VolumesActionsTest-194871335 tempest-VolumesActionsTest-194871335-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:15:35.089566 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-ee705868-c45d-4826-8eec-71c662218855 tempest-VolumesActionsTest-194871335 tempest-VolumesActionsTest-194871335-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:15:35.090006 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-ee705868-c45d-4826-8eec-71c662218855 tempest-VolumesActionsTest-194871335 tempest-VolumesActionsTest-194871335-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:15:35.091315 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-ee705868-c45d-4826-8eec-71c662218855 tempest-VolumesActionsTest-194871335 tempest-VolumesActionsTest-194871335-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:15:35.091673 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-ee705868-c45d-4826-8eec-71c662218855 tempest-VolumesActionsTest-194871335 tempest-VolumesActionsTest-194871335-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:15:35.092223 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-ee705868-c45d-4826-8eec-71c662218855 tempest-VolumesActionsTest-194871335 tempest-VolumesActionsTest-194871335-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:15:35.223710 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-ee705868-c45d-4826-8eec-71c662218855 tempest-VolumesActionsTest-194871335 tempest-VolumesActionsTest-194871335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18920ad97e6946df9689bd6d4abd50b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12163a99662b48759b3fd7da51445ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:15:35.232209 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-ee705868-c45d-4826-8eec-71c662218855 tempest-VolumesActionsTest-194871335 tempest-VolumesActionsTest-194871335-project] 10.222.0.23 "GET /compute/v2.1/servers/8496d8ca-0305-4d1e-ab85-3ab7bd3ed9c6" status: 200 len: 1314 microversion: 2.1 time: 0.153296 Oct 13 13:15:35.232758 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 354/723] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:15:35 2022] GET /compute/v2.1/servers/8496d8ca-0305-4d1e-ab85-3ab7bd3ed9c6 => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:15:35.250950 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-4edbf1be-e1be-4cc5-b165-195e90ab3690 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Calling method '>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:15:35.251604 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-4edbf1be-e1be-4cc5-b165-195e90ab3690 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] [instance: c3478cd4-e4ab-4a7d-9f4d-65323c450348] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:15:35.258193 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-4edbf1be-e1be-4cc5-b165-195e90ab3690 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:15:35.258672 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-4edbf1be-e1be-4cc5-b165-195e90ab3690 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:15:35.259135 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-4edbf1be-e1be-4cc5-b165-195e90ab3690 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:15:35.259825 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-4edbf1be-e1be-4cc5-b165-195e90ab3690 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:15:35.260275 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-4edbf1be-e1be-4cc5-b165-195e90ab3690 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:15:35.260695 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-4edbf1be-e1be-4cc5-b165-195e90ab3690 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:15:35.397734 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-4edbf1be-e1be-4cc5-b165-195e90ab3690 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:15:35.406535 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-4edbf1be-e1be-4cc5-b165-195e90ab3690 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:15:35.408003 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-4edbf1be-e1be-4cc5-b165-195e90ab3690 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:15:35.409154 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-4edbf1be-e1be-4cc5-b165-195e90ab3690 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] 10.222.0.23 "GET /compute/v2.1/servers/c3478cd4-e4ab-4a7d-9f4d-65323c450348" status: 200 len: 1730 microversion: 2.20 time: 0.162769 Oct 13 13:15:35.409844 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 370/724] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 13:15:35 2022] GET /compute/v2.1/servers/c3478cd4-e4ab-4a7d-9f4d-65323c450348 => generated 1730 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 13:15:35.581333 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [req-1da3c2d4-b9a7-471c-a38f-beb8d8174596 req-cca1ef9b-f963-4bf0-9fa4-210c082d20db service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8496d8ca-0305-4d1e-ab85-3ab7bd3ed9c6", "name": "network-vif-plugged", "status": "completed", "tag": "62044e46-f508-4225-9482-992ecc2140b1"}]} {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 13:15:35.596370 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [req-1da3c2d4-b9a7-471c-a38f-beb8d8174596 req-cca1ef9b-f963-4bf0-9fa4-210c082d20db service nova] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:15:35.596854 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [req-1da3c2d4-b9a7-471c-a38f-beb8d8174596 req-cca1ef9b-f963-4bf0-9fa4-210c082d20db service nova] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:15:35.597290 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [req-1da3c2d4-b9a7-471c-a38f-beb8d8174596 req-cca1ef9b-f963-4bf0-9fa4-210c082d20db service nova] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:15:35.609530 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.compute.server_external_events [req-1da3c2d4-b9a7-471c-a38f-beb8d8174596 req-cca1ef9b-f963-4bf0-9fa4-210c082d20db service nova] Creating event network-vif-plugged:62044e46-f508-4225-9482-992ecc2140b1 for instance 8496d8ca-0305-4d1e-ab85-3ab7bd3ed9c6 on hv-cinder-82660 Oct 13 13:15:35.615548 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [req-1da3c2d4-b9a7-471c-a38f-beb8d8174596 req-cca1ef9b-f963-4bf0-9fa4-210c082d20db service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098209 Oct 13 13:15:35.616360 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 355/725] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 13:15:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 13:15:36.254958 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-ccee3efd-f564-4157-973d-5ddf71202d8a tempest-VolumesActionsTest-194871335 tempest-VolumesActionsTest-194871335-project] Calling method '>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:15:36.255593 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-ccee3efd-f564-4157-973d-5ddf71202d8a tempest-VolumesActionsTest-194871335 tempest-VolumesActionsTest-194871335-project] [instance: 8496d8ca-0305-4d1e-ab85-3ab7bd3ed9c6] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:15:36.257452 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG dbcounter [-] [118814] Writing DB stats nova_cell0:SELECT=2 {{(pid=118814) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:15:36.258097 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG dbcounter [-] [118814] Writing DB stats nova_cell0:SELECT=6 {{(pid=118814) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:15:36.264265 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-ccee3efd-f564-4157-973d-5ddf71202d8a tempest-VolumesActionsTest-194871335 tempest-VolumesActionsTest-194871335-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:15:36.264747 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-ccee3efd-f564-4157-973d-5ddf71202d8a tempest-VolumesActionsTest-194871335 tempest-VolumesActionsTest-194871335-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:15:36.265179 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-ccee3efd-f564-4157-973d-5ddf71202d8a tempest-VolumesActionsTest-194871335 tempest-VolumesActionsTest-194871335-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:15:36.265859 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-ccee3efd-f564-4157-973d-5ddf71202d8a tempest-VolumesActionsTest-194871335 tempest-VolumesActionsTest-194871335-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:15:36.266329 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-ccee3efd-f564-4157-973d-5ddf71202d8a tempest-VolumesActionsTest-194871335 tempest-VolumesActionsTest-194871335-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:15:36.266738 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-ccee3efd-f564-4157-973d-5ddf71202d8a tempest-VolumesActionsTest-194871335 tempest-VolumesActionsTest-194871335-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:15:36.393451 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-ccee3efd-f564-4157-973d-5ddf71202d8a tempest-VolumesActionsTest-194871335 tempest-VolumesActionsTest-194871335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18920ad97e6946df9689bd6d4abd50b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12163a99662b48759b3fd7da51445ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:15:36.401025 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-ccee3efd-f564-4157-973d-5ddf71202d8a tempest-VolumesActionsTest-194871335 tempest-VolumesActionsTest-194871335-project] 10.222.0.23 "GET /compute/v2.1/servers/8496d8ca-0305-4d1e-ab85-3ab7bd3ed9c6" status: 200 len: 1314 microversion: 2.1 time: 0.149958 Oct 13 13:15:36.401580 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 371/726] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:15:36 2022] GET /compute/v2.1/servers/8496d8ca-0305-4d1e-ab85-3ab7bd3ed9c6 => generated 1314 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:15:36.436946 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-5669115f-b98d-41e3-a7b9-3df12f82ede4 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Calling method '>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:15:36.437631 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-5669115f-b98d-41e3-a7b9-3df12f82ede4 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] [instance: c3478cd4-e4ab-4a7d-9f4d-65323c450348] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:15:36.439542 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG dbcounter [-] [118815] Writing DB stats nova_cell0:SELECT=2 {{(pid=118815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:15:36.444858 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-5669115f-b98d-41e3-a7b9-3df12f82ede4 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:15:36.445330 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-5669115f-b98d-41e3-a7b9-3df12f82ede4 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:15:36.445761 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-5669115f-b98d-41e3-a7b9-3df12f82ede4 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:15:36.446437 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-5669115f-b98d-41e3-a7b9-3df12f82ede4 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:15:36.446883 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-5669115f-b98d-41e3-a7b9-3df12f82ede4 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:15:36.447324 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-5669115f-b98d-41e3-a7b9-3df12f82ede4 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:15:36.576900 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-5669115f-b98d-41e3-a7b9-3df12f82ede4 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:15:36.584992 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-5669115f-b98d-41e3-a7b9-3df12f82ede4 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:15:36.586431 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-5669115f-b98d-41e3-a7b9-3df12f82ede4 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:15:36.587668 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-5669115f-b98d-41e3-a7b9-3df12f82ede4 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] 10.222.0.23 "GET /compute/v2.1/servers/c3478cd4-e4ab-4a7d-9f4d-65323c450348" status: 200 len: 1730 microversion: 2.20 time: 0.155472 Oct 13 13:15:36.588238 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 356/727] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 13:15:36 2022] GET /compute/v2.1/servers/c3478cd4-e4ab-4a7d-9f4d-65323c450348 => generated 1730 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 13:15:37.423465 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-b88d968e-d64c-4387-a25d-223230b90dfa tempest-VolumesActionsTest-194871335 tempest-VolumesActionsTest-194871335-project] Calling method '>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:15:37.424663 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-b88d968e-d64c-4387-a25d-223230b90dfa tempest-VolumesActionsTest-194871335 tempest-VolumesActionsTest-194871335-project] [instance: 8496d8ca-0305-4d1e-ab85-3ab7bd3ed9c6] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:15:37.431780 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-b88d968e-d64c-4387-a25d-223230b90dfa tempest-VolumesActionsTest-194871335 tempest-VolumesActionsTest-194871335-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:15:37.432630 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-b88d968e-d64c-4387-a25d-223230b90dfa tempest-VolumesActionsTest-194871335 tempest-VolumesActionsTest-194871335-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:15:37.433447 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-b88d968e-d64c-4387-a25d-223230b90dfa tempest-VolumesActionsTest-194871335 tempest-VolumesActionsTest-194871335-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:15:37.435068 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-b88d968e-d64c-4387-a25d-223230b90dfa tempest-VolumesActionsTest-194871335 tempest-VolumesActionsTest-194871335-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:15:37.436204 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-b88d968e-d64c-4387-a25d-223230b90dfa tempest-VolumesActionsTest-194871335 tempest-VolumesActionsTest-194871335-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:15:37.436860 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-b88d968e-d64c-4387-a25d-223230b90dfa tempest-VolumesActionsTest-194871335 tempest-VolumesActionsTest-194871335-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:15:37.578337 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-b88d968e-d64c-4387-a25d-223230b90dfa tempest-VolumesActionsTest-194871335 tempest-VolumesActionsTest-194871335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18920ad97e6946df9689bd6d4abd50b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12163a99662b48759b3fd7da51445ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:15:37.593786 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-b88d968e-d64c-4387-a25d-223230b90dfa tempest-VolumesActionsTest-194871335 tempest-VolumesActionsTest-194871335-project] 10.222.0.23 "GET /compute/v2.1/servers/8496d8ca-0305-4d1e-ab85-3ab7bd3ed9c6" status: 200 len: 1497 microversion: 2.1 time: 0.174270 Oct 13 13:15:37.607780 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 372/728] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:15:37 2022] GET /compute/v2.1/servers/8496d8ca-0305-4d1e-ab85-3ab7bd3ed9c6 => generated 1497 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:15:37.617821 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-41d6f13b-c76a-4426-abe5-a0972d3a2fd3 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Calling method '>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:15:37.618427 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-41d6f13b-c76a-4426-abe5-a0972d3a2fd3 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] [instance: c3478cd4-e4ab-4a7d-9f4d-65323c450348] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:15:37.625875 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-41d6f13b-c76a-4426-abe5-a0972d3a2fd3 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:15:37.626410 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-41d6f13b-c76a-4426-abe5-a0972d3a2fd3 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:15:37.626778 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-41d6f13b-c76a-4426-abe5-a0972d3a2fd3 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:15:37.627882 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-41d6f13b-c76a-4426-abe5-a0972d3a2fd3 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:15:37.628492 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-41d6f13b-c76a-4426-abe5-a0972d3a2fd3 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:15:37.629060 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-41d6f13b-c76a-4426-abe5-a0972d3a2fd3 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:15:37.777928 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-41d6f13b-c76a-4426-abe5-a0972d3a2fd3 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:15:37.786623 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-41d6f13b-c76a-4426-abe5-a0972d3a2fd3 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:15:37.788323 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-41d6f13b-c76a-4426-abe5-a0972d3a2fd3 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:15:37.789514 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-41d6f13b-c76a-4426-abe5-a0972d3a2fd3 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] 10.222.0.23 "GET /compute/v2.1/servers/c3478cd4-e4ab-4a7d-9f4d-65323c450348" status: 200 len: 1730 microversion: 2.20 time: 0.175718 Oct 13 13:15:37.790383 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 357/729] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 13:15:37 2022] GET /compute/v2.1/servers/c3478cd4-e4ab-4a7d-9f4d-65323c450348 => generated 1730 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 13:15:38.095114 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-2813bb73-8fda-472d-b9af-ec56e01987b0 tempest-VolumesActionsTest-194871335 tempest-VolumesActionsTest-194871335-project] Calling method '>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:15:38.095731 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-2813bb73-8fda-472d-b9af-ec56e01987b0 tempest-VolumesActionsTest-194871335 tempest-VolumesActionsTest-194871335-project] [instance: 8496d8ca-0305-4d1e-ab85-3ab7bd3ed9c6] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:15:38.101863 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-2813bb73-8fda-472d-b9af-ec56e01987b0 tempest-VolumesActionsTest-194871335 tempest-VolumesActionsTest-194871335-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:15:38.102341 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-2813bb73-8fda-472d-b9af-ec56e01987b0 tempest-VolumesActionsTest-194871335 tempest-VolumesActionsTest-194871335-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:15:38.102985 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-2813bb73-8fda-472d-b9af-ec56e01987b0 tempest-VolumesActionsTest-194871335 tempest-VolumesActionsTest-194871335-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:15:38.103704 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-2813bb73-8fda-472d-b9af-ec56e01987b0 tempest-VolumesActionsTest-194871335 tempest-VolumesActionsTest-194871335-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:15:38.104307 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-2813bb73-8fda-472d-b9af-ec56e01987b0 tempest-VolumesActionsTest-194871335 tempest-VolumesActionsTest-194871335-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:15:38.104978 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-2813bb73-8fda-472d-b9af-ec56e01987b0 tempest-VolumesActionsTest-194871335 tempest-VolumesActionsTest-194871335-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:15:38.132004 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-2813bb73-8fda-472d-b9af-ec56e01987b0 tempest-VolumesActionsTest-194871335 tempest-VolumesActionsTest-194871335-project] [instance: 8496d8ca-0305-4d1e-ab85-3ab7bd3ed9c6] Going to try to terminate instance {{(pid=118814) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 13 13:15:38.203452 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG dbcounter [-] [118814] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=118814) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:15:38.220566 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-2813bb73-8fda-472d-b9af-ec56e01987b0 tempest-VolumesActionsTest-194871335 tempest-VolumesActionsTest-194871335-project] 10.222.0.23 "DELETE /compute/v2.1/servers/8496d8ca-0305-4d1e-ab85-3ab7bd3ed9c6" status: 204 len: 0 microversion: 2.1 time: 0.129456 Oct 13 13:15:38.221143 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 373/730] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Oct 13 13:15:38 2022] DELETE /compute/v2.1/servers/8496d8ca-0305-4d1e-ab85-3ab7bd3ed9c6 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 13 13:15:38.230665 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-c26e74ef-8512-449b-9867-e35a12cb6565 tempest-VolumesActionsTest-194871335 tempest-VolumesActionsTest-194871335-project] Calling method '>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:15:38.232161 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-c26e74ef-8512-449b-9867-e35a12cb6565 tempest-VolumesActionsTest-194871335 tempest-VolumesActionsTest-194871335-project] [instance: 8496d8ca-0305-4d1e-ab85-3ab7bd3ed9c6] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:15:38.238845 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-c26e74ef-8512-449b-9867-e35a12cb6565 tempest-VolumesActionsTest-194871335 tempest-VolumesActionsTest-194871335-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:15:38.239684 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-c26e74ef-8512-449b-9867-e35a12cb6565 tempest-VolumesActionsTest-194871335 tempest-VolumesActionsTest-194871335-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:15:38.240408 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-c26e74ef-8512-449b-9867-e35a12cb6565 tempest-VolumesActionsTest-194871335 tempest-VolumesActionsTest-194871335-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:15:38.241608 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-c26e74ef-8512-449b-9867-e35a12cb6565 tempest-VolumesActionsTest-194871335 tempest-VolumesActionsTest-194871335-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:15:38.242318 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-c26e74ef-8512-449b-9867-e35a12cb6565 tempest-VolumesActionsTest-194871335 tempest-VolumesActionsTest-194871335-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:15:38.242992 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-c26e74ef-8512-449b-9867-e35a12cb6565 tempest-VolumesActionsTest-194871335 tempest-VolumesActionsTest-194871335-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:15:38.395627 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-c26e74ef-8512-449b-9867-e35a12cb6565 tempest-VolumesActionsTest-194871335 tempest-VolumesActionsTest-194871335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18920ad97e6946df9689bd6d4abd50b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12163a99662b48759b3fd7da51445ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:15:38.403910 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-c26e74ef-8512-449b-9867-e35a12cb6565 tempest-VolumesActionsTest-194871335 tempest-VolumesActionsTest-194871335-project] 10.222.0.23 "GET /compute/v2.1/servers/8496d8ca-0305-4d1e-ab85-3ab7bd3ed9c6" status: 200 len: 1503 microversion: 2.1 time: 0.176455 Oct 13 13:15:38.406560 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 358/731] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:15:38 2022] GET /compute/v2.1/servers/8496d8ca-0305-4d1e-ab85-3ab7bd3ed9c6 => generated 1503 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 13:15:38.817255 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-30c3782d-e1db-4051-8e5d-6ce7060156f5 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Calling method '>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:15:38.818213 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-30c3782d-e1db-4051-8e5d-6ce7060156f5 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] [instance: c3478cd4-e4ab-4a7d-9f4d-65323c450348] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:15:38.826209 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-30c3782d-e1db-4051-8e5d-6ce7060156f5 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:15:38.826692 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-30c3782d-e1db-4051-8e5d-6ce7060156f5 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:15:38.827166 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-30c3782d-e1db-4051-8e5d-6ce7060156f5 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:15:38.827863 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-30c3782d-e1db-4051-8e5d-6ce7060156f5 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:15:38.828311 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-30c3782d-e1db-4051-8e5d-6ce7060156f5 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:15:38.828728 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-30c3782d-e1db-4051-8e5d-6ce7060156f5 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:15:39.004258 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-30c3782d-e1db-4051-8e5d-6ce7060156f5 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:15:39.012319 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-30c3782d-e1db-4051-8e5d-6ce7060156f5 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:15:39.013803 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-30c3782d-e1db-4051-8e5d-6ce7060156f5 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:15:39.014983 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-30c3782d-e1db-4051-8e5d-6ce7060156f5 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] 10.222.0.23 "GET /compute/v2.1/servers/c3478cd4-e4ab-4a7d-9f4d-65323c450348" status: 200 len: 1730 microversion: 2.20 time: 0.202384 Oct 13 13:15:39.015561 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 374/732] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 13:15:38 2022] GET /compute/v2.1/servers/c3478cd4-e4ab-4a7d-9f4d-65323c450348 => generated 1730 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 13:15:39.427619 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-60ea894e-5f14-433f-99a9-822cf2c3358a tempest-VolumesActionsTest-194871335 tempest-VolumesActionsTest-194871335-project] Calling method '>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:15:39.428261 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-60ea894e-5f14-433f-99a9-822cf2c3358a tempest-VolumesActionsTest-194871335 tempest-VolumesActionsTest-194871335-project] [instance: 8496d8ca-0305-4d1e-ab85-3ab7bd3ed9c6] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:15:39.435451 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-60ea894e-5f14-433f-99a9-822cf2c3358a tempest-VolumesActionsTest-194871335 tempest-VolumesActionsTest-194871335-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:15:39.435941 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-60ea894e-5f14-433f-99a9-822cf2c3358a tempest-VolumesActionsTest-194871335 tempest-VolumesActionsTest-194871335-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:15:39.436376 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-60ea894e-5f14-433f-99a9-822cf2c3358a tempest-VolumesActionsTest-194871335 tempest-VolumesActionsTest-194871335-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:15:39.437077 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-60ea894e-5f14-433f-99a9-822cf2c3358a tempest-VolumesActionsTest-194871335 tempest-VolumesActionsTest-194871335-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:15:39.437538 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-60ea894e-5f14-433f-99a9-822cf2c3358a tempest-VolumesActionsTest-194871335 tempest-VolumesActionsTest-194871335-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:15:39.437963 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-60ea894e-5f14-433f-99a9-822cf2c3358a tempest-VolumesActionsTest-194871335 tempest-VolumesActionsTest-194871335-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:15:39.572713 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-60ea894e-5f14-433f-99a9-822cf2c3358a tempest-VolumesActionsTest-194871335 tempest-VolumesActionsTest-194871335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18920ad97e6946df9689bd6d4abd50b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12163a99662b48759b3fd7da51445ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:15:39.581267 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-60ea894e-5f14-433f-99a9-822cf2c3358a tempest-VolumesActionsTest-194871335 tempest-VolumesActionsTest-194871335-project] 10.222.0.23 "GET /compute/v2.1/servers/8496d8ca-0305-4d1e-ab85-3ab7bd3ed9c6" status: 200 len: 1503 microversion: 2.1 time: 0.158046 Oct 13 13:15:39.582073 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 359/733] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:15:39 2022] GET /compute/v2.1/servers/8496d8ca-0305-4d1e-ab85-3ab7bd3ed9c6 => generated 1503 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:15:40.041808 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-67385456-f0ae-4cac-a794-dc31764f57ea tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Calling method '>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:15:40.042408 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-67385456-f0ae-4cac-a794-dc31764f57ea tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] [instance: c3478cd4-e4ab-4a7d-9f4d-65323c450348] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:15:40.050316 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-67385456-f0ae-4cac-a794-dc31764f57ea tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:15:40.051091 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-67385456-f0ae-4cac-a794-dc31764f57ea tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:15:40.051733 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-67385456-f0ae-4cac-a794-dc31764f57ea tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:15:40.052632 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-67385456-f0ae-4cac-a794-dc31764f57ea tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:15:40.053383 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-67385456-f0ae-4cac-a794-dc31764f57ea tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:15:40.053991 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-67385456-f0ae-4cac-a794-dc31764f57ea tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:15:40.194772 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-67385456-f0ae-4cac-a794-dc31764f57ea tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:15:40.203862 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-67385456-f0ae-4cac-a794-dc31764f57ea tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:15:40.205472 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-67385456-f0ae-4cac-a794-dc31764f57ea tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:15:40.206936 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-67385456-f0ae-4cac-a794-dc31764f57ea tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] 10.222.0.23 "GET /compute/v2.1/servers/c3478cd4-e4ab-4a7d-9f4d-65323c450348" status: 200 len: 1730 microversion: 2.20 time: 0.168987 Oct 13 13:15:40.207521 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 375/734] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 13:15:40 2022] GET /compute/v2.1/servers/c3478cd4-e4ab-4a7d-9f4d-65323c450348 => generated 1730 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 13:15:40.603551 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-22d72ab7-b191-44e5-b6d6-a782bb39ea1a tempest-VolumesActionsTest-194871335 tempest-VolumesActionsTest-194871335-project] Calling method '>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:15:40.604202 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-22d72ab7-b191-44e5-b6d6-a782bb39ea1a tempest-VolumesActionsTest-194871335 tempest-VolumesActionsTest-194871335-project] [instance: 8496d8ca-0305-4d1e-ab85-3ab7bd3ed9c6] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:15:40.610659 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-22d72ab7-b191-44e5-b6d6-a782bb39ea1a tempest-VolumesActionsTest-194871335 tempest-VolumesActionsTest-194871335-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:15:40.611178 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-22d72ab7-b191-44e5-b6d6-a782bb39ea1a tempest-VolumesActionsTest-194871335 tempest-VolumesActionsTest-194871335-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:15:40.611631 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-22d72ab7-b191-44e5-b6d6-a782bb39ea1a tempest-VolumesActionsTest-194871335 tempest-VolumesActionsTest-194871335-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:15:40.612329 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-22d72ab7-b191-44e5-b6d6-a782bb39ea1a tempest-VolumesActionsTest-194871335 tempest-VolumesActionsTest-194871335-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:15:40.612793 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-22d72ab7-b191-44e5-b6d6-a782bb39ea1a tempest-VolumesActionsTest-194871335 tempest-VolumesActionsTest-194871335-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:15:40.613220 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-22d72ab7-b191-44e5-b6d6-a782bb39ea1a tempest-VolumesActionsTest-194871335 tempest-VolumesActionsTest-194871335-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:15:40.750228 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-22d72ab7-b191-44e5-b6d6-a782bb39ea1a tempest-VolumesActionsTest-194871335 tempest-VolumesActionsTest-194871335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18920ad97e6946df9689bd6d4abd50b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12163a99662b48759b3fd7da51445ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:15:40.758433 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-22d72ab7-b191-44e5-b6d6-a782bb39ea1a tempest-VolumesActionsTest-194871335 tempest-VolumesActionsTest-194871335-project] 10.222.0.23 "GET /compute/v2.1/servers/8496d8ca-0305-4d1e-ab85-3ab7bd3ed9c6" status: 200 len: 1503 microversion: 2.1 time: 0.158690 Oct 13 13:15:40.759004 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 360/735] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:15:40 2022] GET /compute/v2.1/servers/8496d8ca-0305-4d1e-ab85-3ab7bd3ed9c6 => generated 1503 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:15:41.233161 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-89280207-17e2-4a62-9b3d-13d3ec00afbd tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Calling method '>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:15:41.233999 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-89280207-17e2-4a62-9b3d-13d3ec00afbd tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] [instance: c3478cd4-e4ab-4a7d-9f4d-65323c450348] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:15:41.240650 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-89280207-17e2-4a62-9b3d-13d3ec00afbd tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:15:41.241136 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-89280207-17e2-4a62-9b3d-13d3ec00afbd tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:15:41.241571 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-89280207-17e2-4a62-9b3d-13d3ec00afbd tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:15:41.242266 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-89280207-17e2-4a62-9b3d-13d3ec00afbd tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:15:41.242720 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-89280207-17e2-4a62-9b3d-13d3ec00afbd tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:15:41.243182 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-89280207-17e2-4a62-9b3d-13d3ec00afbd tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:15:41.379617 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-89280207-17e2-4a62-9b3d-13d3ec00afbd tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:15:41.387870 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-89280207-17e2-4a62-9b3d-13d3ec00afbd tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:15:41.389322 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-89280207-17e2-4a62-9b3d-13d3ec00afbd tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:15:41.390488 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-89280207-17e2-4a62-9b3d-13d3ec00afbd tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] 10.222.0.23 "GET /compute/v2.1/servers/c3478cd4-e4ab-4a7d-9f4d-65323c450348" status: 200 len: 1730 microversion: 2.20 time: 0.161640 Oct 13 13:15:41.391043 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 376/736] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 13:15:41 2022] GET /compute/v2.1/servers/c3478cd4-e4ab-4a7d-9f4d-65323c450348 => generated 1730 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 13:15:41.782353 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-4bda4884-98db-47f3-bc5d-573af8d6c74b tempest-VolumesActionsTest-194871335 tempest-VolumesActionsTest-194871335-project] Calling method '>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:15:41.783066 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-4bda4884-98db-47f3-bc5d-573af8d6c74b tempest-VolumesActionsTest-194871335 tempest-VolumesActionsTest-194871335-project] [instance: 8496d8ca-0305-4d1e-ab85-3ab7bd3ed9c6] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:15:41.792186 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-4bda4884-98db-47f3-bc5d-573af8d6c74b tempest-VolumesActionsTest-194871335 tempest-VolumesActionsTest-194871335-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:15:41.792814 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-4bda4884-98db-47f3-bc5d-573af8d6c74b tempest-VolumesActionsTest-194871335 tempest-VolumesActionsTest-194871335-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:15:41.793357 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-4bda4884-98db-47f3-bc5d-573af8d6c74b tempest-VolumesActionsTest-194871335 tempest-VolumesActionsTest-194871335-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:15:41.794725 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-4bda4884-98db-47f3-bc5d-573af8d6c74b tempest-VolumesActionsTest-194871335 tempest-VolumesActionsTest-194871335-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:15:41.795311 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-4bda4884-98db-47f3-bc5d-573af8d6c74b tempest-VolumesActionsTest-194871335 tempest-VolumesActionsTest-194871335-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:15:41.795844 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-4bda4884-98db-47f3-bc5d-573af8d6c74b tempest-VolumesActionsTest-194871335 tempest-VolumesActionsTest-194871335-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:15:41.931049 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-4bda4884-98db-47f3-bc5d-573af8d6c74b tempest-VolumesActionsTest-194871335 tempest-VolumesActionsTest-194871335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18920ad97e6946df9689bd6d4abd50b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12163a99662b48759b3fd7da51445ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:15:41.938810 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-4bda4884-98db-47f3-bc5d-573af8d6c74b tempest-VolumesActionsTest-194871335 tempest-VolumesActionsTest-194871335-project] 10.222.0.23 "GET /compute/v2.1/servers/8496d8ca-0305-4d1e-ab85-3ab7bd3ed9c6" status: 200 len: 1503 microversion: 2.1 time: 0.160947 Oct 13 13:15:41.939433 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 361/737] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:15:41 2022] GET /compute/v2.1/servers/8496d8ca-0305-4d1e-ab85-3ab7bd3ed9c6 => generated 1503 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:15:42.416237 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-71e20386-5106-4d69-8038-f4c8bab2b67d tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Calling method '>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:15:42.416796 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-71e20386-5106-4d69-8038-f4c8bab2b67d tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] [instance: c3478cd4-e4ab-4a7d-9f4d-65323c450348] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:15:42.423707 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-71e20386-5106-4d69-8038-f4c8bab2b67d tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:15:42.424468 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-71e20386-5106-4d69-8038-f4c8bab2b67d tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:15:42.424913 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-71e20386-5106-4d69-8038-f4c8bab2b67d tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:15:42.425619 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-71e20386-5106-4d69-8038-f4c8bab2b67d tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:15:42.426076 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-71e20386-5106-4d69-8038-f4c8bab2b67d tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:15:42.426503 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-71e20386-5106-4d69-8038-f4c8bab2b67d tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:15:42.571954 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-71e20386-5106-4d69-8038-f4c8bab2b67d tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:15:42.581242 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-71e20386-5106-4d69-8038-f4c8bab2b67d tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:15:42.583018 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-71e20386-5106-4d69-8038-f4c8bab2b67d tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:15:42.584323 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-71e20386-5106-4d69-8038-f4c8bab2b67d tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] 10.222.0.23 "GET /compute/v2.1/servers/c3478cd4-e4ab-4a7d-9f4d-65323c450348" status: 200 len: 1730 microversion: 2.20 time: 0.172065 Oct 13 13:15:42.585011 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 377/738] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 13:15:42 2022] GET /compute/v2.1/servers/c3478cd4-e4ab-4a7d-9f4d-65323c450348 => generated 1730 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 13:15:42.961725 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-a2e1ef30-9b60-437e-9c37-2cfa6c40a466 tempest-VolumesActionsTest-194871335 tempest-VolumesActionsTest-194871335-project] Calling method '>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:15:42.962359 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-a2e1ef30-9b60-437e-9c37-2cfa6c40a466 tempest-VolumesActionsTest-194871335 tempest-VolumesActionsTest-194871335-project] [instance: 8496d8ca-0305-4d1e-ab85-3ab7bd3ed9c6] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:15:42.969565 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-a2e1ef30-9b60-437e-9c37-2cfa6c40a466 tempest-VolumesActionsTest-194871335 tempest-VolumesActionsTest-194871335-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:15:42.970046 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-a2e1ef30-9b60-437e-9c37-2cfa6c40a466 tempest-VolumesActionsTest-194871335 tempest-VolumesActionsTest-194871335-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:15:42.970479 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-a2e1ef30-9b60-437e-9c37-2cfa6c40a466 tempest-VolumesActionsTest-194871335 tempest-VolumesActionsTest-194871335-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:15:42.971200 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-a2e1ef30-9b60-437e-9c37-2cfa6c40a466 tempest-VolumesActionsTest-194871335 tempest-VolumesActionsTest-194871335-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:15:42.971810 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-a2e1ef30-9b60-437e-9c37-2cfa6c40a466 tempest-VolumesActionsTest-194871335 tempest-VolumesActionsTest-194871335-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:15:42.972229 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-a2e1ef30-9b60-437e-9c37-2cfa6c40a466 tempest-VolumesActionsTest-194871335 tempest-VolumesActionsTest-194871335-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:15:42.975392 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG dbcounter [-] [118815] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:15:43.113875 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-a2e1ef30-9b60-437e-9c37-2cfa6c40a466 tempest-VolumesActionsTest-194871335 tempest-VolumesActionsTest-194871335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18920ad97e6946df9689bd6d4abd50b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12163a99662b48759b3fd7da51445ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:15:43.122227 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-a2e1ef30-9b60-437e-9c37-2cfa6c40a466 tempest-VolumesActionsTest-194871335 tempest-VolumesActionsTest-194871335-project] 10.222.0.23 "GET /compute/v2.1/servers/8496d8ca-0305-4d1e-ab85-3ab7bd3ed9c6" status: 200 len: 1503 microversion: 2.1 time: 0.164341 Oct 13 13:15:43.122795 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 362/739] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:15:42 2022] GET /compute/v2.1/servers/8496d8ca-0305-4d1e-ab85-3ab7bd3ed9c6 => generated 1503 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:15:43.610559 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-d97eafa0-0dad-4e2b-9253-cc0fa748c0f8 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Calling method '>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:15:43.611285 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-d97eafa0-0dad-4e2b-9253-cc0fa748c0f8 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] [instance: c3478cd4-e4ab-4a7d-9f4d-65323c450348] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:15:43.617939 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-d97eafa0-0dad-4e2b-9253-cc0fa748c0f8 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:15:43.618420 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-d97eafa0-0dad-4e2b-9253-cc0fa748c0f8 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:15:43.618882 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-d97eafa0-0dad-4e2b-9253-cc0fa748c0f8 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:15:43.619606 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-d97eafa0-0dad-4e2b-9253-cc0fa748c0f8 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:15:43.620058 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-d97eafa0-0dad-4e2b-9253-cc0fa748c0f8 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:15:43.620480 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-d97eafa0-0dad-4e2b-9253-cc0fa748c0f8 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:15:43.763409 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-d97eafa0-0dad-4e2b-9253-cc0fa748c0f8 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:15:43.772015 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-d97eafa0-0dad-4e2b-9253-cc0fa748c0f8 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:15:43.773471 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-d97eafa0-0dad-4e2b-9253-cc0fa748c0f8 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:15:43.774644 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-d97eafa0-0dad-4e2b-9253-cc0fa748c0f8 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] 10.222.0.23 "GET /compute/v2.1/servers/c3478cd4-e4ab-4a7d-9f4d-65323c450348" status: 200 len: 1730 microversion: 2.20 time: 0.168838 Oct 13 13:15:43.775386 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 378/740] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 13:15:43 2022] GET /compute/v2.1/servers/c3478cd4-e4ab-4a7d-9f4d-65323c450348 => generated 1730 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 13:15:44.145962 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-a5abf3e5-87c8-4bf6-9f09-0acd921af7b6 tempest-VolumesActionsTest-194871335 tempest-VolumesActionsTest-194871335-project] Calling method '>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:15:44.146578 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-a5abf3e5-87c8-4bf6-9f09-0acd921af7b6 tempest-VolumesActionsTest-194871335 tempest-VolumesActionsTest-194871335-project] [instance: 8496d8ca-0305-4d1e-ab85-3ab7bd3ed9c6] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:15:44.153948 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-a5abf3e5-87c8-4bf6-9f09-0acd921af7b6 tempest-VolumesActionsTest-194871335 tempest-VolumesActionsTest-194871335-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:15:44.154435 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-a5abf3e5-87c8-4bf6-9f09-0acd921af7b6 tempest-VolumesActionsTest-194871335 tempest-VolumesActionsTest-194871335-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:15:44.154931 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-a5abf3e5-87c8-4bf6-9f09-0acd921af7b6 tempest-VolumesActionsTest-194871335 tempest-VolumesActionsTest-194871335-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:15:44.155605 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-a5abf3e5-87c8-4bf6-9f09-0acd921af7b6 tempest-VolumesActionsTest-194871335 tempest-VolumesActionsTest-194871335-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:15:44.156063 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-a5abf3e5-87c8-4bf6-9f09-0acd921af7b6 tempest-VolumesActionsTest-194871335 tempest-VolumesActionsTest-194871335-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:15:44.156485 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-a5abf3e5-87c8-4bf6-9f09-0acd921af7b6 tempest-VolumesActionsTest-194871335 tempest-VolumesActionsTest-194871335-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:15:44.301731 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-a5abf3e5-87c8-4bf6-9f09-0acd921af7b6 tempest-VolumesActionsTest-194871335 tempest-VolumesActionsTest-194871335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18920ad97e6946df9689bd6d4abd50b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12163a99662b48759b3fd7da51445ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:15:44.309592 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-a5abf3e5-87c8-4bf6-9f09-0acd921af7b6 tempest-VolumesActionsTest-194871335 tempest-VolumesActionsTest-194871335-project] 10.222.0.23 "GET /compute/v2.1/servers/8496d8ca-0305-4d1e-ab85-3ab7bd3ed9c6" status: 200 len: 1503 microversion: 2.1 time: 0.167401 Oct 13 13:15:44.310660 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 363/741] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:15:44 2022] GET /compute/v2.1/servers/8496d8ca-0305-4d1e-ab85-3ab7bd3ed9c6 => generated 1503 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:15:44.800194 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-c30ea130-6dcf-4b16-ad1e-2f1345df340e tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Calling method '>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:15:44.800803 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-c30ea130-6dcf-4b16-ad1e-2f1345df340e tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] [instance: c3478cd4-e4ab-4a7d-9f4d-65323c450348] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:15:44.807485 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-c30ea130-6dcf-4b16-ad1e-2f1345df340e tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:15:44.808109 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-c30ea130-6dcf-4b16-ad1e-2f1345df340e tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:15:44.808549 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-c30ea130-6dcf-4b16-ad1e-2f1345df340e tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:15:44.809807 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-c30ea130-6dcf-4b16-ad1e-2f1345df340e tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:15:44.810446 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-c30ea130-6dcf-4b16-ad1e-2f1345df340e tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:15:44.810873 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-c30ea130-6dcf-4b16-ad1e-2f1345df340e tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:15:44.945036 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-c30ea130-6dcf-4b16-ad1e-2f1345df340e tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:15:44.954840 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-c30ea130-6dcf-4b16-ad1e-2f1345df340e tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:15:44.956327 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-c30ea130-6dcf-4b16-ad1e-2f1345df340e tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:15:44.957495 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-c30ea130-6dcf-4b16-ad1e-2f1345df340e tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] 10.222.0.23 "GET /compute/v2.1/servers/c3478cd4-e4ab-4a7d-9f4d-65323c450348" status: 200 len: 1730 microversion: 2.20 time: 0.161498 Oct 13 13:15:44.958052 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 379/742] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 13:15:44 2022] GET /compute/v2.1/servers/c3478cd4-e4ab-4a7d-9f4d-65323c450348 => generated 1730 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 13:15:45.333997 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-24fe0916-9b45-4e5c-92bf-c8e92ec0b950 tempest-VolumesActionsTest-194871335 tempest-VolumesActionsTest-194871335-project] Calling method '>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:15:45.334612 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-24fe0916-9b45-4e5c-92bf-c8e92ec0b950 tempest-VolumesActionsTest-194871335 tempest-VolumesActionsTest-194871335-project] [instance: 8496d8ca-0305-4d1e-ab85-3ab7bd3ed9c6] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:15:45.341270 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-24fe0916-9b45-4e5c-92bf-c8e92ec0b950 tempest-VolumesActionsTest-194871335 tempest-VolumesActionsTest-194871335-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:15:45.341749 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-24fe0916-9b45-4e5c-92bf-c8e92ec0b950 tempest-VolumesActionsTest-194871335 tempest-VolumesActionsTest-194871335-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:15:45.342177 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-24fe0916-9b45-4e5c-92bf-c8e92ec0b950 tempest-VolumesActionsTest-194871335 tempest-VolumesActionsTest-194871335-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:15:45.342886 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-24fe0916-9b45-4e5c-92bf-c8e92ec0b950 tempest-VolumesActionsTest-194871335 tempest-VolumesActionsTest-194871335-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:15:45.343386 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-24fe0916-9b45-4e5c-92bf-c8e92ec0b950 tempest-VolumesActionsTest-194871335 tempest-VolumesActionsTest-194871335-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:15:45.343851 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-24fe0916-9b45-4e5c-92bf-c8e92ec0b950 tempest-VolumesActionsTest-194871335 tempest-VolumesActionsTest-194871335-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:15:45.480082 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-24fe0916-9b45-4e5c-92bf-c8e92ec0b950 tempest-VolumesActionsTest-194871335 tempest-VolumesActionsTest-194871335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18920ad97e6946df9689bd6d4abd50b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12163a99662b48759b3fd7da51445ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:15:45.488421 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-24fe0916-9b45-4e5c-92bf-c8e92ec0b950 tempest-VolumesActionsTest-194871335 tempest-VolumesActionsTest-194871335-project] 10.222.0.23 "GET /compute/v2.1/servers/8496d8ca-0305-4d1e-ab85-3ab7bd3ed9c6" status: 200 len: 1503 microversion: 2.1 time: 0.158576 Oct 13 13:15:45.488983 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 364/743] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:15:45 2022] GET /compute/v2.1/servers/8496d8ca-0305-4d1e-ab85-3ab7bd3ed9c6 => generated 1503 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:15:45.981838 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-a67edb3b-2268-440a-838a-bdfb883ac6ca tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Calling method '>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:15:45.982377 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-a67edb3b-2268-440a-838a-bdfb883ac6ca tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] [instance: c3478cd4-e4ab-4a7d-9f4d-65323c450348] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:15:45.988855 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-a67edb3b-2268-440a-838a-bdfb883ac6ca tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:15:45.989340 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-a67edb3b-2268-440a-838a-bdfb883ac6ca tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:15:45.989776 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-a67edb3b-2268-440a-838a-bdfb883ac6ca tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:15:45.990467 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-a67edb3b-2268-440a-838a-bdfb883ac6ca tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:15:45.990929 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-a67edb3b-2268-440a-838a-bdfb883ac6ca tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:15:45.991386 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-a67edb3b-2268-440a-838a-bdfb883ac6ca tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:15:46.118605 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-a67edb3b-2268-440a-838a-bdfb883ac6ca tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:15:46.126603 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-a67edb3b-2268-440a-838a-bdfb883ac6ca tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:15:46.128073 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-a67edb3b-2268-440a-838a-bdfb883ac6ca tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:15:46.129221 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-a67edb3b-2268-440a-838a-bdfb883ac6ca tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] 10.222.0.23 "GET /compute/v2.1/servers/c3478cd4-e4ab-4a7d-9f4d-65323c450348" status: 200 len: 1730 microversion: 2.20 time: 0.151427 Oct 13 13:15:46.129794 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 380/744] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 13:15:45 2022] GET /compute/v2.1/servers/c3478cd4-e4ab-4a7d-9f4d-65323c450348 => generated 1730 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 13:15:46.510932 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-e2727474-c50b-4e42-a19e-c57f0cb5b9c2 tempest-VolumesActionsTest-194871335 tempest-VolumesActionsTest-194871335-project] Calling method '>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:15:46.511574 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-e2727474-c50b-4e42-a19e-c57f0cb5b9c2 tempest-VolumesActionsTest-194871335 tempest-VolumesActionsTest-194871335-project] [instance: 8496d8ca-0305-4d1e-ab85-3ab7bd3ed9c6] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:15:46.518660 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-e2727474-c50b-4e42-a19e-c57f0cb5b9c2 tempest-VolumesActionsTest-194871335 tempest-VolumesActionsTest-194871335-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:15:46.519183 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-e2727474-c50b-4e42-a19e-c57f0cb5b9c2 tempest-VolumesActionsTest-194871335 tempest-VolumesActionsTest-194871335-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:15:46.519624 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-e2727474-c50b-4e42-a19e-c57f0cb5b9c2 tempest-VolumesActionsTest-194871335 tempest-VolumesActionsTest-194871335-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:15:46.520305 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-e2727474-c50b-4e42-a19e-c57f0cb5b9c2 tempest-VolumesActionsTest-194871335 tempest-VolumesActionsTest-194871335-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:15:46.520758 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-e2727474-c50b-4e42-a19e-c57f0cb5b9c2 tempest-VolumesActionsTest-194871335 tempest-VolumesActionsTest-194871335-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:15:46.521181 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-e2727474-c50b-4e42-a19e-c57f0cb5b9c2 tempest-VolumesActionsTest-194871335 tempest-VolumesActionsTest-194871335-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:15:46.645306 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-e2727474-c50b-4e42-a19e-c57f0cb5b9c2 tempest-VolumesActionsTest-194871335 tempest-VolumesActionsTest-194871335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18920ad97e6946df9689bd6d4abd50b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12163a99662b48759b3fd7da51445ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:15:46.652876 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-e2727474-c50b-4e42-a19e-c57f0cb5b9c2 tempest-VolumesActionsTest-194871335 tempest-VolumesActionsTest-194871335-project] 10.222.0.23 "GET /compute/v2.1/servers/8496d8ca-0305-4d1e-ab85-3ab7bd3ed9c6" status: 200 len: 1503 microversion: 2.1 time: 0.145784 Oct 13 13:15:46.653782 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 365/745] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:15:46 2022] GET /compute/v2.1/servers/8496d8ca-0305-4d1e-ab85-3ab7bd3ed9c6 => generated 1503 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:15:47.155028 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-e5152a83-9cb3-4c71-af0e-34928d9515ba tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Calling method '>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:15:47.155612 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-e5152a83-9cb3-4c71-af0e-34928d9515ba tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] [instance: c3478cd4-e4ab-4a7d-9f4d-65323c450348] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:15:47.161948 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-e5152a83-9cb3-4c71-af0e-34928d9515ba tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:15:47.162422 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-e5152a83-9cb3-4c71-af0e-34928d9515ba tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:15:47.162888 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-e5152a83-9cb3-4c71-af0e-34928d9515ba tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:15:47.163602 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-e5152a83-9cb3-4c71-af0e-34928d9515ba tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:15:47.164048 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-e5152a83-9cb3-4c71-af0e-34928d9515ba tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:15:47.164462 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-e5152a83-9cb3-4c71-af0e-34928d9515ba tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:15:47.293690 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-e5152a83-9cb3-4c71-af0e-34928d9515ba tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:15:47.302435 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-e5152a83-9cb3-4c71-af0e-34928d9515ba tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:15:47.303886 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-e5152a83-9cb3-4c71-af0e-34928d9515ba tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:15:47.305028 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-e5152a83-9cb3-4c71-af0e-34928d9515ba tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] 10.222.0.23 "GET /compute/v2.1/servers/c3478cd4-e4ab-4a7d-9f4d-65323c450348" status: 200 len: 1730 microversion: 2.20 time: 0.154455 Oct 13 13:15:47.305582 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 381/746] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 13:15:47 2022] GET /compute/v2.1/servers/c3478cd4-e4ab-4a7d-9f4d-65323c450348 => generated 1730 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 13:15:47.676207 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-962d98fe-77fc-450f-9df9-dc3eb8991a90 tempest-VolumesActionsTest-194871335 tempest-VolumesActionsTest-194871335-project] Calling method '>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:15:47.676749 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-962d98fe-77fc-450f-9df9-dc3eb8991a90 tempest-VolumesActionsTest-194871335 tempest-VolumesActionsTest-194871335-project] [instance: 8496d8ca-0305-4d1e-ab85-3ab7bd3ed9c6] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:15:47.683025 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-962d98fe-77fc-450f-9df9-dc3eb8991a90 tempest-VolumesActionsTest-194871335 tempest-VolumesActionsTest-194871335-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:15:47.683535 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-962d98fe-77fc-450f-9df9-dc3eb8991a90 tempest-VolumesActionsTest-194871335 tempest-VolumesActionsTest-194871335-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:15:47.683971 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-962d98fe-77fc-450f-9df9-dc3eb8991a90 tempest-VolumesActionsTest-194871335 tempest-VolumesActionsTest-194871335-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:15:47.685156 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-962d98fe-77fc-450f-9df9-dc3eb8991a90 tempest-VolumesActionsTest-194871335 tempest-VolumesActionsTest-194871335-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:15:47.685610 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-962d98fe-77fc-450f-9df9-dc3eb8991a90 tempest-VolumesActionsTest-194871335 tempest-VolumesActionsTest-194871335-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:15:47.686033 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-962d98fe-77fc-450f-9df9-dc3eb8991a90 tempest-VolumesActionsTest-194871335 tempest-VolumesActionsTest-194871335-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:15:47.810244 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-962d98fe-77fc-450f-9df9-dc3eb8991a90 tempest-VolumesActionsTest-194871335 tempest-VolumesActionsTest-194871335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18920ad97e6946df9689bd6d4abd50b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12163a99662b48759b3fd7da51445ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:15:47.818014 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-962d98fe-77fc-450f-9df9-dc3eb8991a90 tempest-VolumesActionsTest-194871335 tempest-VolumesActionsTest-194871335-project] 10.222.0.23 "GET /compute/v2.1/servers/8496d8ca-0305-4d1e-ab85-3ab7bd3ed9c6" status: 200 len: 1503 microversion: 2.1 time: 0.146016 Oct 13 13:15:47.818579 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 366/747] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:15:47 2022] GET /compute/v2.1/servers/8496d8ca-0305-4d1e-ab85-3ab7bd3ed9c6 => generated 1503 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:15:48.329307 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-d6bf982e-0a24-44ac-ae3d-9be09cfbf5e3 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Calling method '>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:15:48.329910 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-d6bf982e-0a24-44ac-ae3d-9be09cfbf5e3 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] [instance: c3478cd4-e4ab-4a7d-9f4d-65323c450348] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:15:48.336412 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-d6bf982e-0a24-44ac-ae3d-9be09cfbf5e3 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:15:48.336885 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-d6bf982e-0a24-44ac-ae3d-9be09cfbf5e3 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:15:48.337315 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-d6bf982e-0a24-44ac-ae3d-9be09cfbf5e3 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:15:48.337986 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-d6bf982e-0a24-44ac-ae3d-9be09cfbf5e3 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:15:48.338429 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-d6bf982e-0a24-44ac-ae3d-9be09cfbf5e3 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:15:48.338845 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-d6bf982e-0a24-44ac-ae3d-9be09cfbf5e3 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:15:48.478008 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-d6bf982e-0a24-44ac-ae3d-9be09cfbf5e3 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:15:48.489334 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-d6bf982e-0a24-44ac-ae3d-9be09cfbf5e3 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:15:48.490811 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-d6bf982e-0a24-44ac-ae3d-9be09cfbf5e3 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:15:48.492107 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-d6bf982e-0a24-44ac-ae3d-9be09cfbf5e3 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] 10.222.0.23 "GET /compute/v2.1/servers/c3478cd4-e4ab-4a7d-9f4d-65323c450348" status: 200 len: 1730 microversion: 2.20 time: 0.166684 Oct 13 13:15:48.496989 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 382/748] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 13:15:48 2022] GET /compute/v2.1/servers/c3478cd4-e4ab-4a7d-9f4d-65323c450348 => generated 1730 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 13:15:48.842206 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-122ec143-c2a1-4437-9cb5-f1457c11825b tempest-VolumesActionsTest-194871335 tempest-VolumesActionsTest-194871335-project] Calling method '>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:15:48.842994 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-122ec143-c2a1-4437-9cb5-f1457c11825b tempest-VolumesActionsTest-194871335 tempest-VolumesActionsTest-194871335-project] [instance: 8496d8ca-0305-4d1e-ab85-3ab7bd3ed9c6] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:15:48.849216 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG dbcounter [-] [118815] Writing DB stats nova_api:SELECT=72 {{(pid=118815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:15:48.851341 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-122ec143-c2a1-4437-9cb5-f1457c11825b tempest-VolumesActionsTest-194871335 tempest-VolumesActionsTest-194871335-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:15:48.852098 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-122ec143-c2a1-4437-9cb5-f1457c11825b tempest-VolumesActionsTest-194871335 tempest-VolumesActionsTest-194871335-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:15:48.852845 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-122ec143-c2a1-4437-9cb5-f1457c11825b tempest-VolumesActionsTest-194871335 tempest-VolumesActionsTest-194871335-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:15:48.853792 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-122ec143-c2a1-4437-9cb5-f1457c11825b tempest-VolumesActionsTest-194871335 tempest-VolumesActionsTest-194871335-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:15:48.854414 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-122ec143-c2a1-4437-9cb5-f1457c11825b tempest-VolumesActionsTest-194871335 tempest-VolumesActionsTest-194871335-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:15:48.855318 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-122ec143-c2a1-4437-9cb5-f1457c11825b tempest-VolumesActionsTest-194871335 tempest-VolumesActionsTest-194871335-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:15:48.910695 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [req-7c46c35b-41f3-4639-af2b-bf41fd29e127 req-6f806114-e7f7-45ed-96f2-ac539c910738 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8496d8ca-0305-4d1e-ab85-3ab7bd3ed9c6", "name": "network-vif-deleted", "tag": "62044e46-f508-4225-9482-992ecc2140b1"}]} {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 13:15:48.920828 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [req-7c46c35b-41f3-4639-af2b-bf41fd29e127 req-6f806114-e7f7-45ed-96f2-ac539c910738 service nova] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:15:48.921331 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [req-7c46c35b-41f3-4639-af2b-bf41fd29e127 req-6f806114-e7f7-45ed-96f2-ac539c910738 service nova] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:15:48.921835 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [req-7c46c35b-41f3-4639-af2b-bf41fd29e127 req-6f806114-e7f7-45ed-96f2-ac539c910738 service nova] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:15:48.926171 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG dbcounter [-] [118814] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=118814) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:15:48.934876 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-122ec143-c2a1-4437-9cb5-f1457c11825b tempest-VolumesActionsTest-194871335 tempest-VolumesActionsTest-194871335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18920ad97e6946df9689bd6d4abd50b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12163a99662b48759b3fd7da51445ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:15:48.935131 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.compute.server_external_events [req-7c46c35b-41f3-4639-af2b-bf41fd29e127 req-6f806114-e7f7-45ed-96f2-ac539c910738 service nova] Creating event network-vif-deleted:62044e46-f508-4225-9482-992ecc2140b1 for instance 8496d8ca-0305-4d1e-ab85-3ab7bd3ed9c6 on hv-cinder-82660 Oct 13 13:15:48.940639 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [req-7c46c35b-41f3-4639-af2b-bf41fd29e127 req-6f806114-e7f7-45ed-96f2-ac539c910738 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033641 Oct 13 13:15:48.941338 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 383/749] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 13:15:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 13 13:15:48.949225 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-122ec143-c2a1-4437-9cb5-f1457c11825b tempest-VolumesActionsTest-194871335 tempest-VolumesActionsTest-194871335-project] 10.222.0.23 "GET /compute/v2.1/servers/8496d8ca-0305-4d1e-ab85-3ab7bd3ed9c6" status: 200 len: 1461 microversion: 2.1 time: 0.111435 Oct 13 13:15:48.950332 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 367/750] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:15:48 2022] GET /compute/v2.1/servers/8496d8ca-0305-4d1e-ab85-3ab7bd3ed9c6 => generated 1461 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:15:49.519282 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-989ec5d4-2be0-4e92-8250-9c731bb3a595 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Calling method '>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:15:49.520018 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-989ec5d4-2be0-4e92-8250-9c731bb3a595 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] [instance: c3478cd4-e4ab-4a7d-9f4d-65323c450348] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:15:49.531251 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-989ec5d4-2be0-4e92-8250-9c731bb3a595 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:15:49.531848 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-989ec5d4-2be0-4e92-8250-9c731bb3a595 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:15:49.532291 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-989ec5d4-2be0-4e92-8250-9c731bb3a595 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:15:49.533059 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-989ec5d4-2be0-4e92-8250-9c731bb3a595 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:15:49.533824 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-989ec5d4-2be0-4e92-8250-9c731bb3a595 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:15:49.534247 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-989ec5d4-2be0-4e92-8250-9c731bb3a595 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:15:49.662004 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-a196d822-20ff-4058-abb4-d4f41a79dbf6 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Calling method '>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:15:49.664281 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-a196d822-20ff-4058-abb4-d4f41a79dbf6 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] [instance: 2aa89397-329a-494c-8b4b-fa7e513d3171] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:15:49.671678 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-a196d822-20ff-4058-abb4-d4f41a79dbf6 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:15:49.672417 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-a196d822-20ff-4058-abb4-d4f41a79dbf6 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:15:49.672874 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-a196d822-20ff-4058-abb4-d4f41a79dbf6 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:15:49.673568 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-a196d822-20ff-4058-abb4-d4f41a79dbf6 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:15:49.674283 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-a196d822-20ff-4058-abb4-d4f41a79dbf6 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:15:49.674958 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-a196d822-20ff-4058-abb4-d4f41a79dbf6 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:15:49.679403 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-989ec5d4-2be0-4e92-8250-9c731bb3a595 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:15:49.688298 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-989ec5d4-2be0-4e92-8250-9c731bb3a595 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:15:49.689728 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-989ec5d4-2be0-4e92-8250-9c731bb3a595 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:15:49.691078 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-989ec5d4-2be0-4e92-8250-9c731bb3a595 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] 10.222.0.23 "GET /compute/v2.1/servers/c3478cd4-e4ab-4a7d-9f4d-65323c450348" status: 200 len: 1730 microversion: 2.20 time: 0.176299 Oct 13 13:15:49.691630 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 384/751] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 13:15:49 2022] GET /compute/v2.1/servers/c3478cd4-e4ab-4a7d-9f4d-65323c450348 => generated 1730 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 13:15:49.709433 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-a196d822-20ff-4058-abb4-d4f41a79dbf6 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] 10.222.0.23 "GET /compute/v2.1/servers/2aa89397-329a-494c-8b4b-fa7e513d3171/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.051688 Oct 13 13:15:49.709998 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 368/752] 10.222.0.23 () {58 vars in 1302 bytes} [Thu Oct 13 13:15:49 2022] GET /compute/v2.1/servers/2aa89397-329a-494c-8b4b-fa7e513d3171/os-volume_attachments => generated 371 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 13 13:15:49.853414 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-3605a578-ee4e-4a09-adfe-51808dd95870 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Calling method '>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:15:49.853899 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-3605a578-ee4e-4a09-adfe-51808dd95870 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] [instance: 2aa89397-329a-494c-8b4b-fa7e513d3171] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:15:49.860430 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-3605a578-ee4e-4a09-adfe-51808dd95870 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:15:49.860905 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-3605a578-ee4e-4a09-adfe-51808dd95870 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:15:49.861342 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-3605a578-ee4e-4a09-adfe-51808dd95870 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:15:49.862018 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-3605a578-ee4e-4a09-adfe-51808dd95870 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:15:49.862461 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-3605a578-ee4e-4a09-adfe-51808dd95870 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:15:49.862875 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-3605a578-ee4e-4a09-adfe-51808dd95870 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:15:49.891431 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-3605a578-ee4e-4a09-adfe-51808dd95870 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] 10.222.0.23 "GET /compute/v2.1/servers/2aa89397-329a-494c-8b4b-fa7e513d3171/os-volume_attachments/d3c3c539-229e-4b11-9dcd-305163fc9b31" status: 200 len: 194 microversion: 2.1 time: 0.041938 Oct 13 13:15:49.891979 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 385/753] 10.222.0.23 () {58 vars in 1413 bytes} [Thu Oct 13 13:15:49 2022] GET /compute/v2.1/servers/2aa89397-329a-494c-8b4b-fa7e513d3171/os-volume_attachments/d3c3c539-229e-4b11-9dcd-305163fc9b31 => generated 194 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 13:15:49.902234 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-f6e57a8a-0a29-405b-816d-cd3d8e0d867f tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Calling method '>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:15:49.902739 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-f6e57a8a-0a29-405b-816d-cd3d8e0d867f tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] [instance: 2aa89397-329a-494c-8b4b-fa7e513d3171] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:15:49.910489 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-f6e57a8a-0a29-405b-816d-cd3d8e0d867f tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:15:49.910489 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-f6e57a8a-0a29-405b-816d-cd3d8e0d867f tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:15:49.910932 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-f6e57a8a-0a29-405b-816d-cd3d8e0d867f tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:15:49.911899 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-f6e57a8a-0a29-405b-816d-cd3d8e0d867f tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:15:49.912360 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-f6e57a8a-0a29-405b-816d-cd3d8e0d867f tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:15:49.912810 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-f6e57a8a-0a29-405b-816d-cd3d8e0d867f tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:15:49.973119 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-27cb2c79-5595-4754-9c0e-be9ec16873af tempest-VolumesActionsTest-194871335 tempest-VolumesActionsTest-194871335-project] Calling method '>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:15:49.973738 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-27cb2c79-5595-4754-9c0e-be9ec16873af tempest-VolumesActionsTest-194871335 tempest-VolumesActionsTest-194871335-project] [instance: 8496d8ca-0305-4d1e-ab85-3ab7bd3ed9c6] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:15:49.980266 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-27cb2c79-5595-4754-9c0e-be9ec16873af tempest-VolumesActionsTest-194871335 tempest-VolumesActionsTest-194871335-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:15:49.980794 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-27cb2c79-5595-4754-9c0e-be9ec16873af tempest-VolumesActionsTest-194871335 tempest-VolumesActionsTest-194871335-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:15:49.981760 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-27cb2c79-5595-4754-9c0e-be9ec16873af tempest-VolumesActionsTest-194871335 tempest-VolumesActionsTest-194871335-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:15:49.982456 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-27cb2c79-5595-4754-9c0e-be9ec16873af tempest-VolumesActionsTest-194871335 tempest-VolumesActionsTest-194871335-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:15:49.982970 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-27cb2c79-5595-4754-9c0e-be9ec16873af tempest-VolumesActionsTest-194871335 tempest-VolumesActionsTest-194871335-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:15:49.983354 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-27cb2c79-5595-4754-9c0e-be9ec16873af tempest-VolumesActionsTest-194871335 tempest-VolumesActionsTest-194871335-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:15:50.001011 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.wsgi [None req-27cb2c79-5595-4754-9c0e-be9ec16873af tempest-VolumesActionsTest-194871335 tempest-VolumesActionsTest-194871335-project] HTTP exception thrown: Instance 8496d8ca-0305-4d1e-ab85-3ab7bd3ed9c6 could not be found. Oct 13 13:15:50.002791 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-27cb2c79-5595-4754-9c0e-be9ec16873af tempest-VolumesActionsTest-194871335 tempest-VolumesActionsTest-194871335-project] Request method failure captured: Oct 13 13:15:50.002791 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: request: GET /compute/v2.1/servers/8496d8ca-0305-4d1e-ab85-3ab7bd3ed9c6 HTTP/1.1 Oct 13 13:15:50.002791 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: Accept: application/json Oct 13 13:15:50.002791 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: Accept-Encoding: identity Oct 13 13:15:50.002791 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: Connection: close Oct 13 13:15:50.002791 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: Content-Length: 0 Oct 13 13:15:50.002791 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: Content-Type: application/json Oct 13 13:15:50.002791 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: Host: 10.222.0.23 Oct 13 13:15:50.002791 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: Openstack-System-Scope: None Oct 13 13:15:50.002791 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: User-Agent: python-urllib3/1.26.12 Oct 13 13:15:50.002791 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Auth-Token: gAAAAABjSA9ri5UBq_IkfP1Qh0u9Fma-nODktWlm_biGnXsTvN92DU_dwtHt07xoHR6wh1L6MvUStpAD4C4TXU3xs54wQnNrrvuOhj1CorB0a8bsAVriZCiJoKEnvxgzek4RuVJcx9Ot5ychRyNQTJoL2ixHYVO3hjzRGFlkmC9p5B_yeMJ9m0I Oct 13 13:15:50.002791 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Domain-Id: None Oct 13 13:15:50.002791 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Domain-Name: None Oct 13 13:15:50.002791 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Identity-Status: Confirmed Oct 13 13:15:50.002791 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Is-Admin-Project: True Oct 13 13:15:50.002791 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Project-Domain-Id: default Oct 13 13:15:50.002791 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Project-Domain-Name: Default Oct 13 13:15:50.002791 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Project-Id: 12163a99662b48759b3fd7da51445ecf Oct 13 13:15:50.002791 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Project-Name: tempest-VolumesActionsTest-194871335 Oct 13 13:15:50.002791 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Role: reader,member Oct 13 13:15:50.002791 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Roles: reader,member Oct 13 13:15:50.004491 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_12163a99662b48759b3fd7da51445ecf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/12163a99662b48759b3fd7da51445ecf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/12163a99662b48759b3fd7da51445ecf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/12163a99662b48759b3fd7da51445ecf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}] Oct 13 13:15:50.004491 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Tenant: tempest-VolumesActionsTest-194871335 Oct 13 13:15:50.004491 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Tenant-Id: 12163a99662b48759b3fd7da51445ecf Oct 13 13:15:50.004491 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Tenant-Name: tempest-VolumesActionsTest-194871335 Oct 13 13:15:50.004491 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-User: tempest-VolumesActionsTest-194871335-project Oct 13 13:15:50.004491 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-User-Domain-Id: default Oct 13 13:15:50.004491 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-User-Domain-Name: Default Oct 13 13:15:50.004491 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-User-Id: 18920ad97e6946df9689bd6d4abd50b0 Oct 13 13:15:50.004491 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-User-Name: tempest-VolumesActionsTest-194871335-project Oct 13 13:15:50.004491 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: method: > Oct 13 13:15:50.004491 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: exception: Instance 8496d8ca-0305-4d1e-ab85-3ab7bd3ed9c6 could not be found. Oct 13 13:15:50.004491 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: action_args: {'id': '8496d8ca-0305-4d1e-ab85-3ab7bd3ed9c6'} Oct 13 13:15:50.005418 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 13:15:50.005418 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 13:15:50.005418 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 13 13:15:50.005418 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 13 13:15:50.005418 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 13 13:15:50.005418 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 13 13:15:50.005418 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 13 13:15:50.005418 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 13 13:15:50.005418 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 13 13:15:50.005418 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 13 13:15:50.005418 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8496d8ca-0305-4d1e-ab85-3ab7bd3ed9c6 could not be found. Oct 13 13:15:50.005418 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi Oct 13 13:15:50.005418 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 13:15:50.005418 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi Oct 13 13:15:50.005418 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 13:15:50.005418 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 13:15:50.005418 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 13:15:50.005418 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 13:15:50.005418 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 13:15:50.005418 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 13:15:50.006881 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 13:15:50.006881 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 13 13:15:50.006881 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 13 13:15:50.006881 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 13 13:15:50.006881 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 13 13:15:50.006881 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 13 13:15:50.006881 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 13 13:15:50.006881 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8496d8ca-0305-4d1e-ab85-3ab7bd3ed9c6 could not be found. Oct 13 13:15:50.006881 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi Oct 13 13:15:50.006881 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 13:15:50.006881 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi Oct 13 13:15:50.006881 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 13:15:50.006881 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 13:15:50.006881 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 13:15:50.006881 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 13:15:50.006881 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 13:15:50.006881 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8496d8ca-0305-4d1e-ab85-3ab7bd3ed9c6 could not be found. Oct 13 13:15:50.006881 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi Oct 13 13:15:50.008220 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.objects.instance [None req-f6e57a8a-0a29-405b-816d-cd3d8e0d867f tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lazy-loading 'services' on Instance uuid 2aa89397-329a-494c-8b4b-fa7e513d3171 {{(pid=118815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 13 13:15:50.008318 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-27cb2c79-5595-4754-9c0e-be9ec16873af tempest-VolumesActionsTest-194871335 tempest-VolumesActionsTest-194871335-project] Returning 404 to user: Instance 8496d8ca-0305-4d1e-ab85-3ab7bd3ed9c6 could not be found. {{(pid=118814) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 13:15:50.008318 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-27cb2c79-5595-4754-9c0e-be9ec16873af tempest-VolumesActionsTest-194871335 tempest-VolumesActionsTest-194871335-project] 10.222.0.23 "GET /compute/v2.1/servers/8496d8ca-0305-4d1e-ab85-3ab7bd3ed9c6" status: 404 len: 111 microversion: 2.1 time: 0.037521 Oct 13 13:15:50.015524 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 386/754] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:15:49 2022] GET /compute/v2.1/servers/8496d8ca-0305-4d1e-ab85-3ab7bd3ed9c6 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 13 13:15:50.064781 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-c176c073-6925-492d-9b6e-41c1fe1ce4bb tempest-VolumesActionsTest-194871335 tempest-VolumesActionsTest-194871335-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-549537837", "imageRef": "e2cdd20b-2540-48bc-a05c-d6a2e7e9a66e", "flavorRef": "452", "networks": [{"uuid": "fa9f61a0-af15-4e66-81ab-796b27386471"}]}} {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 13:15:50.089724 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-f6e57a8a-0a29-405b-816d-cd3d8e0d867f tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] 10.222.0.23 "DELETE /compute/v2.1/servers/2aa89397-329a-494c-8b4b-fa7e513d3171/os-volume_attachments/d3c3c539-229e-4b11-9dcd-305163fc9b31" status: 202 len: 0 microversion: 2.1 time: 0.191162 Oct 13 13:15:50.090967 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 369/755] 10.222.0.23 () {58 vars in 1416 bytes} [Thu Oct 13 13:15:49 2022] DELETE /compute/v2.1/servers/2aa89397-329a-494c-8b4b-fa7e513d3171/os-volume_attachments/d3c3c539-229e-4b11-9dcd-305163fc9b31 => generated 0 bytes in 193 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 13 13:15:50.128122 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.network.neutron [None req-c176c073-6925-492d-9b6e-41c1fe1ce4bb tempest-VolumesActionsTest-194871335 tempest-VolumesActionsTest-194871335-project] validate_networks() for [('fa9f61a0-af15-4e66-81ab-796b27386471', None, None, None, None, None)] {{(pid=118814) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 13 13:15:50.469957 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.virt.hardware [None req-c176c073-6925-492d-9b6e-41c1fe1ce4bb tempest-VolumesActionsTest-194871335 tempest-VolumesActionsTest-194871335-project] Flavor limits 0:0:0 {{(pid=118814) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 13 13:15:50.470405 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.virt.hardware [None req-c176c073-6925-492d-9b6e-41c1fe1ce4bb tempest-VolumesActionsTest-194871335 tempest-VolumesActionsTest-194871335-project] Image limits 0:0:0 {{(pid=118814) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 13 13:15:50.470875 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.virt.hardware [None req-c176c073-6925-492d-9b6e-41c1fe1ce4bb tempest-VolumesActionsTest-194871335 tempest-VolumesActionsTest-194871335-project] Flavor pref 0:0:0 {{(pid=118814) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 13 13:15:50.471308 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.virt.hardware [None req-c176c073-6925-492d-9b6e-41c1fe1ce4bb tempest-VolumesActionsTest-194871335 tempest-VolumesActionsTest-194871335-project] Image pref 0:0:0 {{(pid=118814) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 13 13:15:50.471763 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.virt.hardware [None req-c176c073-6925-492d-9b6e-41c1fe1ce4bb tempest-VolumesActionsTest-194871335 tempest-VolumesActionsTest-194871335-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118814) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 13 13:15:50.480406 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-c176c073-6925-492d-9b6e-41c1fe1ce4bb tempest-VolumesActionsTest-194871335 tempest-VolumesActionsTest-194871335-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:15:50.480874 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-c176c073-6925-492d-9b6e-41c1fe1ce4bb tempest-VolumesActionsTest-194871335 tempest-VolumesActionsTest-194871335-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:15:50.481297 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-c176c073-6925-492d-9b6e-41c1fe1ce4bb tempest-VolumesActionsTest-194871335 tempest-VolumesActionsTest-194871335-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:15:50.482005 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-c176c073-6925-492d-9b6e-41c1fe1ce4bb tempest-VolumesActionsTest-194871335 tempest-VolumesActionsTest-194871335-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:15:50.482447 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-c176c073-6925-492d-9b6e-41c1fe1ce4bb tempest-VolumesActionsTest-194871335 tempest-VolumesActionsTest-194871335-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:15:50.482863 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-c176c073-6925-492d-9b6e-41c1fe1ce4bb tempest-VolumesActionsTest-194871335 tempest-VolumesActionsTest-194871335-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:15:50.499855 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.quota [None req-c176c073-6925-492d-9b6e-41c1fe1ce4bb tempest-VolumesActionsTest-194871335 tempest-VolumesActionsTest-194871335-project] Getting quotas for project 12163a99662b48759b3fd7da51445ecf. Resources: {'instances', 'cores', 'ram'} {{(pid=118814) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 13 13:15:50.503713 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.quota [None req-c176c073-6925-492d-9b6e-41c1fe1ce4bb tempest-VolumesActionsTest-194871335 tempest-VolumesActionsTest-194871335-project] Getting quotas for user 18920ad97e6946df9689bd6d4abd50b0 and project 12163a99662b48759b3fd7da51445ecf. Resources: {'instances', 'cores', 'ram'} {{(pid=118814) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 13 13:15:50.515037 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-c176c073-6925-492d-9b6e-41c1fe1ce4bb tempest-VolumesActionsTest-194871335 tempest-VolumesActionsTest-194871335-project] Going to run 1 instances... {{(pid=118814) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 13 13:15:50.517333 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-c176c073-6925-492d-9b6e-41c1fe1ce4bb tempest-VolumesActionsTest-194871335 tempest-VolumesActionsTest-194871335-project] [instance: 48ce53de-edd3-4295-84bf-6d91081962b4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e2cdd20b-2540-48bc-a05c-d6a2e7e9a66e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118814) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 13 13:15:50.563043 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-c176c073-6925-492d-9b6e-41c1fe1ce4bb tempest-VolumesActionsTest-194871335 tempest-VolumesActionsTest-194871335-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.502000 Oct 13 13:15:50.563998 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 387/756] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Oct 13 13:15:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 503 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 13 13:15:50.575774 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-e67962aa-6619-4ff7-9406-7ea1afc1ec88 tempest-VolumesActionsTest-194871335 tempest-VolumesActionsTest-194871335-project] Calling method '>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:15:50.576468 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-e67962aa-6619-4ff7-9406-7ea1afc1ec88 tempest-VolumesActionsTest-194871335 tempest-VolumesActionsTest-194871335-project] [instance: 48ce53de-edd3-4295-84bf-6d91081962b4] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:15:50.634527 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-e67962aa-6619-4ff7-9406-7ea1afc1ec88 tempest-VolumesActionsTest-194871335 tempest-VolumesActionsTest-194871335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18920ad97e6946df9689bd6d4abd50b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12163a99662b48759b3fd7da51445ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:15:50.642558 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-e67962aa-6619-4ff7-9406-7ea1afc1ec88 tempest-VolumesActionsTest-194871335 tempest-VolumesActionsTest-194871335-project] 10.222.0.23 "GET /compute/v2.1/servers/48ce53de-edd3-4295-84bf-6d91081962b4" status: 200 len: 1213 microversion: 2.1 time: 0.071477 Oct 13 13:15:50.643228 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 370/757] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:15:50 2022] GET /compute/v2.1/servers/48ce53de-edd3-4295-84bf-6d91081962b4 => generated 1213 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:15:50.716612 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-30d4f349-0c08-4bb9-84e7-02a6e8776fd7 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Calling method '>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:15:50.717156 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-30d4f349-0c08-4bb9-84e7-02a6e8776fd7 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] [instance: c3478cd4-e4ab-4a7d-9f4d-65323c450348] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:15:50.723426 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-30d4f349-0c08-4bb9-84e7-02a6e8776fd7 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:15:50.723903 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-30d4f349-0c08-4bb9-84e7-02a6e8776fd7 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:15:50.724338 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-30d4f349-0c08-4bb9-84e7-02a6e8776fd7 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:15:50.725009 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-30d4f349-0c08-4bb9-84e7-02a6e8776fd7 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:15:50.725481 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-30d4f349-0c08-4bb9-84e7-02a6e8776fd7 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:15:50.725900 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-30d4f349-0c08-4bb9-84e7-02a6e8776fd7 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:15:50.872657 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-30d4f349-0c08-4bb9-84e7-02a6e8776fd7 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:15:50.880824 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-30d4f349-0c08-4bb9-84e7-02a6e8776fd7 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:15:50.882278 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-30d4f349-0c08-4bb9-84e7-02a6e8776fd7 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:15:50.883461 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-30d4f349-0c08-4bb9-84e7-02a6e8776fd7 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] 10.222.0.23 "GET /compute/v2.1/servers/c3478cd4-e4ab-4a7d-9f4d-65323c450348" status: 200 len: 1730 microversion: 2.20 time: 0.171405 Oct 13 13:15:50.899076 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 388/758] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 13:15:50 2022] GET /compute/v2.1/servers/c3478cd4-e4ab-4a7d-9f4d-65323c450348 => generated 1730 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 13:15:51.222574 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-04161618-eaf8-4378-a853-7ab9e08c2557 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Calling method '>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:15:51.223091 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-04161618-eaf8-4378-a853-7ab9e08c2557 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] [instance: 2aa89397-329a-494c-8b4b-fa7e513d3171] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:15:51.230490 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-04161618-eaf8-4378-a853-7ab9e08c2557 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:15:51.230961 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-04161618-eaf8-4378-a853-7ab9e08c2557 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:15:51.231500 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-04161618-eaf8-4378-a853-7ab9e08c2557 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:15:51.232288 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-04161618-eaf8-4378-a853-7ab9e08c2557 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:15:51.232769 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-04161618-eaf8-4378-a853-7ab9e08c2557 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:15:51.233188 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-04161618-eaf8-4378-a853-7ab9e08c2557 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:15:51.261835 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-04161618-eaf8-4378-a853-7ab9e08c2557 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] 10.222.0.23 "GET /compute/v2.1/servers/2aa89397-329a-494c-8b4b-fa7e513d3171/os-volume_attachments/917f300f-8779-444d-86a1-dcf92eed66f2" status: 200 len: 194 microversion: 2.1 time: 0.043125 Oct 13 13:15:51.262937 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 371/759] 10.222.0.23 () {58 vars in 1413 bytes} [Thu Oct 13 13:15:51 2022] GET /compute/v2.1/servers/2aa89397-329a-494c-8b4b-fa7e513d3171/os-volume_attachments/917f300f-8779-444d-86a1-dcf92eed66f2 => generated 194 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 13:15:51.273395 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-c269e14f-ed59-4a1a-b789-f28cb4c8bef2 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Calling method '>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:15:51.273884 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-c269e14f-ed59-4a1a-b789-f28cb4c8bef2 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] [instance: 2aa89397-329a-494c-8b4b-fa7e513d3171] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:15:51.280324 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-c269e14f-ed59-4a1a-b789-f28cb4c8bef2 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:15:51.280802 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-c269e14f-ed59-4a1a-b789-f28cb4c8bef2 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:15:51.281238 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-c269e14f-ed59-4a1a-b789-f28cb4c8bef2 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:15:51.281922 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-c269e14f-ed59-4a1a-b789-f28cb4c8bef2 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:15:51.282374 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-c269e14f-ed59-4a1a-b789-f28cb4c8bef2 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:15:51.282795 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-c269e14f-ed59-4a1a-b789-f28cb4c8bef2 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:15:51.362691 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.objects.instance [None req-c269e14f-ed59-4a1a-b789-f28cb4c8bef2 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lazy-loading 'services' on Instance uuid 2aa89397-329a-494c-8b4b-fa7e513d3171 {{(pid=118814) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 13 13:15:51.431814 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-c269e14f-ed59-4a1a-b789-f28cb4c8bef2 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] 10.222.0.23 "DELETE /compute/v2.1/servers/2aa89397-329a-494c-8b4b-fa7e513d3171/os-volume_attachments/917f300f-8779-444d-86a1-dcf92eed66f2" status: 202 len: 0 microversion: 2.1 time: 0.162211 Oct 13 13:15:51.432393 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 389/760] 10.222.0.23 () {58 vars in 1416 bytes} [Thu Oct 13 13:15:51 2022] DELETE /compute/v2.1/servers/2aa89397-329a-494c-8b4b-fa7e513d3171/os-volume_attachments/917f300f-8779-444d-86a1-dcf92eed66f2 => generated 0 bytes in 164 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 13 13:15:51.649963 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [req-23d4e3f7-edf2-49ac-8f3a-f3641e6383a0 req-33b7b882-9e67-486c-a405-72b34381084b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c3478cd4-e4ab-4a7d-9f4d-65323c450348", "name": "network-vif-plugged", "status": "completed", "tag": "ff57ee79-9921-43ed-817d-5ba082c97343"}]} {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 13:15:51.667300 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-bad78e25-101a-46e5-bdb0-ff7ba5371327 tempest-VolumesActionsTest-194871335 tempest-VolumesActionsTest-194871335-project] Calling method '>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:15:51.668017 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-bad78e25-101a-46e5-bdb0-ff7ba5371327 tempest-VolumesActionsTest-194871335 tempest-VolumesActionsTest-194871335-project] [instance: 48ce53de-edd3-4295-84bf-6d91081962b4] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:15:51.668791 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [req-23d4e3f7-edf2-49ac-8f3a-f3641e6383a0 req-33b7b882-9e67-486c-a405-72b34381084b service nova] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:15:51.669808 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [req-23d4e3f7-edf2-49ac-8f3a-f3641e6383a0 req-33b7b882-9e67-486c-a405-72b34381084b service nova] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:15:51.670638 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [req-23d4e3f7-edf2-49ac-8f3a-f3641e6383a0 req-33b7b882-9e67-486c-a405-72b34381084b service nova] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:15:51.682110 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-bad78e25-101a-46e5-bdb0-ff7ba5371327 tempest-VolumesActionsTest-194871335 tempest-VolumesActionsTest-194871335-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:15:51.682607 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-bad78e25-101a-46e5-bdb0-ff7ba5371327 tempest-VolumesActionsTest-194871335 tempest-VolumesActionsTest-194871335-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:15:51.683047 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-bad78e25-101a-46e5-bdb0-ff7ba5371327 tempest-VolumesActionsTest-194871335 tempest-VolumesActionsTest-194871335-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:15:51.683478 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.compute.server_external_events [req-23d4e3f7-edf2-49ac-8f3a-f3641e6383a0 req-33b7b882-9e67-486c-a405-72b34381084b service nova] Creating event network-vif-plugged:ff57ee79-9921-43ed-817d-5ba082c97343 for instance c3478cd4-e4ab-4a7d-9f4d-65323c450348 on hv-cinder-82660 Oct 13 13:15:51.686288 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-bad78e25-101a-46e5-bdb0-ff7ba5371327 tempest-VolumesActionsTest-194871335 tempest-VolumesActionsTest-194871335-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:15:51.686765 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-bad78e25-101a-46e5-bdb0-ff7ba5371327 tempest-VolumesActionsTest-194871335 tempest-VolumesActionsTest-194871335-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:15:51.687213 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-bad78e25-101a-46e5-bdb0-ff7ba5371327 tempest-VolumesActionsTest-194871335 tempest-VolumesActionsTest-194871335-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:15:51.690226 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [req-23d4e3f7-edf2-49ac-8f3a-f3641e6383a0 req-33b7b882-9e67-486c-a405-72b34381084b service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046105 Oct 13 13:15:51.691275 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 372/761] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 13:15:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 13 13:15:51.753534 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-bad78e25-101a-46e5-bdb0-ff7ba5371327 tempest-VolumesActionsTest-194871335 tempest-VolumesActionsTest-194871335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18920ad97e6946df9689bd6d4abd50b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12163a99662b48759b3fd7da51445ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:15:51.761317 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-bad78e25-101a-46e5-bdb0-ff7ba5371327 tempest-VolumesActionsTest-194871335 tempest-VolumesActionsTest-194871335-project] 10.222.0.23 "GET /compute/v2.1/servers/48ce53de-edd3-4295-84bf-6d91081962b4" status: 200 len: 1283 microversion: 2.1 time: 0.100506 Oct 13 13:15:51.761880 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 390/762] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:15:51 2022] GET /compute/v2.1/servers/48ce53de-edd3-4295-84bf-6d91081962b4 => generated 1283 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:15:51.913722 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-155f19de-9dd7-4198-8c56-63a66a90acff tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Calling method '>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:15:51.914436 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-155f19de-9dd7-4198-8c56-63a66a90acff tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] [instance: c3478cd4-e4ab-4a7d-9f4d-65323c450348] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:15:51.921909 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-155f19de-9dd7-4198-8c56-63a66a90acff tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:15:51.922801 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-155f19de-9dd7-4198-8c56-63a66a90acff tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:15:51.923390 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-155f19de-9dd7-4198-8c56-63a66a90acff tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:15:51.924570 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-155f19de-9dd7-4198-8c56-63a66a90acff tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:15:51.925120 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-155f19de-9dd7-4198-8c56-63a66a90acff tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:15:51.925660 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-155f19de-9dd7-4198-8c56-63a66a90acff tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:15:52.078087 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-155f19de-9dd7-4198-8c56-63a66a90acff tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:15:52.086192 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-155f19de-9dd7-4198-8c56-63a66a90acff tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:15:52.088576 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-155f19de-9dd7-4198-8c56-63a66a90acff tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:15:52.089750 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-155f19de-9dd7-4198-8c56-63a66a90acff tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] 10.222.0.23 "GET /compute/v2.1/servers/c3478cd4-e4ab-4a7d-9f4d-65323c450348" status: 200 len: 1730 microversion: 2.20 time: 0.183606 Oct 13 13:15:52.090350 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 373/763] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 13:15:51 2022] GET /compute/v2.1/servers/c3478cd4-e4ab-4a7d-9f4d-65323c450348 => generated 1730 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 13:15:52.613209 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-bf45ec48-6cc9-4736-84a2-c065645ccc8b tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Calling method '>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:15:52.615469 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-bf45ec48-6cc9-4736-84a2-c065645ccc8b tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] [instance: 2aa89397-329a-494c-8b4b-fa7e513d3171] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:15:52.621440 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-bf45ec48-6cc9-4736-84a2-c065645ccc8b tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:15:52.621921 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-bf45ec48-6cc9-4736-84a2-c065645ccc8b tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:15:52.622353 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-bf45ec48-6cc9-4736-84a2-c065645ccc8b tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:15:52.623030 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-bf45ec48-6cc9-4736-84a2-c065645ccc8b tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:15:52.623517 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-bf45ec48-6cc9-4736-84a2-c065645ccc8b tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:15:52.623934 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-bf45ec48-6cc9-4736-84a2-c065645ccc8b tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:15:52.654691 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-bf45ec48-6cc9-4736-84a2-c065645ccc8b tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] 10.222.0.23 "GET /compute/v2.1/servers/2aa89397-329a-494c-8b4b-fa7e513d3171/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045221 Oct 13 13:15:52.655192 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 391/764] 10.222.0.23 () {58 vars in 1302 bytes} [Thu Oct 13 13:15:52 2022] GET /compute/v2.1/servers/2aa89397-329a-494c-8b4b-fa7e513d3171/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 13 13:15:52.770253 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-22397a98-19a5-4aa5-933b-b4ba88cf9879 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Calling method '>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:15:52.772511 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-22397a98-19a5-4aa5-933b-b4ba88cf9879 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] [instance: 2aa89397-329a-494c-8b4b-fa7e513d3171] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:15:52.779750 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-22397a98-19a5-4aa5-933b-b4ba88cf9879 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:15:52.779988 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-22397a98-19a5-4aa5-933b-b4ba88cf9879 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:15:52.780434 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-22397a98-19a5-4aa5-933b-b4ba88cf9879 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:15:52.781128 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-22397a98-19a5-4aa5-933b-b4ba88cf9879 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:15:52.781586 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-22397a98-19a5-4aa5-933b-b4ba88cf9879 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:15:52.782012 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-22397a98-19a5-4aa5-933b-b4ba88cf9879 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:15:52.786676 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-61844e26-c029-4a45-aa60-caf047ce3b6d tempest-VolumesActionsTest-194871335 tempest-VolumesActionsTest-194871335-project] Calling method '>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:15:52.787464 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-61844e26-c029-4a45-aa60-caf047ce3b6d tempest-VolumesActionsTest-194871335 tempest-VolumesActionsTest-194871335-project] [instance: 48ce53de-edd3-4295-84bf-6d91081962b4] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:15:52.794076 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-61844e26-c029-4a45-aa60-caf047ce3b6d tempest-VolumesActionsTest-194871335 tempest-VolumesActionsTest-194871335-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:15:52.795480 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-61844e26-c029-4a45-aa60-caf047ce3b6d tempest-VolumesActionsTest-194871335 tempest-VolumesActionsTest-194871335-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:15:52.795900 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-61844e26-c029-4a45-aa60-caf047ce3b6d tempest-VolumesActionsTest-194871335 tempest-VolumesActionsTest-194871335-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:15:52.797055 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-61844e26-c029-4a45-aa60-caf047ce3b6d tempest-VolumesActionsTest-194871335 tempest-VolumesActionsTest-194871335-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:15:52.797623 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-61844e26-c029-4a45-aa60-caf047ce3b6d tempest-VolumesActionsTest-194871335 tempest-VolumesActionsTest-194871335-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:15:52.798146 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-61844e26-c029-4a45-aa60-caf047ce3b6d tempest-VolumesActionsTest-194871335 tempest-VolumesActionsTest-194871335-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:15:52.812559 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-22397a98-19a5-4aa5-933b-b4ba88cf9879 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] 10.222.0.23 "GET /compute/v2.1/servers/2aa89397-329a-494c-8b4b-fa7e513d3171/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046171 Oct 13 13:15:52.813397 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 374/765] 10.222.0.23 () {58 vars in 1302 bytes} [Thu Oct 13 13:15:52 2022] GET /compute/v2.1/servers/2aa89397-329a-494c-8b4b-fa7e513d3171/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 13 13:15:52.881888 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-745dd20c-1a58-47d1-ac03-518f4ba274d4 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Calling method '>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:15:52.882753 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-745dd20c-1a58-47d1-ac03-518f4ba274d4 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] [instance: 2aa89397-329a-494c-8b4b-fa7e513d3171] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:15:52.889474 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-745dd20c-1a58-47d1-ac03-518f4ba274d4 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:15:52.889961 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-745dd20c-1a58-47d1-ac03-518f4ba274d4 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:15:52.890394 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-745dd20c-1a58-47d1-ac03-518f4ba274d4 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:15:52.891113 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-745dd20c-1a58-47d1-ac03-518f4ba274d4 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:15:52.891572 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-745dd20c-1a58-47d1-ac03-518f4ba274d4 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:15:52.892003 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-745dd20c-1a58-47d1-ac03-518f4ba274d4 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:15:52.920518 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-745dd20c-1a58-47d1-ac03-518f4ba274d4 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] [instance: 2aa89397-329a-494c-8b4b-fa7e513d3171] Going to try to terminate instance {{(pid=118815) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 13 13:15:52.945117 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-61844e26-c029-4a45-aa60-caf047ce3b6d tempest-VolumesActionsTest-194871335 tempest-VolumesActionsTest-194871335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18920ad97e6946df9689bd6d4abd50b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12163a99662b48759b3fd7da51445ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:15:52.954103 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-61844e26-c029-4a45-aa60-caf047ce3b6d tempest-VolumesActionsTest-194871335 tempest-VolumesActionsTest-194871335-project] 10.222.0.23 "GET /compute/v2.1/servers/48ce53de-edd3-4295-84bf-6d91081962b4" status: 200 len: 1313 microversion: 2.1 time: 0.171810 Oct 13 13:15:52.954670 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 392/766] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:15:52 2022] GET /compute/v2.1/servers/48ce53de-edd3-4295-84bf-6d91081962b4 => generated 1313 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:15:53.009669 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-745dd20c-1a58-47d1-ac03-518f4ba274d4 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] 10.222.0.23 "DELETE /compute/v2.1/servers/2aa89397-329a-494c-8b4b-fa7e513d3171" status: 204 len: 0 microversion: 2.1 time: 0.131247 Oct 13 13:15:53.010596 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 375/767] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Oct 13 13:15:52 2022] DELETE /compute/v2.1/servers/2aa89397-329a-494c-8b4b-fa7e513d3171 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 13 13:15:53.020260 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-814d1eee-00ad-4b79-96a7-d920113a1860 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Calling method '>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:15:53.020977 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-814d1eee-00ad-4b79-96a7-d920113a1860 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] [instance: 2aa89397-329a-494c-8b4b-fa7e513d3171] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:15:53.027103 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-814d1eee-00ad-4b79-96a7-d920113a1860 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:15:53.027629 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-814d1eee-00ad-4b79-96a7-d920113a1860 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:15:53.028257 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-814d1eee-00ad-4b79-96a7-d920113a1860 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:15:53.028951 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-814d1eee-00ad-4b79-96a7-d920113a1860 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:15:53.029407 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-814d1eee-00ad-4b79-96a7-d920113a1860 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:15:53.029834 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-814d1eee-00ad-4b79-96a7-d920113a1860 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:15:53.116219 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-04244aca-5803-46e8-8d95-11d9ed147548 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Calling method '>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:15:53.117133 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-04244aca-5803-46e8-8d95-11d9ed147548 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] [instance: c3478cd4-e4ab-4a7d-9f4d-65323c450348] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:15:53.124133 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-04244aca-5803-46e8-8d95-11d9ed147548 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:15:53.124951 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-04244aca-5803-46e8-8d95-11d9ed147548 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:15:53.125384 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-04244aca-5803-46e8-8d95-11d9ed147548 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:15:53.126257 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-04244aca-5803-46e8-8d95-11d9ed147548 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:15:53.126863 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-04244aca-5803-46e8-8d95-11d9ed147548 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:15:53.127463 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-04244aca-5803-46e8-8d95-11d9ed147548 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:15:53.164388 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-814d1eee-00ad-4b79-96a7-d920113a1860 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e783caddcad473dbdd764919286e244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecd3d5d2a3a54a07ba64f1fea4846c40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:15:53.172248 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-814d1eee-00ad-4b79-96a7-d920113a1860 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] 10.222.0.23 "GET /compute/v2.1/servers/2aa89397-329a-494c-8b4b-fa7e513d3171" status: 200 len: 1674 microversion: 2.1 time: 0.156523 Oct 13 13:15:53.172912 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 393/768] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:15:53 2022] GET /compute/v2.1/servers/2aa89397-329a-494c-8b4b-fa7e513d3171 => generated 1674 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 13:15:53.232094 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [req-5319d69f-c3d8-4d9b-82be-2716b45bfe33 req-6d4d1043-630c-4472-8ece-54a565da4fdf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "48ce53de-edd3-4295-84bf-6d91081962b4", "tag": "386cac14-ed13-4c42-852a-c038b6163a36"}]} {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 13:15:53.241995 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [req-5319d69f-c3d8-4d9b-82be-2716b45bfe33 req-6d4d1043-630c-4472-8ece-54a565da4fdf service nova] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:15:53.242473 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [req-5319d69f-c3d8-4d9b-82be-2716b45bfe33 req-6d4d1043-630c-4472-8ece-54a565da4fdf service nova] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:15:53.242897 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [req-5319d69f-c3d8-4d9b-82be-2716b45bfe33 req-6d4d1043-630c-4472-8ece-54a565da4fdf service nova] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:15:53.255906 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.compute.server_external_events [req-5319d69f-c3d8-4d9b-82be-2716b45bfe33 req-6d4d1043-630c-4472-8ece-54a565da4fdf service nova] Creating event network-changed:386cac14-ed13-4c42-852a-c038b6163a36 for instance 48ce53de-edd3-4295-84bf-6d91081962b4 on hv-cinder-82660 Oct 13 13:15:53.261468 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [req-5319d69f-c3d8-4d9b-82be-2716b45bfe33 req-6d4d1043-630c-4472-8ece-54a565da4fdf service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032949 Oct 13 13:15:53.263118 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 394/769] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 13:15:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 13 13:15:53.271242 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-04244aca-5803-46e8-8d95-11d9ed147548 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:15:53.280198 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-04244aca-5803-46e8-8d95-11d9ed147548 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:15:53.283162 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-04244aca-5803-46e8-8d95-11d9ed147548 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:15:53.284396 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-04244aca-5803-46e8-8d95-11d9ed147548 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] 10.222.0.23 "GET /compute/v2.1/servers/c3478cd4-e4ab-4a7d-9f4d-65323c450348" status: 200 len: 1730 microversion: 2.20 time: 0.172353 Oct 13 13:15:53.285021 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 376/770] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 13:15:53 2022] GET /compute/v2.1/servers/c3478cd4-e4ab-4a7d-9f4d-65323c450348 => generated 1730 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 13 13:15:53.978065 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-e811ea47-2af3-4ea3-8999-2152399a88bb tempest-VolumesActionsTest-194871335 tempest-VolumesActionsTest-194871335-project] Calling method '>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:15:53.978765 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-e811ea47-2af3-4ea3-8999-2152399a88bb tempest-VolumesActionsTest-194871335 tempest-VolumesActionsTest-194871335-project] [instance: 48ce53de-edd3-4295-84bf-6d91081962b4] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:15:53.985586 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-e811ea47-2af3-4ea3-8999-2152399a88bb tempest-VolumesActionsTest-194871335 tempest-VolumesActionsTest-194871335-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:15:53.986105 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-e811ea47-2af3-4ea3-8999-2152399a88bb tempest-VolumesActionsTest-194871335 tempest-VolumesActionsTest-194871335-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:15:53.986506 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-e811ea47-2af3-4ea3-8999-2152399a88bb tempest-VolumesActionsTest-194871335 tempest-VolumesActionsTest-194871335-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:15:53.987223 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-e811ea47-2af3-4ea3-8999-2152399a88bb tempest-VolumesActionsTest-194871335 tempest-VolumesActionsTest-194871335-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:15:53.987677 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-e811ea47-2af3-4ea3-8999-2152399a88bb tempest-VolumesActionsTest-194871335 tempest-VolumesActionsTest-194871335-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:15:53.988099 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-e811ea47-2af3-4ea3-8999-2152399a88bb tempest-VolumesActionsTest-194871335 tempest-VolumesActionsTest-194871335-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:15:54.114059 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-e811ea47-2af3-4ea3-8999-2152399a88bb tempest-VolumesActionsTest-194871335 tempest-VolumesActionsTest-194871335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18920ad97e6946df9689bd6d4abd50b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12163a99662b48759b3fd7da51445ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:15:54.122321 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-e811ea47-2af3-4ea3-8999-2152399a88bb tempest-VolumesActionsTest-194871335 tempest-VolumesActionsTest-194871335-project] 10.222.0.23 "GET /compute/v2.1/servers/48ce53de-edd3-4295-84bf-6d91081962b4" status: 200 len: 1313 microversion: 2.1 time: 0.148967 Oct 13 13:15:54.122879 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 395/771] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:15:53 2022] GET /compute/v2.1/servers/48ce53de-edd3-4295-84bf-6d91081962b4 => generated 1313 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:15:54.196621 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-66b8db6d-31cb-425f-a523-c83c142c6f12 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Calling method '>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:15:54.197155 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-66b8db6d-31cb-425f-a523-c83c142c6f12 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] [instance: 2aa89397-329a-494c-8b4b-fa7e513d3171] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:15:54.204169 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-66b8db6d-31cb-425f-a523-c83c142c6f12 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:15:54.204693 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-66b8db6d-31cb-425f-a523-c83c142c6f12 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:15:54.205122 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-66b8db6d-31cb-425f-a523-c83c142c6f12 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:15:54.205795 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-66b8db6d-31cb-425f-a523-c83c142c6f12 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:15:54.206242 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-66b8db6d-31cb-425f-a523-c83c142c6f12 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:15:54.206659 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-66b8db6d-31cb-425f-a523-c83c142c6f12 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:15:54.309559 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-9fd568e0-fa6f-443d-9558-66cf32e312bd tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Calling method '>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:15:54.310167 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-9fd568e0-fa6f-443d-9558-66cf32e312bd tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] [instance: c3478cd4-e4ab-4a7d-9f4d-65323c450348] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:15:54.316175 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-9fd568e0-fa6f-443d-9558-66cf32e312bd tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:15:54.316654 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-9fd568e0-fa6f-443d-9558-66cf32e312bd tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:15:54.317092 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-9fd568e0-fa6f-443d-9558-66cf32e312bd tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:15:54.317774 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-9fd568e0-fa6f-443d-9558-66cf32e312bd tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:15:54.318217 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-9fd568e0-fa6f-443d-9558-66cf32e312bd tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:15:54.318630 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-9fd568e0-fa6f-443d-9558-66cf32e312bd tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:15:54.345248 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-66b8db6d-31cb-425f-a523-c83c142c6f12 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e783caddcad473dbdd764919286e244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecd3d5d2a3a54a07ba64f1fea4846c40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:15:54.353921 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-66b8db6d-31cb-425f-a523-c83c142c6f12 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] 10.222.0.23 "GET /compute/v2.1/servers/2aa89397-329a-494c-8b4b-fa7e513d3171" status: 200 len: 1674 microversion: 2.1 time: 0.161086 Oct 13 13:15:54.354501 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 377/772] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:15:54 2022] GET /compute/v2.1/servers/2aa89397-329a-494c-8b4b-fa7e513d3171 => generated 1674 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:15:54.453460 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-9fd568e0-fa6f-443d-9558-66cf32e312bd tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:15:54.461873 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-9fd568e0-fa6f-443d-9558-66cf32e312bd tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:15:54.463383 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-9fd568e0-fa6f-443d-9558-66cf32e312bd tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:15:54.465524 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-9fd568e0-fa6f-443d-9558-66cf32e312bd tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] 10.222.0.23 "GET /compute/v2.1/servers/c3478cd4-e4ab-4a7d-9f4d-65323c450348" status: 200 len: 1730 microversion: 2.20 time: 0.158951 Oct 13 13:15:54.466074 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 396/773] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 13:15:54 2022] GET /compute/v2.1/servers/c3478cd4-e4ab-4a7d-9f4d-65323c450348 => generated 1730 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 13 13:15:55.145714 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-e041c8d0-450c-40be-a57a-4ea346989e28 tempest-VolumesActionsTest-194871335 tempest-VolumesActionsTest-194871335-project] Calling method '>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:15:55.146323 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-e041c8d0-450c-40be-a57a-4ea346989e28 tempest-VolumesActionsTest-194871335 tempest-VolumesActionsTest-194871335-project] [instance: 48ce53de-edd3-4295-84bf-6d91081962b4] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:15:55.152284 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-e041c8d0-450c-40be-a57a-4ea346989e28 tempest-VolumesActionsTest-194871335 tempest-VolumesActionsTest-194871335-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:15:55.152786 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-e041c8d0-450c-40be-a57a-4ea346989e28 tempest-VolumesActionsTest-194871335 tempest-VolumesActionsTest-194871335-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:15:55.153214 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-e041c8d0-450c-40be-a57a-4ea346989e28 tempest-VolumesActionsTest-194871335 tempest-VolumesActionsTest-194871335-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:15:55.153893 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-e041c8d0-450c-40be-a57a-4ea346989e28 tempest-VolumesActionsTest-194871335 tempest-VolumesActionsTest-194871335-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:15:55.154367 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-e041c8d0-450c-40be-a57a-4ea346989e28 tempest-VolumesActionsTest-194871335 tempest-VolumesActionsTest-194871335-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:15:55.154782 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-e041c8d0-450c-40be-a57a-4ea346989e28 tempest-VolumesActionsTest-194871335 tempest-VolumesActionsTest-194871335-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:15:55.157393 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG dbcounter [-] [118815] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=118815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:15:55.299967 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-e041c8d0-450c-40be-a57a-4ea346989e28 tempest-VolumesActionsTest-194871335 tempest-VolumesActionsTest-194871335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18920ad97e6946df9689bd6d4abd50b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12163a99662b48759b3fd7da51445ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:15:55.307494 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-e041c8d0-450c-40be-a57a-4ea346989e28 tempest-VolumesActionsTest-194871335 tempest-VolumesActionsTest-194871335-project] 10.222.0.23 "GET /compute/v2.1/servers/48ce53de-edd3-4295-84bf-6d91081962b4" status: 200 len: 1313 microversion: 2.1 time: 0.165643 Oct 13 13:15:55.308059 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 378/774] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:15:55 2022] GET /compute/v2.1/servers/48ce53de-edd3-4295-84bf-6d91081962b4 => generated 1313 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:15:55.377249 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-7c541ea0-ed9d-43f5-9b7f-4e1467edcef8 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Calling method '>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:15:55.377851 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-7c541ea0-ed9d-43f5-9b7f-4e1467edcef8 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] [instance: 2aa89397-329a-494c-8b4b-fa7e513d3171] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:15:55.384862 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-7c541ea0-ed9d-43f5-9b7f-4e1467edcef8 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:15:55.385335 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-7c541ea0-ed9d-43f5-9b7f-4e1467edcef8 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:15:55.385765 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-7c541ea0-ed9d-43f5-9b7f-4e1467edcef8 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:15:55.386443 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-7c541ea0-ed9d-43f5-9b7f-4e1467edcef8 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:15:55.386993 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-7c541ea0-ed9d-43f5-9b7f-4e1467edcef8 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:15:55.387459 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-7c541ea0-ed9d-43f5-9b7f-4e1467edcef8 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:15:55.492153 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-372a30a3-b2c6-4a24-91ed-aff3750c224c tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Calling method '>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:15:55.492671 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-372a30a3-b2c6-4a24-91ed-aff3750c224c tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] [instance: c3478cd4-e4ab-4a7d-9f4d-65323c450348] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:15:55.498486 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-372a30a3-b2c6-4a24-91ed-aff3750c224c tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:15:55.498962 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-372a30a3-b2c6-4a24-91ed-aff3750c224c tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:15:55.499451 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-372a30a3-b2c6-4a24-91ed-aff3750c224c tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:15:55.500138 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-372a30a3-b2c6-4a24-91ed-aff3750c224c tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:15:55.500585 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-372a30a3-b2c6-4a24-91ed-aff3750c224c tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:15:55.501004 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-372a30a3-b2c6-4a24-91ed-aff3750c224c tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:15:55.519645 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-7c541ea0-ed9d-43f5-9b7f-4e1467edcef8 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e783caddcad473dbdd764919286e244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecd3d5d2a3a54a07ba64f1fea4846c40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:15:55.528387 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-7c541ea0-ed9d-43f5-9b7f-4e1467edcef8 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] 10.222.0.23 "GET /compute/v2.1/servers/2aa89397-329a-494c-8b4b-fa7e513d3171" status: 200 len: 1674 microversion: 2.1 time: 0.155113 Oct 13 13:15:55.529699 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 397/775] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:15:55 2022] GET /compute/v2.1/servers/2aa89397-329a-494c-8b4b-fa7e513d3171 => generated 1674 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:15:55.639764 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-372a30a3-b2c6-4a24-91ed-aff3750c224c tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:15:55.648547 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-372a30a3-b2c6-4a24-91ed-aff3750c224c tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:15:55.650105 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-372a30a3-b2c6-4a24-91ed-aff3750c224c tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:15:55.651372 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-372a30a3-b2c6-4a24-91ed-aff3750c224c tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] 10.222.0.23 "GET /compute/v2.1/servers/c3478cd4-e4ab-4a7d-9f4d-65323c450348" status: 200 len: 1717 microversion: 2.20 time: 0.163258 Oct 13 13:15:55.652004 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 379/776] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 13:15:55 2022] GET /compute/v2.1/servers/c3478cd4-e4ab-4a7d-9f4d-65323c450348 => generated 1717 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 13 13:15:56.330484 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-3da38af7-1b0b-4e13-b054-ecd2d8ba4e0a tempest-VolumesActionsTest-194871335 tempest-VolumesActionsTest-194871335-project] Calling method '>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:15:56.331116 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-3da38af7-1b0b-4e13-b054-ecd2d8ba4e0a tempest-VolumesActionsTest-194871335 tempest-VolumesActionsTest-194871335-project] [instance: 48ce53de-edd3-4295-84bf-6d91081962b4] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:15:56.337322 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-3da38af7-1b0b-4e13-b054-ecd2d8ba4e0a tempest-VolumesActionsTest-194871335 tempest-VolumesActionsTest-194871335-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:15:56.337804 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-3da38af7-1b0b-4e13-b054-ecd2d8ba4e0a tempest-VolumesActionsTest-194871335 tempest-VolumesActionsTest-194871335-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:15:56.338236 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-3da38af7-1b0b-4e13-b054-ecd2d8ba4e0a tempest-VolumesActionsTest-194871335 tempest-VolumesActionsTest-194871335-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:15:56.338931 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-3da38af7-1b0b-4e13-b054-ecd2d8ba4e0a tempest-VolumesActionsTest-194871335 tempest-VolumesActionsTest-194871335-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:15:56.339398 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-3da38af7-1b0b-4e13-b054-ecd2d8ba4e0a tempest-VolumesActionsTest-194871335 tempest-VolumesActionsTest-194871335-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:15:56.339917 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-3da38af7-1b0b-4e13-b054-ecd2d8ba4e0a tempest-VolumesActionsTest-194871335 tempest-VolumesActionsTest-194871335-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:15:56.484057 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-3da38af7-1b0b-4e13-b054-ecd2d8ba4e0a tempest-VolumesActionsTest-194871335 tempest-VolumesActionsTest-194871335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18920ad97e6946df9689bd6d4abd50b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12163a99662b48759b3fd7da51445ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:15:56.492223 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-3da38af7-1b0b-4e13-b054-ecd2d8ba4e0a tempest-VolumesActionsTest-194871335 tempest-VolumesActionsTest-194871335-project] 10.222.0.23 "GET /compute/v2.1/servers/48ce53de-edd3-4295-84bf-6d91081962b4" status: 200 len: 1313 microversion: 2.1 time: 0.165630 Oct 13 13:15:56.492975 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 398/777] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:15:56 2022] GET /compute/v2.1/servers/48ce53de-edd3-4295-84bf-6d91081962b4 => generated 1313 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:15:56.553755 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-0e9d4074-c978-4d83-8058-4bfe6fd52727 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Calling method '>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:15:56.554482 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-0e9d4074-c978-4d83-8058-4bfe6fd52727 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] [instance: 2aa89397-329a-494c-8b4b-fa7e513d3171] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:15:56.561553 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-0e9d4074-c978-4d83-8058-4bfe6fd52727 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:15:56.562033 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-0e9d4074-c978-4d83-8058-4bfe6fd52727 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:15:56.562465 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-0e9d4074-c978-4d83-8058-4bfe6fd52727 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:15:56.563218 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-0e9d4074-c978-4d83-8058-4bfe6fd52727 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:15:56.563670 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-0e9d4074-c978-4d83-8058-4bfe6fd52727 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:15:56.564090 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-0e9d4074-c978-4d83-8058-4bfe6fd52727 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:15:56.626264 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-0e9d4074-c978-4d83-8058-4bfe6fd52727 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e783caddcad473dbdd764919286e244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecd3d5d2a3a54a07ba64f1fea4846c40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:15:56.634347 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-0e9d4074-c978-4d83-8058-4bfe6fd52727 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] 10.222.0.23 "GET /compute/v2.1/servers/2aa89397-329a-494c-8b4b-fa7e513d3171" status: 200 len: 1607 microversion: 2.1 time: 0.084996 Oct 13 13:15:56.634925 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 380/778] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:15:56 2022] GET /compute/v2.1/servers/2aa89397-329a-494c-8b4b-fa7e513d3171 => generated 1607 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:15:56.757720 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [req-43acb09a-850d-4c50-ba99-d79f33ac75c2 req-77532c40-3642-42f6-8da6-a2044d25b399 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2aa89397-329a-494c-8b4b-fa7e513d3171", "name": "network-vif-deleted", "tag": "c2c3f2c7-45cd-4ffe-85fe-fc2012972cc8"}]} {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 13:15:56.767741 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [req-43acb09a-850d-4c50-ba99-d79f33ac75c2 req-77532c40-3642-42f6-8da6-a2044d25b399 service nova] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:15:56.768301 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [req-43acb09a-850d-4c50-ba99-d79f33ac75c2 req-77532c40-3642-42f6-8da6-a2044d25b399 service nova] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:15:56.768792 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [req-43acb09a-850d-4c50-ba99-d79f33ac75c2 req-77532c40-3642-42f6-8da6-a2044d25b399 service nova] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:15:56.783315 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.compute.server_external_events [req-43acb09a-850d-4c50-ba99-d79f33ac75c2 req-77532c40-3642-42f6-8da6-a2044d25b399 service nova] Creating event network-vif-deleted:c2c3f2c7-45cd-4ffe-85fe-fc2012972cc8 for instance 2aa89397-329a-494c-8b4b-fa7e513d3171 on hv-cinder-82660 Oct 13 13:15:56.788537 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [req-43acb09a-850d-4c50-ba99-d79f33ac75c2 req-77532c40-3642-42f6-8da6-a2044d25b399 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034901 Oct 13 13:15:56.789123 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 399/779] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 13:15:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 13:15:57.517707 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-be7d37f3-3d9b-4c86-ad0d-68fe59942896 tempest-VolumesActionsTest-194871335 tempest-VolumesActionsTest-194871335-project] Calling method '>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:15:57.518468 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-be7d37f3-3d9b-4c86-ad0d-68fe59942896 tempest-VolumesActionsTest-194871335 tempest-VolumesActionsTest-194871335-project] [instance: 48ce53de-edd3-4295-84bf-6d91081962b4] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:15:57.525208 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-be7d37f3-3d9b-4c86-ad0d-68fe59942896 tempest-VolumesActionsTest-194871335 tempest-VolumesActionsTest-194871335-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:15:57.525869 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-be7d37f3-3d9b-4c86-ad0d-68fe59942896 tempest-VolumesActionsTest-194871335 tempest-VolumesActionsTest-194871335-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:15:57.526408 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-be7d37f3-3d9b-4c86-ad0d-68fe59942896 tempest-VolumesActionsTest-194871335 tempest-VolumesActionsTest-194871335-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:15:57.527397 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-be7d37f3-3d9b-4c86-ad0d-68fe59942896 tempest-VolumesActionsTest-194871335 tempest-VolumesActionsTest-194871335-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:15:57.528087 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-be7d37f3-3d9b-4c86-ad0d-68fe59942896 tempest-VolumesActionsTest-194871335 tempest-VolumesActionsTest-194871335-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:15:57.528622 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-be7d37f3-3d9b-4c86-ad0d-68fe59942896 tempest-VolumesActionsTest-194871335 tempest-VolumesActionsTest-194871335-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:15:57.658680 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-fad4580d-f269-449c-805e-f5d3e534c517 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Calling method '>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:15:57.659455 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-fad4580d-f269-449c-805e-f5d3e534c517 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] [instance: 2aa89397-329a-494c-8b4b-fa7e513d3171] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:15:57.680232 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-fad4580d-f269-449c-805e-f5d3e534c517 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:15:57.680737 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-fad4580d-f269-449c-805e-f5d3e534c517 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:15:57.681178 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-fad4580d-f269-449c-805e-f5d3e534c517 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:15:57.681887 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-fad4580d-f269-449c-805e-f5d3e534c517 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:15:57.682342 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-fad4580d-f269-449c-805e-f5d3e534c517 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:15:57.685281 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-fad4580d-f269-449c-805e-f5d3e534c517 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:15:57.700846 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-be7d37f3-3d9b-4c86-ad0d-68fe59942896 tempest-VolumesActionsTest-194871335 tempest-VolumesActionsTest-194871335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18920ad97e6946df9689bd6d4abd50b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12163a99662b48759b3fd7da51445ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:15:57.727360 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-be7d37f3-3d9b-4c86-ad0d-68fe59942896 tempest-VolumesActionsTest-194871335 tempest-VolumesActionsTest-194871335-project] 10.222.0.23 "GET /compute/v2.1/servers/48ce53de-edd3-4295-84bf-6d91081962b4" status: 200 len: 1313 microversion: 2.1 time: 0.214093 Oct 13 13:15:57.731496 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 381/780] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:15:57 2022] GET /compute/v2.1/servers/48ce53de-edd3-4295-84bf-6d91081962b4 => generated 1313 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:15:57.738771 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-fad4580d-f269-449c-805e-f5d3e534c517 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:15:57.739694 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-fad4580d-f269-449c-805e-f5d3e534c517 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:15:57.740421 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-fad4580d-f269-449c-805e-f5d3e534c517 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:15:57.740891 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.objects.instance [None req-fad4580d-f269-449c-805e-f5d3e534c517 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lazy-loading 'fault' on Instance uuid 2aa89397-329a-494c-8b4b-fa7e513d3171 {{(pid=118814) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 13 13:15:57.815561 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-fad4580d-f269-449c-805e-f5d3e534c517 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e783caddcad473dbdd764919286e244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecd3d5d2a3a54a07ba64f1fea4846c40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:15:57.836590 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-fad4580d-f269-449c-805e-f5d3e534c517 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] 10.222.0.23 "GET /compute/v2.1/servers/2aa89397-329a-494c-8b4b-fa7e513d3171" status: 200 len: 1327 microversion: 2.1 time: 0.180715 Oct 13 13:15:57.837190 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 400/781] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:15:57 2022] GET /compute/v2.1/servers/2aa89397-329a-494c-8b4b-fa7e513d3171 => generated 1327 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:15:58.753757 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-d7320518-1081-4a75-9206-3f4da96b0364 tempest-VolumesActionsTest-194871335 tempest-VolumesActionsTest-194871335-project] Calling method '>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:15:58.754393 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-d7320518-1081-4a75-9206-3f4da96b0364 tempest-VolumesActionsTest-194871335 tempest-VolumesActionsTest-194871335-project] [instance: 48ce53de-edd3-4295-84bf-6d91081962b4] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:15:58.760827 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-d7320518-1081-4a75-9206-3f4da96b0364 tempest-VolumesActionsTest-194871335 tempest-VolumesActionsTest-194871335-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:15:58.761309 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-d7320518-1081-4a75-9206-3f4da96b0364 tempest-VolumesActionsTest-194871335 tempest-VolumesActionsTest-194871335-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:15:58.761747 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-d7320518-1081-4a75-9206-3f4da96b0364 tempest-VolumesActionsTest-194871335 tempest-VolumesActionsTest-194871335-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:15:58.762439 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-d7320518-1081-4a75-9206-3f4da96b0364 tempest-VolumesActionsTest-194871335 tempest-VolumesActionsTest-194871335-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:15:58.762890 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-d7320518-1081-4a75-9206-3f4da96b0364 tempest-VolumesActionsTest-194871335 tempest-VolumesActionsTest-194871335-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:15:58.763345 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-d7320518-1081-4a75-9206-3f4da96b0364 tempest-VolumesActionsTest-194871335 tempest-VolumesActionsTest-194871335-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:15:58.861292 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-4a7b2c12-87ae-4c3a-91c2-fc22e7396207 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Calling method '>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:15:58.862068 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-4a7b2c12-87ae-4c3a-91c2-fc22e7396207 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] [instance: 2aa89397-329a-494c-8b4b-fa7e513d3171] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:15:58.868486 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-4a7b2c12-87ae-4c3a-91c2-fc22e7396207 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:15:58.868961 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-4a7b2c12-87ae-4c3a-91c2-fc22e7396207 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:15:58.869402 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-4a7b2c12-87ae-4c3a-91c2-fc22e7396207 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:15:58.870092 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-4a7b2c12-87ae-4c3a-91c2-fc22e7396207 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:15:58.870573 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-4a7b2c12-87ae-4c3a-91c2-fc22e7396207 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:15:58.871669 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-4a7b2c12-87ae-4c3a-91c2-fc22e7396207 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:15:58.885092 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.wsgi [None req-4a7b2c12-87ae-4c3a-91c2-fc22e7396207 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] HTTP exception thrown: Instance 2aa89397-329a-494c-8b4b-fa7e513d3171 could not be found. Oct 13 13:15:58.886789 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-4a7b2c12-87ae-4c3a-91c2-fc22e7396207 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Request method failure captured: Oct 13 13:15:58.886789 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: request: GET /compute/v2.1/servers/2aa89397-329a-494c-8b4b-fa7e513d3171 HTTP/1.1 Oct 13 13:15:58.886789 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: Accept: application/json Oct 13 13:15:58.886789 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: Accept-Encoding: identity Oct 13 13:15:58.886789 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: Connection: close Oct 13 13:15:58.886789 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: Content-Length: 0 Oct 13 13:15:58.886789 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: Content-Type: application/json Oct 13 13:15:58.886789 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: Host: 10.222.0.23 Oct 13 13:15:58.886789 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: Openstack-System-Scope: None Oct 13 13:15:58.886789 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: User-Agent: python-urllib3/1.26.12 Oct 13 13:15:58.886789 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Auth-Token: gAAAAABjSA4j2QZ79JADlbjw7OER1BQZIiLZ1uCyFy0h36PJaXCQoDK_yCwayKC5Dar6tv1xHn9Cdo-oanif51w0YCyPjllC9Rp_s6doFqdHrbagiQe_kWvWm9qSmDfIBvi6knMX5BwHXrEbR4L15OTJyRFkB4RlDw3ylQxb4D5_yL2WGeVHmtE Oct 13 13:15:58.886789 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Domain-Id: None Oct 13 13:15:58.886789 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Domain-Name: None Oct 13 13:15:58.886789 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Identity-Status: Confirmed Oct 13 13:15:58.886789 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Is-Admin-Project: True Oct 13 13:15:58.886789 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Project-Domain-Id: default Oct 13 13:15:58.886789 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Project-Domain-Name: Default Oct 13 13:15:58.886789 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Project-Id: ecd3d5d2a3a54a07ba64f1fea4846c40 Oct 13 13:15:58.886789 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Project-Name: tempest-AttachVolumeTestJSON-1763301118 Oct 13 13:15:58.886789 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Role: reader,member Oct 13 13:15:58.886789 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Roles: reader,member Oct 13 13:15:58.888348 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_ecd3d5d2a3a54a07ba64f1fea4846c40"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ecd3d5d2a3a54a07ba64f1fea4846c40"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ecd3d5d2a3a54a07ba64f1fea4846c40"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/ecd3d5d2a3a54a07ba64f1fea4846c40"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}] Oct 13 13:15:58.888348 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Tenant: tempest-AttachVolumeTestJSON-1763301118 Oct 13 13:15:58.888348 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Tenant-Id: ecd3d5d2a3a54a07ba64f1fea4846c40 Oct 13 13:15:58.888348 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1763301118 Oct 13 13:15:58.888348 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-User: tempest-AttachVolumeTestJSON-1763301118-project Oct 13 13:15:58.888348 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-User-Domain-Id: default Oct 13 13:15:58.888348 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-User-Domain-Name: Default Oct 13 13:15:58.888348 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-User-Id: 2e783caddcad473dbdd764919286e244 Oct 13 13:15:58.888348 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-User-Name: tempest-AttachVolumeTestJSON-1763301118-project Oct 13 13:15:58.888348 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: method: > Oct 13 13:15:58.888348 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: exception: Instance 2aa89397-329a-494c-8b4b-fa7e513d3171 could not be found. Oct 13 13:15:58.888348 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: action_args: {'id': '2aa89397-329a-494c-8b4b-fa7e513d3171'} Oct 13 13:15:58.889325 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 13:15:58.889325 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 13:15:58.889325 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 13 13:15:58.889325 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 13 13:15:58.889325 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 13 13:15:58.889325 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 13 13:15:58.889325 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 13 13:15:58.889325 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 13 13:15:58.889325 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 13 13:15:58.889325 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 13 13:15:58.889325 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2aa89397-329a-494c-8b4b-fa7e513d3171 could not be found. Oct 13 13:15:58.889325 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi Oct 13 13:15:58.889325 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 13:15:58.889325 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi Oct 13 13:15:58.889325 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 13:15:58.889325 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 13:15:58.889325 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 13:15:58.889325 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 13:15:58.889325 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 13:15:58.889325 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 13:15:58.894281 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 13:15:58.894281 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 13 13:15:58.894281 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 13 13:15:58.894281 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 13 13:15:58.894281 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 13 13:15:58.894281 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 13 13:15:58.894281 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 13 13:15:58.894281 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2aa89397-329a-494c-8b4b-fa7e513d3171 could not be found. Oct 13 13:15:58.894281 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi Oct 13 13:15:58.894281 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 13:15:58.894281 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi Oct 13 13:15:58.894281 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 13:15:58.894281 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 13:15:58.894281 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 13:15:58.894281 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 13:15:58.894281 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 13:15:58.894281 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2aa89397-329a-494c-8b4b-fa7e513d3171 could not be found. Oct 13 13:15:58.894281 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi Oct 13 13:15:58.895886 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-4a7b2c12-87ae-4c3a-91c2-fc22e7396207 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Returning 404 to user: Instance 2aa89397-329a-494c-8b4b-fa7e513d3171 could not be found. {{(pid=118814) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 13:15:58.895886 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-4a7b2c12-87ae-4c3a-91c2-fc22e7396207 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] 10.222.0.23 "GET /compute/v2.1/servers/2aa89397-329a-494c-8b4b-fa7e513d3171" status: 404 len: 111 microversion: 2.1 time: 0.030897 Oct 13 13:15:58.895886 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 401/782] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:15:58 2022] GET /compute/v2.1/servers/2aa89397-329a-494c-8b4b-fa7e513d3171 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 13 13:15:58.896137 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-d7320518-1081-4a75-9206-3f4da96b0364 tempest-VolumesActionsTest-194871335 tempest-VolumesActionsTest-194871335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18920ad97e6946df9689bd6d4abd50b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12163a99662b48759b3fd7da51445ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:15:58.901085 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-493fc7a9-2a2b-4d30-80c7-2007f1921b19 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Calling method '.version_select at 0x7f5093d17dc0>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:15:58.901478 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-d7320518-1081-4a75-9206-3f4da96b0364 tempest-VolumesActionsTest-194871335 tempest-VolumesActionsTest-194871335-project] 10.222.0.23 "GET /compute/v2.1/servers/48ce53de-edd3-4295-84bf-6d91081962b4" status: 200 len: 1313 microversion: 2.1 time: 0.151636 Oct 13 13:15:58.902039 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 382/783] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:15:58 2022] GET /compute/v2.1/servers/48ce53de-edd3-4295-84bf-6d91081962b4 => generated 1313 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:15:58.926640 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-493fc7a9-2a2b-4d30-80c7-2007f1921b19 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-137972482" status: 202 len: 0 microversion: 2.1 time: 0.029126 Oct 13 13:15:58.927234 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 402/784] 10.222.0.23 () {58 vars in 1218 bytes} [Thu Oct 13 13:15:58 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-137972482 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 13 13:15:59.677517 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [req-04affb81-c454-4eef-9b32-3ad5de9d3c38 req-5c424b67-bfe7-4a9f-86d5-de7aa5729736 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "48ce53de-edd3-4295-84bf-6d91081962b4", "name": "network-vif-plugged", "status": "completed", "tag": "386cac14-ed13-4c42-852a-c038b6163a36"}]} {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 13:15:59.687580 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [req-04affb81-c454-4eef-9b32-3ad5de9d3c38 req-5c424b67-bfe7-4a9f-86d5-de7aa5729736 service nova] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:15:59.688185 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [req-04affb81-c454-4eef-9b32-3ad5de9d3c38 req-5c424b67-bfe7-4a9f-86d5-de7aa5729736 service nova] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:15:59.688615 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [req-04affb81-c454-4eef-9b32-3ad5de9d3c38 req-5c424b67-bfe7-4a9f-86d5-de7aa5729736 service nova] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:15:59.856881 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.compute.server_external_events [req-04affb81-c454-4eef-9b32-3ad5de9d3c38 req-5c424b67-bfe7-4a9f-86d5-de7aa5729736 service nova] Creating event network-vif-plugged:386cac14-ed13-4c42-852a-c038b6163a36 for instance 48ce53de-edd3-4295-84bf-6d91081962b4 on hv-cinder-82660 Oct 13 13:15:59.861579 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [req-04affb81-c454-4eef-9b32-3ad5de9d3c38 req-5c424b67-bfe7-4a9f-86d5-de7aa5729736 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.188141 Oct 13 13:15:59.862177 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 383/785] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 13:15:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 13:15:59.923666 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-9400bea8-05cf-4fed-9dd1-832aff3068b3 tempest-VolumesActionsTest-194871335 tempest-VolumesActionsTest-194871335-project] Calling method '>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:15:59.925121 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-9400bea8-05cf-4fed-9dd1-832aff3068b3 tempest-VolumesActionsTest-194871335 tempest-VolumesActionsTest-194871335-project] [instance: 48ce53de-edd3-4295-84bf-6d91081962b4] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:15:59.932069 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-9400bea8-05cf-4fed-9dd1-832aff3068b3 tempest-VolumesActionsTest-194871335 tempest-VolumesActionsTest-194871335-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:15:59.932558 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-9400bea8-05cf-4fed-9dd1-832aff3068b3 tempest-VolumesActionsTest-194871335 tempest-VolumesActionsTest-194871335-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:15:59.932996 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-9400bea8-05cf-4fed-9dd1-832aff3068b3 tempest-VolumesActionsTest-194871335 tempest-VolumesActionsTest-194871335-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:15:59.934227 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-9400bea8-05cf-4fed-9dd1-832aff3068b3 tempest-VolumesActionsTest-194871335 tempest-VolumesActionsTest-194871335-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:15:59.934683 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-9400bea8-05cf-4fed-9dd1-832aff3068b3 tempest-VolumesActionsTest-194871335 tempest-VolumesActionsTest-194871335-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:15:59.935128 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-9400bea8-05cf-4fed-9dd1-832aff3068b3 tempest-VolumesActionsTest-194871335 tempest-VolumesActionsTest-194871335-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:16:00.066619 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-9400bea8-05cf-4fed-9dd1-832aff3068b3 tempest-VolumesActionsTest-194871335 tempest-VolumesActionsTest-194871335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18920ad97e6946df9689bd6d4abd50b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12163a99662b48759b3fd7da51445ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:16:00.068940 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG dbcounter [-] [118814] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=118814) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:16:00.076338 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-9400bea8-05cf-4fed-9dd1-832aff3068b3 tempest-VolumesActionsTest-194871335 tempest-VolumesActionsTest-194871335-project] 10.222.0.23 "GET /compute/v2.1/servers/48ce53de-edd3-4295-84bf-6d91081962b4" status: 200 len: 1313 microversion: 2.1 time: 0.157023 Oct 13 13:16:00.076902 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 403/786] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:15:59 2022] GET /compute/v2.1/servers/48ce53de-edd3-4295-84bf-6d91081962b4 => generated 1313 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:16:01.096854 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG dbcounter [-] [118815] Writing DB stats nova_cell0:SELECT=2 {{(pid=118815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:16:01.101454 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-30b579ff-1e8c-403c-9c53-d8f555e005e3 tempest-VolumesActionsTest-194871335 tempest-VolumesActionsTest-194871335-project] Calling method '>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:16:01.102163 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-30b579ff-1e8c-403c-9c53-d8f555e005e3 tempest-VolumesActionsTest-194871335 tempest-VolumesActionsTest-194871335-project] [instance: 48ce53de-edd3-4295-84bf-6d91081962b4] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:16:01.108415 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-30b579ff-1e8c-403c-9c53-d8f555e005e3 tempest-VolumesActionsTest-194871335 tempest-VolumesActionsTest-194871335-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:16:01.108940 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-30b579ff-1e8c-403c-9c53-d8f555e005e3 tempest-VolumesActionsTest-194871335 tempest-VolumesActionsTest-194871335-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:16:01.109368 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-30b579ff-1e8c-403c-9c53-d8f555e005e3 tempest-VolumesActionsTest-194871335 tempest-VolumesActionsTest-194871335-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:16:01.110045 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-30b579ff-1e8c-403c-9c53-d8f555e005e3 tempest-VolumesActionsTest-194871335 tempest-VolumesActionsTest-194871335-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:16:01.110492 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-30b579ff-1e8c-403c-9c53-d8f555e005e3 tempest-VolumesActionsTest-194871335 tempest-VolumesActionsTest-194871335-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:16:01.110910 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-30b579ff-1e8c-403c-9c53-d8f555e005e3 tempest-VolumesActionsTest-194871335 tempest-VolumesActionsTest-194871335-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:16:01.236282 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-30b579ff-1e8c-403c-9c53-d8f555e005e3 tempest-VolumesActionsTest-194871335 tempest-VolumesActionsTest-194871335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18920ad97e6946df9689bd6d4abd50b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12163a99662b48759b3fd7da51445ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:16:01.243736 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-30b579ff-1e8c-403c-9c53-d8f555e005e3 tempest-VolumesActionsTest-194871335 tempest-VolumesActionsTest-194871335-project] 10.222.0.23 "GET /compute/v2.1/servers/48ce53de-edd3-4295-84bf-6d91081962b4" status: 200 len: 1313 microversion: 2.1 time: 0.147870 Oct 13 13:16:01.244283 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 384/787] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:16:01 2022] GET /compute/v2.1/servers/48ce53de-edd3-4295-84bf-6d91081962b4 => generated 1313 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:16:01.785264 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-2fe3308a-1976-4bc6-812c-d72e3fb70294 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Calling method '>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:16:01.785765 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-2fe3308a-1976-4bc6-812c-d72e3fb70294 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] [instance: 2aa89397-329a-494c-8b4b-fa7e513d3171] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:16:01.788240 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG dbcounter [-] [118814] Writing DB stats nova_cell0:SELECT=2 {{(pid=118814) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:16:01.788731 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG dbcounter [-] [118814] Writing DB stats nova_cell0:SELECT=6 {{(pid=118814) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:16:01.795923 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-2fe3308a-1976-4bc6-812c-d72e3fb70294 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:16:01.796408 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-2fe3308a-1976-4bc6-812c-d72e3fb70294 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:16:01.796874 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-2fe3308a-1976-4bc6-812c-d72e3fb70294 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:16:01.797566 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-2fe3308a-1976-4bc6-812c-d72e3fb70294 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:16:01.798019 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-2fe3308a-1976-4bc6-812c-d72e3fb70294 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:16:01.798443 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-2fe3308a-1976-4bc6-812c-d72e3fb70294 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:16:01.812830 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.wsgi [None req-2fe3308a-1976-4bc6-812c-d72e3fb70294 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] HTTP exception thrown: Instance 2aa89397-329a-494c-8b4b-fa7e513d3171 could not be found. Oct 13 13:16:01.814351 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-2fe3308a-1976-4bc6-812c-d72e3fb70294 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Request method failure captured: Oct 13 13:16:01.814351 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: request: DELETE /compute/v2.1/servers/2aa89397-329a-494c-8b4b-fa7e513d3171 HTTP/1.1 Oct 13 13:16:01.814351 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: Accept: application/json Oct 13 13:16:01.814351 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: Accept-Encoding: identity Oct 13 13:16:01.814351 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: Connection: close Oct 13 13:16:01.814351 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: Content-Length: 0 Oct 13 13:16:01.814351 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: Content-Type: application/json Oct 13 13:16:01.814351 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: Host: 10.222.0.23 Oct 13 13:16:01.814351 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: Openstack-System-Scope: None Oct 13 13:16:01.814351 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: User-Agent: python-urllib3/1.26.12 Oct 13 13:16:01.814351 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Auth-Token: gAAAAABjSA4j2QZ79JADlbjw7OER1BQZIiLZ1uCyFy0h36PJaXCQoDK_yCwayKC5Dar6tv1xHn9Cdo-oanif51w0YCyPjllC9Rp_s6doFqdHrbagiQe_kWvWm9qSmDfIBvi6knMX5BwHXrEbR4L15OTJyRFkB4RlDw3ylQxb4D5_yL2WGeVHmtE Oct 13 13:16:01.814351 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Domain-Id: None Oct 13 13:16:01.814351 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Domain-Name: None Oct 13 13:16:01.814351 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Identity-Status: Confirmed Oct 13 13:16:01.814351 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Is-Admin-Project: True Oct 13 13:16:01.814351 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Project-Domain-Id: default Oct 13 13:16:01.814351 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Project-Domain-Name: Default Oct 13 13:16:01.814351 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Project-Id: ecd3d5d2a3a54a07ba64f1fea4846c40 Oct 13 13:16:01.814351 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Project-Name: tempest-AttachVolumeTestJSON-1763301118 Oct 13 13:16:01.814351 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Role: reader,member Oct 13 13:16:01.814351 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Roles: reader,member Oct 13 13:16:01.815958 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_ecd3d5d2a3a54a07ba64f1fea4846c40"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ecd3d5d2a3a54a07ba64f1fea4846c40"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ecd3d5d2a3a54a07ba64f1fea4846c40"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/ecd3d5d2a3a54a07ba64f1fea4846c40"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}] Oct 13 13:16:01.815958 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Tenant: tempest-AttachVolumeTestJSON-1763301118 Oct 13 13:16:01.815958 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Tenant-Id: ecd3d5d2a3a54a07ba64f1fea4846c40 Oct 13 13:16:01.815958 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1763301118 Oct 13 13:16:01.815958 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-User: tempest-AttachVolumeTestJSON-1763301118-project Oct 13 13:16:01.815958 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-User-Domain-Id: default Oct 13 13:16:01.815958 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-User-Domain-Name: Default Oct 13 13:16:01.815958 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-User-Id: 2e783caddcad473dbdd764919286e244 Oct 13 13:16:01.815958 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-User-Name: tempest-AttachVolumeTestJSON-1763301118-project Oct 13 13:16:01.815958 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: method: > Oct 13 13:16:01.815958 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: exception: Instance 2aa89397-329a-494c-8b4b-fa7e513d3171 could not be found. Oct 13 13:16:01.815958 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: action_args: {'id': '2aa89397-329a-494c-8b4b-fa7e513d3171'} Oct 13 13:16:01.816871 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 13:16:01.816871 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 13:16:01.816871 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 13 13:16:01.816871 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 13 13:16:01.816871 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 13 13:16:01.816871 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 13 13:16:01.816871 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 13 13:16:01.816871 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 13 13:16:01.816871 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 13 13:16:01.816871 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 13 13:16:01.816871 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2aa89397-329a-494c-8b4b-fa7e513d3171 could not be found. Oct 13 13:16:01.816871 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi Oct 13 13:16:01.816871 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 13:16:01.816871 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi Oct 13 13:16:01.816871 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 13:16:01.816871 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 13:16:01.816871 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 13:16:01.816871 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 13:16:01.816871 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 13:16:01.816871 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 13:16:01.818347 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 13:16:01.818347 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 13 13:16:01.818347 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 13 13:16:01.818347 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 13 13:16:01.818347 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 13 13:16:01.818347 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 13 13:16:01.818347 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 13 13:16:01.818347 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 13 13:16:01.818347 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 13 13:16:01.818347 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2aa89397-329a-494c-8b4b-fa7e513d3171 could not be found. Oct 13 13:16:01.818347 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi Oct 13 13:16:01.818347 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 13:16:01.818347 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi Oct 13 13:16:01.818347 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 13:16:01.818347 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 13:16:01.818347 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 13:16:01.818347 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 13:16:01.818347 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 13:16:01.818347 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2aa89397-329a-494c-8b4b-fa7e513d3171 could not be found. Oct 13 13:16:01.818347 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi Oct 13 13:16:01.819811 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-2fe3308a-1976-4bc6-812c-d72e3fb70294 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Returning 404 to user: Instance 2aa89397-329a-494c-8b4b-fa7e513d3171 could not be found. {{(pid=118814) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 13:16:01.819811 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-2fe3308a-1976-4bc6-812c-d72e3fb70294 tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] 10.222.0.23 "DELETE /compute/v2.1/servers/2aa89397-329a-494c-8b4b-fa7e513d3171" status: 404 len: 111 microversion: 2.1 time: 0.034366 Oct 13 13:16:01.819811 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 404/788] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Oct 13 13:16:01 2022] DELETE /compute/v2.1/servers/2aa89397-329a-494c-8b4b-fa7e513d3171 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 13 13:16:01.824367 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-44563589-1bcd-4fe6-86f3-3dc3cae51d9b tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Calling method '>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:16:01.824978 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-44563589-1bcd-4fe6-86f3-3dc3cae51d9b tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] [instance: 2aa89397-329a-494c-8b4b-fa7e513d3171] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:16:01.830954 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-44563589-1bcd-4fe6-86f3-3dc3cae51d9b tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:16:01.831472 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-44563589-1bcd-4fe6-86f3-3dc3cae51d9b tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:16:01.831916 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-44563589-1bcd-4fe6-86f3-3dc3cae51d9b tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:16:01.832606 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-44563589-1bcd-4fe6-86f3-3dc3cae51d9b tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:16:01.833064 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-44563589-1bcd-4fe6-86f3-3dc3cae51d9b tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:16:01.833493 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-44563589-1bcd-4fe6-86f3-3dc3cae51d9b tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:16:01.846452 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.wsgi [None req-44563589-1bcd-4fe6-86f3-3dc3cae51d9b tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] HTTP exception thrown: Instance 2aa89397-329a-494c-8b4b-fa7e513d3171 could not be found. Oct 13 13:16:01.848084 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-44563589-1bcd-4fe6-86f3-3dc3cae51d9b tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Request method failure captured: Oct 13 13:16:01.848084 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: request: GET /compute/v2.1/servers/2aa89397-329a-494c-8b4b-fa7e513d3171 HTTP/1.1 Oct 13 13:16:01.848084 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: Accept: application/json Oct 13 13:16:01.848084 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: Accept-Encoding: identity Oct 13 13:16:01.848084 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: Connection: close Oct 13 13:16:01.848084 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: Content-Length: 0 Oct 13 13:16:01.848084 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: Content-Type: application/json Oct 13 13:16:01.848084 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: Host: 10.222.0.23 Oct 13 13:16:01.848084 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: Openstack-System-Scope: None Oct 13 13:16:01.848084 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: User-Agent: python-urllib3/1.26.12 Oct 13 13:16:01.848084 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Auth-Token: gAAAAABjSA4j2QZ79JADlbjw7OER1BQZIiLZ1uCyFy0h36PJaXCQoDK_yCwayKC5Dar6tv1xHn9Cdo-oanif51w0YCyPjllC9Rp_s6doFqdHrbagiQe_kWvWm9qSmDfIBvi6knMX5BwHXrEbR4L15OTJyRFkB4RlDw3ylQxb4D5_yL2WGeVHmtE Oct 13 13:16:01.848084 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Domain-Id: None Oct 13 13:16:01.848084 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Domain-Name: None Oct 13 13:16:01.848084 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Identity-Status: Confirmed Oct 13 13:16:01.848084 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Is-Admin-Project: True Oct 13 13:16:01.848084 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Project-Domain-Id: default Oct 13 13:16:01.848084 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Project-Domain-Name: Default Oct 13 13:16:01.848084 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Project-Id: ecd3d5d2a3a54a07ba64f1fea4846c40 Oct 13 13:16:01.848084 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Project-Name: tempest-AttachVolumeTestJSON-1763301118 Oct 13 13:16:01.848084 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Role: reader,member Oct 13 13:16:01.848084 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Roles: reader,member Oct 13 13:16:01.849597 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_ecd3d5d2a3a54a07ba64f1fea4846c40"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ecd3d5d2a3a54a07ba64f1fea4846c40"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ecd3d5d2a3a54a07ba64f1fea4846c40"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/ecd3d5d2a3a54a07ba64f1fea4846c40"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}] Oct 13 13:16:01.849597 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Tenant: tempest-AttachVolumeTestJSON-1763301118 Oct 13 13:16:01.849597 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Tenant-Id: ecd3d5d2a3a54a07ba64f1fea4846c40 Oct 13 13:16:01.849597 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1763301118 Oct 13 13:16:01.849597 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-User: tempest-AttachVolumeTestJSON-1763301118-project Oct 13 13:16:01.849597 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-User-Domain-Id: default Oct 13 13:16:01.849597 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-User-Domain-Name: Default Oct 13 13:16:01.849597 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-User-Id: 2e783caddcad473dbdd764919286e244 Oct 13 13:16:01.849597 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-User-Name: tempest-AttachVolumeTestJSON-1763301118-project Oct 13 13:16:01.849597 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: method: > Oct 13 13:16:01.849597 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: exception: Instance 2aa89397-329a-494c-8b4b-fa7e513d3171 could not be found. Oct 13 13:16:01.849597 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: action_args: {'id': '2aa89397-329a-494c-8b4b-fa7e513d3171'} Oct 13 13:16:01.850440 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 13:16:01.850440 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 13:16:01.850440 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 13 13:16:01.850440 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 13 13:16:01.850440 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 13 13:16:01.850440 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 13 13:16:01.850440 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 13 13:16:01.850440 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 13 13:16:01.850440 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 13 13:16:01.850440 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 13 13:16:01.850440 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2aa89397-329a-494c-8b4b-fa7e513d3171 could not be found. Oct 13 13:16:01.850440 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi Oct 13 13:16:01.850440 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 13:16:01.850440 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi Oct 13 13:16:01.850440 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 13:16:01.850440 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 13:16:01.850440 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 13:16:01.850440 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 13:16:01.850440 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 13:16:01.850440 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 13:16:01.851646 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 13:16:01.851646 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 13 13:16:01.851646 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 13 13:16:01.851646 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 13 13:16:01.851646 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 13 13:16:01.851646 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 13 13:16:01.851646 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 13 13:16:01.851646 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2aa89397-329a-494c-8b4b-fa7e513d3171 could not be found. Oct 13 13:16:01.851646 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi Oct 13 13:16:01.851646 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 13:16:01.851646 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi Oct 13 13:16:01.851646 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 13:16:01.851646 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 13:16:01.851646 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 13:16:01.851646 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 13:16:01.851646 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 13:16:01.851646 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2aa89397-329a-494c-8b4b-fa7e513d3171 could not be found. Oct 13 13:16:01.851646 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi Oct 13 13:16:01.852704 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-44563589-1bcd-4fe6-86f3-3dc3cae51d9b tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Returning 404 to user: Instance 2aa89397-329a-494c-8b4b-fa7e513d3171 could not be found. {{(pid=118815) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 13:16:01.852704 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-44563589-1bcd-4fe6-86f3-3dc3cae51d9b tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] 10.222.0.23 "GET /compute/v2.1/servers/2aa89397-329a-494c-8b4b-fa7e513d3171" status: 404 len: 111 microversion: 2.1 time: 0.028950 Oct 13 13:16:01.852704 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 385/789] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:16:01 2022] GET /compute/v2.1/servers/2aa89397-329a-494c-8b4b-fa7e513d3171 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 13 13:16:02.265709 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-56ece83f-dfc9-4eac-b4ca-cda4d321a59e tempest-VolumesActionsTest-194871335 tempest-VolumesActionsTest-194871335-project] Calling method '>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:16:02.266327 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-56ece83f-dfc9-4eac-b4ca-cda4d321a59e tempest-VolumesActionsTest-194871335 tempest-VolumesActionsTest-194871335-project] [instance: 48ce53de-edd3-4295-84bf-6d91081962b4] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:16:02.272237 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-56ece83f-dfc9-4eac-b4ca-cda4d321a59e tempest-VolumesActionsTest-194871335 tempest-VolumesActionsTest-194871335-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:16:02.272724 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-56ece83f-dfc9-4eac-b4ca-cda4d321a59e tempest-VolumesActionsTest-194871335 tempest-VolumesActionsTest-194871335-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:16:02.273163 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-56ece83f-dfc9-4eac-b4ca-cda4d321a59e tempest-VolumesActionsTest-194871335 tempest-VolumesActionsTest-194871335-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:16:02.273852 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-56ece83f-dfc9-4eac-b4ca-cda4d321a59e tempest-VolumesActionsTest-194871335 tempest-VolumesActionsTest-194871335-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:16:02.274309 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-56ece83f-dfc9-4eac-b4ca-cda4d321a59e tempest-VolumesActionsTest-194871335 tempest-VolumesActionsTest-194871335-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:16:02.274750 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-56ece83f-dfc9-4eac-b4ca-cda4d321a59e tempest-VolumesActionsTest-194871335 tempest-VolumesActionsTest-194871335-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:16:02.405808 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-56ece83f-dfc9-4eac-b4ca-cda4d321a59e tempest-VolumesActionsTest-194871335 tempest-VolumesActionsTest-194871335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18920ad97e6946df9689bd6d4abd50b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12163a99662b48759b3fd7da51445ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:16:02.413502 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-56ece83f-dfc9-4eac-b4ca-cda4d321a59e tempest-VolumesActionsTest-194871335 tempest-VolumesActionsTest-194871335-project] 10.222.0.23 "GET /compute/v2.1/servers/48ce53de-edd3-4295-84bf-6d91081962b4" status: 200 len: 1496 microversion: 2.1 time: 0.151728 Oct 13 13:16:02.414072 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 405/790] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:16:02 2022] GET /compute/v2.1/servers/48ce53de-edd3-4295-84bf-6d91081962b4 => generated 1496 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:16:02.842411 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-e2006c79-bef5-45d8-ba27-9111cdc99dca tempest-VolumesActionsTest-194871335 tempest-VolumesActionsTest-194871335-project] Calling method '>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:16:02.842911 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-e2006c79-bef5-45d8-ba27-9111cdc99dca tempest-VolumesActionsTest-194871335 tempest-VolumesActionsTest-194871335-project] [instance: 48ce53de-edd3-4295-84bf-6d91081962b4] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:16:02.849350 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-e2006c79-bef5-45d8-ba27-9111cdc99dca tempest-VolumesActionsTest-194871335 tempest-VolumesActionsTest-194871335-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:16:02.849820 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-e2006c79-bef5-45d8-ba27-9111cdc99dca tempest-VolumesActionsTest-194871335 tempest-VolumesActionsTest-194871335-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:16:02.850271 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-e2006c79-bef5-45d8-ba27-9111cdc99dca tempest-VolumesActionsTest-194871335 tempest-VolumesActionsTest-194871335-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:16:02.850941 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-e2006c79-bef5-45d8-ba27-9111cdc99dca tempest-VolumesActionsTest-194871335 tempest-VolumesActionsTest-194871335-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:16:02.851542 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-e2006c79-bef5-45d8-ba27-9111cdc99dca tempest-VolumesActionsTest-194871335 tempest-VolumesActionsTest-194871335-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:16:02.851963 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-e2006c79-bef5-45d8-ba27-9111cdc99dca tempest-VolumesActionsTest-194871335 tempest-VolumesActionsTest-194871335-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:16:02.876634 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-e2006c79-bef5-45d8-ba27-9111cdc99dca tempest-VolumesActionsTest-194871335 tempest-VolumesActionsTest-194871335-project] [instance: 48ce53de-edd3-4295-84bf-6d91081962b4] Going to try to terminate instance {{(pid=118815) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 13 13:16:02.950773 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-e2006c79-bef5-45d8-ba27-9111cdc99dca tempest-VolumesActionsTest-194871335 tempest-VolumesActionsTest-194871335-project] 10.222.0.23 "DELETE /compute/v2.1/servers/48ce53de-edd3-4295-84bf-6d91081962b4" status: 204 len: 0 microversion: 2.1 time: 0.111377 Oct 13 13:16:02.951430 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 386/791] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Oct 13 13:16:02 2022] DELETE /compute/v2.1/servers/48ce53de-edd3-4295-84bf-6d91081962b4 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 13 13:16:02.959647 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-3f46cd0a-2801-484f-a74f-fcb1b7d5abf9 tempest-VolumesActionsTest-194871335 tempest-VolumesActionsTest-194871335-project] Calling method '>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:16:02.960259 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-3f46cd0a-2801-484f-a74f-fcb1b7d5abf9 tempest-VolumesActionsTest-194871335 tempest-VolumesActionsTest-194871335-project] [instance: 48ce53de-edd3-4295-84bf-6d91081962b4] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:16:02.967132 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-3f46cd0a-2801-484f-a74f-fcb1b7d5abf9 tempest-VolumesActionsTest-194871335 tempest-VolumesActionsTest-194871335-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:16:02.967829 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-3f46cd0a-2801-484f-a74f-fcb1b7d5abf9 tempest-VolumesActionsTest-194871335 tempest-VolumesActionsTest-194871335-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:16:02.968273 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-3f46cd0a-2801-484f-a74f-fcb1b7d5abf9 tempest-VolumesActionsTest-194871335 tempest-VolumesActionsTest-194871335-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:16:02.968962 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-3f46cd0a-2801-484f-a74f-fcb1b7d5abf9 tempest-VolumesActionsTest-194871335 tempest-VolumesActionsTest-194871335-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:16:02.969419 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-3f46cd0a-2801-484f-a74f-fcb1b7d5abf9 tempest-VolumesActionsTest-194871335 tempest-VolumesActionsTest-194871335-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:16:02.969842 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-3f46cd0a-2801-484f-a74f-fcb1b7d5abf9 tempest-VolumesActionsTest-194871335 tempest-VolumesActionsTest-194871335-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:16:02.993718 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-6dee8f59-d2b3-4e35-862b-24fff743aeca tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Calling method '>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:16:02.994332 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-6dee8f59-d2b3-4e35-862b-24fff743aeca tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] [instance: e125ab44-9111-4260-909d-95d57b7861a7] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:16:03.000746 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-6dee8f59-d2b3-4e35-862b-24fff743aeca tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:16:03.001227 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-6dee8f59-d2b3-4e35-862b-24fff743aeca tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:16:03.001667 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-6dee8f59-d2b3-4e35-862b-24fff743aeca tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:16:03.002372 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-6dee8f59-d2b3-4e35-862b-24fff743aeca tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:16:03.002810 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-6dee8f59-d2b3-4e35-862b-24fff743aeca tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:16:03.003286 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-6dee8f59-d2b3-4e35-862b-24fff743aeca tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:16:03.017375 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.wsgi [None req-6dee8f59-d2b3-4e35-862b-24fff743aeca tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] HTTP exception thrown: Instance e125ab44-9111-4260-909d-95d57b7861a7 could not be found. Oct 13 13:16:03.019032 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-6dee8f59-d2b3-4e35-862b-24fff743aeca tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Request method failure captured: Oct 13 13:16:03.019032 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: request: DELETE /compute/v2.1/servers/e125ab44-9111-4260-909d-95d57b7861a7 HTTP/1.1 Oct 13 13:16:03.019032 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: Accept: application/json Oct 13 13:16:03.019032 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: Accept-Encoding: identity Oct 13 13:16:03.019032 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: Connection: close Oct 13 13:16:03.019032 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: Content-Length: 0 Oct 13 13:16:03.019032 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: Content-Type: application/json Oct 13 13:16:03.019032 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: Host: 10.222.0.23 Oct 13 13:16:03.019032 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: Openstack-System-Scope: None Oct 13 13:16:03.019032 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: User-Agent: python-urllib3/1.26.12 Oct 13 13:16:03.019032 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Auth-Token: gAAAAABjSA4j2QZ79JADlbjw7OER1BQZIiLZ1uCyFy0h36PJaXCQoDK_yCwayKC5Dar6tv1xHn9Cdo-oanif51w0YCyPjllC9Rp_s6doFqdHrbagiQe_kWvWm9qSmDfIBvi6knMX5BwHXrEbR4L15OTJyRFkB4RlDw3ylQxb4D5_yL2WGeVHmtE Oct 13 13:16:03.019032 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Domain-Id: None Oct 13 13:16:03.019032 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Domain-Name: None Oct 13 13:16:03.019032 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Identity-Status: Confirmed Oct 13 13:16:03.019032 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Is-Admin-Project: True Oct 13 13:16:03.019032 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Project-Domain-Id: default Oct 13 13:16:03.019032 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Project-Domain-Name: Default Oct 13 13:16:03.019032 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Project-Id: ecd3d5d2a3a54a07ba64f1fea4846c40 Oct 13 13:16:03.019032 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Project-Name: tempest-AttachVolumeTestJSON-1763301118 Oct 13 13:16:03.019032 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Role: reader,member Oct 13 13:16:03.019032 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Roles: reader,member Oct 13 13:16:03.020597 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_ecd3d5d2a3a54a07ba64f1fea4846c40"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ecd3d5d2a3a54a07ba64f1fea4846c40"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ecd3d5d2a3a54a07ba64f1fea4846c40"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/ecd3d5d2a3a54a07ba64f1fea4846c40"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}] Oct 13 13:16:03.020597 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Tenant: tempest-AttachVolumeTestJSON-1763301118 Oct 13 13:16:03.020597 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Tenant-Id: ecd3d5d2a3a54a07ba64f1fea4846c40 Oct 13 13:16:03.020597 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1763301118 Oct 13 13:16:03.020597 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-User: tempest-AttachVolumeTestJSON-1763301118-project Oct 13 13:16:03.020597 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-User-Domain-Id: default Oct 13 13:16:03.020597 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-User-Domain-Name: Default Oct 13 13:16:03.020597 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-User-Id: 2e783caddcad473dbdd764919286e244 Oct 13 13:16:03.020597 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-User-Name: tempest-AttachVolumeTestJSON-1763301118-project Oct 13 13:16:03.020597 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: method: > Oct 13 13:16:03.020597 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: exception: Instance e125ab44-9111-4260-909d-95d57b7861a7 could not be found. Oct 13 13:16:03.020597 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: action_args: {'id': 'e125ab44-9111-4260-909d-95d57b7861a7'} Oct 13 13:16:03.021326 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 13:16:03.021326 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 13:16:03.021326 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 13 13:16:03.021326 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 13 13:16:03.021326 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 13 13:16:03.021326 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 13 13:16:03.021326 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 13 13:16:03.021326 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 13 13:16:03.021326 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 13 13:16:03.021326 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 13 13:16:03.021326 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e125ab44-9111-4260-909d-95d57b7861a7 could not be found. Oct 13 13:16:03.021326 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi Oct 13 13:16:03.021326 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 13:16:03.021326 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi Oct 13 13:16:03.021326 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 13:16:03.021326 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 13:16:03.021326 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 13:16:03.021326 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 13:16:03.021326 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 13:16:03.021326 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 13:16:03.022566 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 13:16:03.022566 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 13 13:16:03.022566 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 13 13:16:03.022566 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 13 13:16:03.022566 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 13 13:16:03.022566 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 13 13:16:03.022566 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 13 13:16:03.022566 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 13 13:16:03.022566 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 13 13:16:03.022566 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e125ab44-9111-4260-909d-95d57b7861a7 could not be found. Oct 13 13:16:03.022566 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi Oct 13 13:16:03.022566 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 13:16:03.022566 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi Oct 13 13:16:03.022566 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 13:16:03.022566 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 13:16:03.022566 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 13:16:03.022566 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 13:16:03.022566 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 13:16:03.022566 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e125ab44-9111-4260-909d-95d57b7861a7 could not be found. Oct 13 13:16:03.022566 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi Oct 13 13:16:03.023834 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-6dee8f59-d2b3-4e35-862b-24fff743aeca tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Returning 404 to user: Instance e125ab44-9111-4260-909d-95d57b7861a7 could not be found. {{(pid=118815) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 13:16:03.023834 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-6dee8f59-d2b3-4e35-862b-24fff743aeca tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] 10.222.0.23 "DELETE /compute/v2.1/servers/e125ab44-9111-4260-909d-95d57b7861a7" status: 404 len: 111 microversion: 2.1 time: 0.031183 Oct 13 13:16:03.023834 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 387/792] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Oct 13 13:16:02 2022] DELETE /compute/v2.1/servers/e125ab44-9111-4260-909d-95d57b7861a7 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 13 13:16:03.028796 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-5a480bd4-88c2-4765-a133-33de7c46354e tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Calling method '>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:16:03.029470 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-5a480bd4-88c2-4765-a133-33de7c46354e tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] [instance: e125ab44-9111-4260-909d-95d57b7861a7] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:16:03.035585 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-5a480bd4-88c2-4765-a133-33de7c46354e tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:16:03.036084 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-5a480bd4-88c2-4765-a133-33de7c46354e tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:16:03.036531 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-5a480bd4-88c2-4765-a133-33de7c46354e tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:16:03.037233 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-5a480bd4-88c2-4765-a133-33de7c46354e tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:16:03.037698 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-5a480bd4-88c2-4765-a133-33de7c46354e tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:16:03.038165 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-5a480bd4-88c2-4765-a133-33de7c46354e tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:16:03.052956 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.wsgi [None req-5a480bd4-88c2-4765-a133-33de7c46354e tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] HTTP exception thrown: Instance e125ab44-9111-4260-909d-95d57b7861a7 could not be found. Oct 13 13:16:03.054487 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-5a480bd4-88c2-4765-a133-33de7c46354e tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Request method failure captured: Oct 13 13:16:03.054487 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: request: GET /compute/v2.1/servers/e125ab44-9111-4260-909d-95d57b7861a7 HTTP/1.1 Oct 13 13:16:03.054487 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: Accept: application/json Oct 13 13:16:03.054487 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: Accept-Encoding: identity Oct 13 13:16:03.054487 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: Connection: close Oct 13 13:16:03.054487 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: Content-Length: 0 Oct 13 13:16:03.054487 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: Content-Type: application/json Oct 13 13:16:03.054487 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: Host: 10.222.0.23 Oct 13 13:16:03.054487 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: Openstack-System-Scope: None Oct 13 13:16:03.054487 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: User-Agent: python-urllib3/1.26.12 Oct 13 13:16:03.054487 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Auth-Token: gAAAAABjSA4j2QZ79JADlbjw7OER1BQZIiLZ1uCyFy0h36PJaXCQoDK_yCwayKC5Dar6tv1xHn9Cdo-oanif51w0YCyPjllC9Rp_s6doFqdHrbagiQe_kWvWm9qSmDfIBvi6knMX5BwHXrEbR4L15OTJyRFkB4RlDw3ylQxb4D5_yL2WGeVHmtE Oct 13 13:16:03.054487 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Domain-Id: None Oct 13 13:16:03.054487 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Domain-Name: None Oct 13 13:16:03.054487 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Identity-Status: Confirmed Oct 13 13:16:03.054487 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Is-Admin-Project: True Oct 13 13:16:03.054487 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Project-Domain-Id: default Oct 13 13:16:03.054487 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Project-Domain-Name: Default Oct 13 13:16:03.054487 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Project-Id: ecd3d5d2a3a54a07ba64f1fea4846c40 Oct 13 13:16:03.054487 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Project-Name: tempest-AttachVolumeTestJSON-1763301118 Oct 13 13:16:03.054487 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Role: reader,member Oct 13 13:16:03.054487 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Roles: reader,member Oct 13 13:16:03.056152 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_ecd3d5d2a3a54a07ba64f1fea4846c40"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ecd3d5d2a3a54a07ba64f1fea4846c40"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ecd3d5d2a3a54a07ba64f1fea4846c40"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/ecd3d5d2a3a54a07ba64f1fea4846c40"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}] Oct 13 13:16:03.056152 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Tenant: tempest-AttachVolumeTestJSON-1763301118 Oct 13 13:16:03.056152 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Tenant-Id: ecd3d5d2a3a54a07ba64f1fea4846c40 Oct 13 13:16:03.056152 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1763301118 Oct 13 13:16:03.056152 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-User: tempest-AttachVolumeTestJSON-1763301118-project Oct 13 13:16:03.056152 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-User-Domain-Id: default Oct 13 13:16:03.056152 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-User-Domain-Name: Default Oct 13 13:16:03.056152 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-User-Id: 2e783caddcad473dbdd764919286e244 Oct 13 13:16:03.056152 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-User-Name: tempest-AttachVolumeTestJSON-1763301118-project Oct 13 13:16:03.056152 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: method: > Oct 13 13:16:03.056152 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: exception: Instance e125ab44-9111-4260-909d-95d57b7861a7 could not be found. Oct 13 13:16:03.056152 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: action_args: {'id': 'e125ab44-9111-4260-909d-95d57b7861a7'} Oct 13 13:16:03.057271 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 13:16:03.057271 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 13:16:03.057271 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 13 13:16:03.057271 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 13 13:16:03.057271 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 13 13:16:03.057271 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 13 13:16:03.057271 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 13 13:16:03.057271 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 13 13:16:03.057271 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 13 13:16:03.057271 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 13 13:16:03.057271 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e125ab44-9111-4260-909d-95d57b7861a7 could not be found. Oct 13 13:16:03.057271 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi Oct 13 13:16:03.057271 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 13:16:03.057271 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi Oct 13 13:16:03.057271 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 13:16:03.057271 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 13:16:03.057271 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 13:16:03.057271 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 13:16:03.057271 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 13:16:03.057271 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 13:16:03.058697 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 13:16:03.058697 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 13 13:16:03.058697 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 13 13:16:03.058697 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 13 13:16:03.058697 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 13 13:16:03.058697 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 13 13:16:03.058697 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 13 13:16:03.058697 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e125ab44-9111-4260-909d-95d57b7861a7 could not be found. Oct 13 13:16:03.058697 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi Oct 13 13:16:03.058697 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 13:16:03.058697 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi Oct 13 13:16:03.058697 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 13:16:03.058697 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 13:16:03.058697 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 13:16:03.058697 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 13:16:03.058697 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 13:16:03.058697 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e125ab44-9111-4260-909d-95d57b7861a7 could not be found. Oct 13 13:16:03.058697 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi Oct 13 13:16:03.060646 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-5a480bd4-88c2-4765-a133-33de7c46354e tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] Returning 404 to user: Instance e125ab44-9111-4260-909d-95d57b7861a7 could not be found. {{(pid=118815) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 13:16:03.060646 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-5a480bd4-88c2-4765-a133-33de7c46354e tempest-AttachVolumeTestJSON-1763301118 tempest-AttachVolumeTestJSON-1763301118-project] 10.222.0.23 "GET /compute/v2.1/servers/e125ab44-9111-4260-909d-95d57b7861a7" status: 404 len: 111 microversion: 2.1 time: 0.030811 Oct 13 13:16:03.060646 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 388/793] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:16:03 2022] GET /compute/v2.1/servers/e125ab44-9111-4260-909d-95d57b7861a7 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 13 13:16:03.110170 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-3f46cd0a-2801-484f-a74f-fcb1b7d5abf9 tempest-VolumesActionsTest-194871335 tempest-VolumesActionsTest-194871335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18920ad97e6946df9689bd6d4abd50b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12163a99662b48759b3fd7da51445ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:16:03.118028 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-3f46cd0a-2801-484f-a74f-fcb1b7d5abf9 tempest-VolumesActionsTest-194871335 tempest-VolumesActionsTest-194871335-project] 10.222.0.23 "GET /compute/v2.1/servers/48ce53de-edd3-4295-84bf-6d91081962b4" status: 200 len: 1502 microversion: 2.1 time: 0.162236 Oct 13 13:16:03.118588 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 406/794] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:16:02 2022] GET /compute/v2.1/servers/48ce53de-edd3-4295-84bf-6d91081962b4 => generated 1502 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:16:04.141191 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-9f037127-94d8-4a93-89d8-cc34c7319ad3 tempest-VolumesActionsTest-194871335 tempest-VolumesActionsTest-194871335-project] Calling method '>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:16:04.142433 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-9f037127-94d8-4a93-89d8-cc34c7319ad3 tempest-VolumesActionsTest-194871335 tempest-VolumesActionsTest-194871335-project] [instance: 48ce53de-edd3-4295-84bf-6d91081962b4] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:16:04.149187 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-9f037127-94d8-4a93-89d8-cc34c7319ad3 tempest-VolumesActionsTest-194871335 tempest-VolumesActionsTest-194871335-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:16:04.149679 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-9f037127-94d8-4a93-89d8-cc34c7319ad3 tempest-VolumesActionsTest-194871335 tempest-VolumesActionsTest-194871335-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:16:04.150121 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-9f037127-94d8-4a93-89d8-cc34c7319ad3 tempest-VolumesActionsTest-194871335 tempest-VolumesActionsTest-194871335-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:16:04.150830 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-9f037127-94d8-4a93-89d8-cc34c7319ad3 tempest-VolumesActionsTest-194871335 tempest-VolumesActionsTest-194871335-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:16:04.151314 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-9f037127-94d8-4a93-89d8-cc34c7319ad3 tempest-VolumesActionsTest-194871335 tempest-VolumesActionsTest-194871335-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:16:04.151739 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-9f037127-94d8-4a93-89d8-cc34c7319ad3 tempest-VolumesActionsTest-194871335 tempest-VolumesActionsTest-194871335-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:16:04.292292 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-9f037127-94d8-4a93-89d8-cc34c7319ad3 tempest-VolumesActionsTest-194871335 tempest-VolumesActionsTest-194871335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18920ad97e6946df9689bd6d4abd50b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12163a99662b48759b3fd7da51445ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:16:04.301290 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-9f037127-94d8-4a93-89d8-cc34c7319ad3 tempest-VolumesActionsTest-194871335 tempest-VolumesActionsTest-194871335-project] 10.222.0.23 "GET /compute/v2.1/servers/48ce53de-edd3-4295-84bf-6d91081962b4" status: 200 len: 1502 microversion: 2.1 time: 0.163637 Oct 13 13:16:04.301835 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 389/795] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:16:04 2022] GET /compute/v2.1/servers/48ce53de-edd3-4295-84bf-6d91081962b4 => generated 1502 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:16:05.325645 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-e109e558-25fc-4a17-83df-74be016186da tempest-VolumesActionsTest-194871335 tempest-VolumesActionsTest-194871335-project] Calling method '>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:16:05.326262 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-e109e558-25fc-4a17-83df-74be016186da tempest-VolumesActionsTest-194871335 tempest-VolumesActionsTest-194871335-project] [instance: 48ce53de-edd3-4295-84bf-6d91081962b4] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:16:05.333256 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-e109e558-25fc-4a17-83df-74be016186da tempest-VolumesActionsTest-194871335 tempest-VolumesActionsTest-194871335-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:16:05.334613 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-e109e558-25fc-4a17-83df-74be016186da tempest-VolumesActionsTest-194871335 tempest-VolumesActionsTest-194871335-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:16:05.335667 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-e109e558-25fc-4a17-83df-74be016186da tempest-VolumesActionsTest-194871335 tempest-VolumesActionsTest-194871335-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:16:05.336569 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-e109e558-25fc-4a17-83df-74be016186da tempest-VolumesActionsTest-194871335 tempest-VolumesActionsTest-194871335-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:16:05.337907 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-e109e558-25fc-4a17-83df-74be016186da tempest-VolumesActionsTest-194871335 tempest-VolumesActionsTest-194871335-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:16:05.338727 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-e109e558-25fc-4a17-83df-74be016186da tempest-VolumesActionsTest-194871335 tempest-VolumesActionsTest-194871335-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:16:05.659800 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [req-8b216557-b8f3-4cfd-a55b-6a92bcc9edd4 req-d042e215-3077-41c6-aa61-1a74ac51649e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "48ce53de-edd3-4295-84bf-6d91081962b4", "name": "network-vif-deleted", "tag": "386cac14-ed13-4c42-852a-c038b6163a36"}]} {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 13:16:05.682954 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [req-8b216557-b8f3-4cfd-a55b-6a92bcc9edd4 req-d042e215-3077-41c6-aa61-1a74ac51649e service nova] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:16:05.685449 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [req-8b216557-b8f3-4cfd-a55b-6a92bcc9edd4 req-d042e215-3077-41c6-aa61-1a74ac51649e service nova] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:16:05.686403 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [req-8b216557-b8f3-4cfd-a55b-6a92bcc9edd4 req-d042e215-3077-41c6-aa61-1a74ac51649e service nova] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:16:05.702028 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.compute.server_external_events [req-8b216557-b8f3-4cfd-a55b-6a92bcc9edd4 req-d042e215-3077-41c6-aa61-1a74ac51649e service nova] Creating event network-vif-deleted:386cac14-ed13-4c42-852a-c038b6163a36 for instance 48ce53de-edd3-4295-84bf-6d91081962b4 on hv-cinder-82660 Oct 13 13:16:05.707352 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [req-8b216557-b8f3-4cfd-a55b-6a92bcc9edd4 req-d042e215-3077-41c6-aa61-1a74ac51649e service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063361 Oct 13 13:16:05.707978 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 390/796] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 13:16:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 13:16:05.846096 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-e109e558-25fc-4a17-83df-74be016186da tempest-VolumesActionsTest-194871335 tempest-VolumesActionsTest-194871335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18920ad97e6946df9689bd6d4abd50b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12163a99662b48759b3fd7da51445ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:16:05.856840 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-e109e558-25fc-4a17-83df-74be016186da tempest-VolumesActionsTest-194871335 tempest-VolumesActionsTest-194871335-project] 10.222.0.23 "GET /compute/v2.1/servers/48ce53de-edd3-4295-84bf-6d91081962b4" status: 200 len: 1502 microversion: 2.1 time: 0.536493 Oct 13 13:16:05.865020 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 407/797] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:16:05 2022] GET /compute/v2.1/servers/48ce53de-edd3-4295-84bf-6d91081962b4 => generated 1502 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:16:06.881646 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-b9f6d9be-3021-4515-9db8-94db5bee1262 tempest-VolumesActionsTest-194871335 tempest-VolumesActionsTest-194871335-project] Calling method '>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:16:06.882392 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-b9f6d9be-3021-4515-9db8-94db5bee1262 tempest-VolumesActionsTest-194871335 tempest-VolumesActionsTest-194871335-project] [instance: 48ce53de-edd3-4295-84bf-6d91081962b4] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:16:06.889814 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-b9f6d9be-3021-4515-9db8-94db5bee1262 tempest-VolumesActionsTest-194871335 tempest-VolumesActionsTest-194871335-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:16:06.890297 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-b9f6d9be-3021-4515-9db8-94db5bee1262 tempest-VolumesActionsTest-194871335 tempest-VolumesActionsTest-194871335-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:16:06.890729 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-b9f6d9be-3021-4515-9db8-94db5bee1262 tempest-VolumesActionsTest-194871335 tempest-VolumesActionsTest-194871335-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:16:06.891671 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-b9f6d9be-3021-4515-9db8-94db5bee1262 tempest-VolumesActionsTest-194871335 tempest-VolumesActionsTest-194871335-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:16:06.892233 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-b9f6d9be-3021-4515-9db8-94db5bee1262 tempest-VolumesActionsTest-194871335 tempest-VolumesActionsTest-194871335-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:16:06.892548 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-b9f6d9be-3021-4515-9db8-94db5bee1262 tempest-VolumesActionsTest-194871335 tempest-VolumesActionsTest-194871335-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:16:06.918078 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.wsgi [None req-b9f6d9be-3021-4515-9db8-94db5bee1262 tempest-VolumesActionsTest-194871335 tempest-VolumesActionsTest-194871335-project] HTTP exception thrown: Instance 48ce53de-edd3-4295-84bf-6d91081962b4 could not be found. Oct 13 13:16:06.919823 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-b9f6d9be-3021-4515-9db8-94db5bee1262 tempest-VolumesActionsTest-194871335 tempest-VolumesActionsTest-194871335-project] Request method failure captured: Oct 13 13:16:06.919823 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: request: GET /compute/v2.1/servers/48ce53de-edd3-4295-84bf-6d91081962b4 HTTP/1.1 Oct 13 13:16:06.919823 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: Accept: application/json Oct 13 13:16:06.919823 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: Accept-Encoding: identity Oct 13 13:16:06.919823 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: Connection: close Oct 13 13:16:06.919823 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: Content-Length: 0 Oct 13 13:16:06.919823 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: Content-Type: application/json Oct 13 13:16:06.919823 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: Host: 10.222.0.23 Oct 13 13:16:06.919823 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: Openstack-System-Scope: None Oct 13 13:16:06.919823 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: User-Agent: python-urllib3/1.26.12 Oct 13 13:16:06.919823 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Auth-Token: gAAAAABjSA9ri5UBq_IkfP1Qh0u9Fma-nODktWlm_biGnXsTvN92DU_dwtHt07xoHR6wh1L6MvUStpAD4C4TXU3xs54wQnNrrvuOhj1CorB0a8bsAVriZCiJoKEnvxgzek4RuVJcx9Ot5ychRyNQTJoL2ixHYVO3hjzRGFlkmC9p5B_yeMJ9m0I Oct 13 13:16:06.919823 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Domain-Id: None Oct 13 13:16:06.919823 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Domain-Name: None Oct 13 13:16:06.919823 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Identity-Status: Confirmed Oct 13 13:16:06.919823 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Is-Admin-Project: True Oct 13 13:16:06.919823 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Project-Domain-Id: default Oct 13 13:16:06.919823 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Project-Domain-Name: Default Oct 13 13:16:06.919823 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Project-Id: 12163a99662b48759b3fd7da51445ecf Oct 13 13:16:06.919823 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Project-Name: tempest-VolumesActionsTest-194871335 Oct 13 13:16:06.919823 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Role: reader,member Oct 13 13:16:06.919823 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Roles: reader,member Oct 13 13:16:06.921151 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_12163a99662b48759b3fd7da51445ecf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/12163a99662b48759b3fd7da51445ecf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/12163a99662b48759b3fd7da51445ecf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/12163a99662b48759b3fd7da51445ecf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}] Oct 13 13:16:06.921151 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Tenant: tempest-VolumesActionsTest-194871335 Oct 13 13:16:06.921151 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Tenant-Id: 12163a99662b48759b3fd7da51445ecf Oct 13 13:16:06.921151 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Tenant-Name: tempest-VolumesActionsTest-194871335 Oct 13 13:16:06.921151 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-User: tempest-VolumesActionsTest-194871335-project Oct 13 13:16:06.921151 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-User-Domain-Id: default Oct 13 13:16:06.921151 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-User-Domain-Name: Default Oct 13 13:16:06.921151 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-User-Id: 18920ad97e6946df9689bd6d4abd50b0 Oct 13 13:16:06.921151 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-User-Name: tempest-VolumesActionsTest-194871335-project Oct 13 13:16:06.921151 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: method: > Oct 13 13:16:06.921151 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: exception: Instance 48ce53de-edd3-4295-84bf-6d91081962b4 could not be found. Oct 13 13:16:06.921151 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: action_args: {'id': '48ce53de-edd3-4295-84bf-6d91081962b4'} Oct 13 13:16:06.921881 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 13:16:06.921881 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 13:16:06.921881 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 13 13:16:06.921881 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 13 13:16:06.921881 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 13 13:16:06.921881 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 13 13:16:06.921881 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 13 13:16:06.921881 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 13 13:16:06.921881 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 13 13:16:06.921881 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 13 13:16:06.921881 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 48ce53de-edd3-4295-84bf-6d91081962b4 could not be found. Oct 13 13:16:06.921881 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi Oct 13 13:16:06.921881 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 13:16:06.921881 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi Oct 13 13:16:06.921881 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 13:16:06.921881 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 13:16:06.921881 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 13:16:06.921881 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 13:16:06.921881 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 13:16:06.921881 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 13:16:06.923115 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 13:16:06.923115 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 13 13:16:06.923115 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 13 13:16:06.923115 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 13 13:16:06.923115 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 13 13:16:06.923115 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 13 13:16:06.923115 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 13 13:16:06.923115 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 48ce53de-edd3-4295-84bf-6d91081962b4 could not be found. Oct 13 13:16:06.923115 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi Oct 13 13:16:06.923115 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 13:16:06.923115 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi Oct 13 13:16:06.923115 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 13:16:06.923115 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 13:16:06.923115 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 13:16:06.923115 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 13:16:06.923115 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 13:16:06.923115 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 48ce53de-edd3-4295-84bf-6d91081962b4 could not be found. Oct 13 13:16:06.923115 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi Oct 13 13:16:06.924519 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-b9f6d9be-3021-4515-9db8-94db5bee1262 tempest-VolumesActionsTest-194871335 tempest-VolumesActionsTest-194871335-project] Returning 404 to user: Instance 48ce53de-edd3-4295-84bf-6d91081962b4 could not be found. {{(pid=118815) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 13:16:06.924519 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-b9f6d9be-3021-4515-9db8-94db5bee1262 tempest-VolumesActionsTest-194871335 tempest-VolumesActionsTest-194871335-project] 10.222.0.23 "GET /compute/v2.1/servers/48ce53de-edd3-4295-84bf-6d91081962b4" status: 404 len: 111 microversion: 2.1 time: 0.044119 Oct 13 13:16:06.935221 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 391/798] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:16:06 2022] GET /compute/v2.1/servers/48ce53de-edd3-4295-84bf-6d91081962b4 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 13 13:16:08.398202 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-1ffa9c7f-8470-42b7-adf7-0df47d08f189 tempest-VolumesSnapshotsTestJSON-870113179 tempest-VolumesSnapshotsTestJSON-870113179-project] Action: 'create', calling method: .version_select at 0x7f5093d175e0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1835492305"}} {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 13:16:08.673739 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-1ffa9c7f-8470-42b7-adf7-0df47d08f189 tempest-VolumesSnapshotsTestJSON-870113179 tempest-VolumesSnapshotsTestJSON-870113179-project] 10.222.0.23 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 0.387784 Oct 13 13:16:08.674704 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 408/799] 10.222.0.23 () {60 vars in 1155 bytes} [Thu Oct 13 13:16:08 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 389 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Oct 13 13:16:08.688374 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-81e774be-6ec4-4971-91d1-87c04c52a39d tempest-VolumesSnapshotsTestJSON-870113179 tempest-VolumesSnapshotsTestJSON-870113179-project] Calling method '.version_select at 0x7f5093c64670>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:16:08.737882 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-81e774be-6ec4-4971-91d1-87c04c52a39d tempest-VolumesSnapshotsTestJSON-870113179 tempest-VolumesSnapshotsTestJSON-870113179-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/f7e45ea4-eef0-4484-af0e-dacd5c67331a" status: 200 len: 345 microversion: 2.1 time: 0.053800 Oct 13 13:16:08.738474 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 392/800] 10.222.0.23 () {58 vars in 1245 bytes} [Thu Oct 13 13:16:08 2022] GET /compute/v2.1/os-volumes/f7e45ea4-eef0-4484-af0e-dacd5c67331a => generated 345 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 13:16:09.752756 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-016673f8-f1a1-4b4c-8115-02f993b45c01 tempest-VolumesSnapshotsTestJSON-870113179 tempest-VolumesSnapshotsTestJSON-870113179-project] Calling method '.version_select at 0x7f5093c798b0>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:16:09.798384 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-016673f8-f1a1-4b4c-8115-02f993b45c01 tempest-VolumesSnapshotsTestJSON-870113179 tempest-VolumesSnapshotsTestJSON-870113179-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/f7e45ea4-eef0-4484-af0e-dacd5c67331a" status: 200 len: 345 microversion: 2.1 time: 0.049867 Oct 13 13:16:09.799204 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 409/801] 10.222.0.23 () {58 vars in 1245 bytes} [Thu Oct 13 13:16:09 2022] GET /compute/v2.1/os-volumes/f7e45ea4-eef0-4484-af0e-dacd5c67331a => generated 345 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 13:16:10.813257 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-f71a0808-6989-48b7-8b4d-ece348d01dbd tempest-VolumesSnapshotsTestJSON-870113179 tempest-VolumesSnapshotsTestJSON-870113179-project] Calling method '.version_select at 0x7f5093b540d0>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:16:10.859267 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-f71a0808-6989-48b7-8b4d-ece348d01dbd tempest-VolumesSnapshotsTestJSON-870113179 tempest-VolumesSnapshotsTestJSON-870113179-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/f7e45ea4-eef0-4484-af0e-dacd5c67331a" status: 200 len: 345 microversion: 2.1 time: 0.050199 Oct 13 13:16:10.859820 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 393/802] 10.222.0.23 () {58 vars in 1245 bytes} [Thu Oct 13 13:16:10 2022] GET /compute/v2.1/os-volumes/f7e45ea4-eef0-4484-af0e-dacd5c67331a => generated 345 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 13:16:11.873866 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-708f634d-922a-45ca-9d10-00c7f8aace1f tempest-VolumesSnapshotsTestJSON-870113179 tempest-VolumesSnapshotsTestJSON-870113179-project] Calling method '.version_select at 0x7f5093c09ca0>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:16:11.933540 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-708f634d-922a-45ca-9d10-00c7f8aace1f tempest-VolumesSnapshotsTestJSON-870113179 tempest-VolumesSnapshotsTestJSON-870113179-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/f7e45ea4-eef0-4484-af0e-dacd5c67331a" status: 200 len: 346 microversion: 2.1 time: 0.063781 Oct 13 13:16:11.934140 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 410/803] 10.222.0.23 () {58 vars in 1245 bytes} [Thu Oct 13 13:16:11 2022] GET /compute/v2.1/os-volumes/f7e45ea4-eef0-4484-af0e-dacd5c67331a => generated 346 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 13:16:11.947661 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-971abcf5-d094-46be-b452-753cbc4fed18 tempest-VolumesSnapshotsTestJSON-870113179 tempest-VolumesSnapshotsTestJSON-870113179-project] Action: 'create', calling method: .version_select at 0x7f5093b88700>, body: {"snapshot": {"volume_id": "f7e45ea4-eef0-4484-af0e-dacd5c67331a", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-2134191676"}} {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 13:16:12.117652 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-971abcf5-d094-46be-b452-753cbc4fed18 tempest-VolumesSnapshotsTestJSON-870113179 tempest-VolumesSnapshotsTestJSON-870113179-project] 10.222.0.23 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.174185 Oct 13 13:16:12.118347 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 394/804] 10.222.0.23 () {60 vars in 1162 bytes} [Thu Oct 13 13:16:11 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 13:16:12.130010 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-bcc95fea-d036-49b8-96bb-3081f5749bfe tempest-VolumesSnapshotsTestJSON-870113179 tempest-VolumesSnapshotsTestJSON-870113179-project] Calling method '.version_select at 0x7f5098ca8700>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:16:12.171580 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-bcc95fea-d036-49b8-96bb-3081f5749bfe tempest-VolumesSnapshotsTestJSON-870113179 tempest-VolumesSnapshotsTestJSON-870113179-project] 10.222.0.23 "GET /compute/v2.1/os-snapshots/d5136156-9931-445d-97d4-66a517ada981" status: 200 len: 287 microversion: 2.1 time: 0.045557 Oct 13 13:16:12.172539 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 411/805] 10.222.0.23 () {58 vars in 1251 bytes} [Thu Oct 13 13:16:12 2022] GET /compute/v2.1/os-snapshots/d5136156-9931-445d-97d4-66a517ada981 => generated 287 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 13 13:16:12.184246 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-75ac079f-ff86-4518-a2fc-cbbb26e0e46e tempest-VolumesSnapshotsTestJSON-870113179 tempest-VolumesSnapshotsTestJSON-870113179-project] Calling method '.version_select at 0x7f5093c0e820>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:16:12.222856 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-75ac079f-ff86-4518-a2fc-cbbb26e0e46e tempest-VolumesSnapshotsTestJSON-870113179 tempest-VolumesSnapshotsTestJSON-870113179-project] 10.222.0.23 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.042681 Oct 13 13:16:12.223525 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 395/806] 10.222.0.23 () {58 vars in 1140 bytes} [Thu Oct 13 13:16:12 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 13:16:12.234565 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-0b52d6e7-3de7-47b5-8b92-8673a49efb7a tempest-VolumesSnapshotsTestJSON-870113179 tempest-VolumesSnapshotsTestJSON-870113179-project] Calling method '.version_select at 0x7f5093c01ee0>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:16:12.267600 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-0b52d6e7-3de7-47b5-8b92-8673a49efb7a tempest-VolumesSnapshotsTestJSON-870113179 tempest-VolumesSnapshotsTestJSON-870113179-project] 10.222.0.23 "GET /compute/v2.1/os-snapshots/d5136156-9931-445d-97d4-66a517ada981" status: 200 len: 287 microversion: 2.1 time: 0.036654 Oct 13 13:16:12.268367 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 412/807] 10.222.0.23 () {58 vars in 1251 bytes} [Thu Oct 13 13:16:12 2022] GET /compute/v2.1/os-snapshots/d5136156-9931-445d-97d4-66a517ada981 => generated 287 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 13:16:13.281472 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-adcc51bd-79a8-4cfe-8492-1ac539657e7f tempest-VolumesSnapshotsTestJSON-870113179 tempest-VolumesSnapshotsTestJSON-870113179-project] Calling method '.version_select at 0x7f5093b881f0>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:16:13.316066 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-adcc51bd-79a8-4cfe-8492-1ac539657e7f tempest-VolumesSnapshotsTestJSON-870113179 tempest-VolumesSnapshotsTestJSON-870113179-project] 10.222.0.23 "GET /compute/v2.1/os-snapshots/d5136156-9931-445d-97d4-66a517ada981" status: 200 len: 287 microversion: 2.1 time: 0.038879 Oct 13 13:16:13.317249 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 396/808] 10.222.0.23 () {58 vars in 1251 bytes} [Thu Oct 13 13:16:13 2022] GET /compute/v2.1/os-snapshots/d5136156-9931-445d-97d4-66a517ada981 => generated 287 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 13:16:14.329913 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-09c5a31d-8503-4acd-ad33-118cdaba0393 tempest-VolumesSnapshotsTestJSON-870113179 tempest-VolumesSnapshotsTestJSON-870113179-project] Calling method '.version_select at 0x7f5093c7f5e0>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:16:14.360826 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-09c5a31d-8503-4acd-ad33-118cdaba0393 tempest-VolumesSnapshotsTestJSON-870113179 tempest-VolumesSnapshotsTestJSON-870113179-project] 10.222.0.23 "GET /compute/v2.1/os-snapshots/d5136156-9931-445d-97d4-66a517ada981" status: 200 len: 287 microversion: 2.1 time: 0.035201 Oct 13 13:16:14.361390 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 413/809] 10.222.0.23 () {58 vars in 1251 bytes} [Thu Oct 13 13:16:14 2022] GET /compute/v2.1/os-snapshots/d5136156-9931-445d-97d4-66a517ada981 => generated 287 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 13:16:15.374138 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-51f8ad1b-d7dc-4bbf-a488-c85ce55ff7f1 tempest-VolumesSnapshotsTestJSON-870113179 tempest-VolumesSnapshotsTestJSON-870113179-project] Calling method '.version_select at 0x7f5093bb34c0>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:16:15.416265 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-51f8ad1b-d7dc-4bbf-a488-c85ce55ff7f1 tempest-VolumesSnapshotsTestJSON-870113179 tempest-VolumesSnapshotsTestJSON-870113179-project] 10.222.0.23 "GET /compute/v2.1/os-snapshots/d5136156-9931-445d-97d4-66a517ada981" status: 200 len: 287 microversion: 2.1 time: 0.046532 Oct 13 13:16:15.417121 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 397/810] 10.222.0.23 () {58 vars in 1251 bytes} [Thu Oct 13 13:16:15 2022] GET /compute/v2.1/os-snapshots/d5136156-9931-445d-97d4-66a517ada981 => generated 287 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 13:16:16.427996 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG dbcounter [-] [118814] Writing DB stats nova_api:UPDATE=1,nova_api:SELECT=83,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=118814) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:16:16.428785 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG dbcounter [-] [118814] Writing DB stats nova_cell1:SELECT=21 {{(pid=118814) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:16:16.436200 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-d9d88a55-4e39-4408-a952-39abbacda74a tempest-VolumesSnapshotsTestJSON-870113179 tempest-VolumesSnapshotsTestJSON-870113179-project] Calling method '.version_select at 0x7f5093c7fa60>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:16:16.473237 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-d9d88a55-4e39-4408-a952-39abbacda74a tempest-VolumesSnapshotsTestJSON-870113179 tempest-VolumesSnapshotsTestJSON-870113179-project] 10.222.0.23 "GET /compute/v2.1/os-snapshots/d5136156-9931-445d-97d4-66a517ada981" status: 200 len: 288 microversion: 2.1 time: 0.046518 Oct 13 13:16:16.474087 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 414/811] 10.222.0.23 () {58 vars in 1251 bytes} [Thu Oct 13 13:16:16 2022] GET /compute/v2.1/os-snapshots/d5136156-9931-445d-97d4-66a517ada981 => generated 288 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 13 13:16:16.493699 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-efb97a45-76a0-4c79-a197-99e71fe84a22 tempest-VolumesSnapshotsTestJSON-870113179 tempest-VolumesSnapshotsTestJSON-870113179-project] Calling method '.version_select at 0x7f5093c641f0>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:16:16.564997 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-efb97a45-76a0-4c79-a197-99e71fe84a22 tempest-VolumesSnapshotsTestJSON-870113179 tempest-VolumesSnapshotsTestJSON-870113179-project] 10.222.0.23 "DELETE /compute/v2.1/os-snapshots/d5136156-9931-445d-97d4-66a517ada981" status: 202 len: 0 microversion: 2.1 time: 0.082452 Oct 13 13:16:16.565719 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 398/812] 10.222.0.23 () {58 vars in 1254 bytes} [Thu Oct 13 13:16:16 2022] DELETE /compute/v2.1/os-snapshots/d5136156-9931-445d-97d4-66a517ada981 => generated 0 bytes in 84 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 13 13:16:16.577311 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-ae95832c-cf81-43fe-ad44-f52a31894b15 tempest-VolumesSnapshotsTestJSON-870113179 tempest-VolumesSnapshotsTestJSON-870113179-project] Calling method '.version_select at 0x7f5093c79550>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:16:16.616227 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-ae95832c-cf81-43fe-ad44-f52a31894b15 tempest-VolumesSnapshotsTestJSON-870113179 tempest-VolumesSnapshotsTestJSON-870113179-project] 10.222.0.23 "GET /compute/v2.1/os-snapshots/d5136156-9931-445d-97d4-66a517ada981" status: 200 len: 287 microversion: 2.1 time: 0.043073 Oct 13 13:16:16.623038 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 415/813] 10.222.0.23 () {58 vars in 1251 bytes} [Thu Oct 13 13:16:16 2022] GET /compute/v2.1/os-snapshots/d5136156-9931-445d-97d4-66a517ada981 => generated 287 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 13:16:17.630189 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-369d3404-c59b-48b2-9dc3-1762b8e7387c tempest-VolumesSnapshotsTestJSON-870113179 tempest-VolumesSnapshotsTestJSON-870113179-project] Calling method '.version_select at 0x7f5093b54670>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:16:17.637021 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG dbcounter [-] [118815] Writing DB stats nova_api:SELECT=61,nova_api:UPDATE=2 {{(pid=118815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:16:17.637747 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG dbcounter [-] [118815] Writing DB stats nova_cell1:SELECT=67,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:16:17.665251 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.wsgi [None req-369d3404-c59b-48b2-9dc3-1762b8e7387c tempest-VolumesSnapshotsTestJSON-870113179 tempest-VolumesSnapshotsTestJSON-870113179-project] HTTP exception thrown: Snapshot d5136156-9931-445d-97d4-66a517ada981 could not be found. Oct 13 13:16:17.667655 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-369d3404-c59b-48b2-9dc3-1762b8e7387c tempest-VolumesSnapshotsTestJSON-870113179 tempest-VolumesSnapshotsTestJSON-870113179-project] Request method failure captured: Oct 13 13:16:17.667655 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: request: GET /compute/v2.1/os-snapshots/d5136156-9931-445d-97d4-66a517ada981 HTTP/1.1 Oct 13 13:16:17.667655 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: Accept: application/json Oct 13 13:16:17.667655 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: Accept-Encoding: identity Oct 13 13:16:17.667655 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: Connection: close Oct 13 13:16:17.667655 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: Content-Length: 0 Oct 13 13:16:17.667655 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: Content-Type: application/json Oct 13 13:16:17.667655 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: Host: 10.222.0.23 Oct 13 13:16:17.667655 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: Openstack-System-Scope: None Oct 13 13:16:17.667655 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: User-Agent: python-urllib3/1.26.12 Oct 13 13:16:17.667655 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Auth-Token: gAAAAABjSA-Yq4BiTdsNlptAVQCRJu-0nZ1_knMttRH2D5krSkt8ZAxaIKqT4PtCH7bV7rm7wrauIL3uqHq3teNdGEs0eFhVvBk3WqumwLIZ2ssK_6N5CygfoLShSc_Mf0ZbM-4wZ86nRZht6J4YTk1L_qM8yazuL_lPgLl95ITTcriIDmyeoaQ Oct 13 13:16:17.667655 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Domain-Id: None Oct 13 13:16:17.667655 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Domain-Name: None Oct 13 13:16:17.667655 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Identity-Status: Confirmed Oct 13 13:16:17.667655 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Is-Admin-Project: True Oct 13 13:16:17.667655 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Project-Domain-Id: default Oct 13 13:16:17.667655 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Project-Domain-Name: Default Oct 13 13:16:17.667655 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Project-Id: 41c4eb07ee1f4413a4e88dd4ce68d4ab Oct 13 13:16:17.667655 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-870113179 Oct 13 13:16:17.667655 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Role: reader,member Oct 13 13:16:17.667655 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Roles: reader,member Oct 13 13:16:17.670295 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_41c4eb07ee1f4413a4e88dd4ce68d4ab"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/41c4eb07ee1f4413a4e88dd4ce68d4ab"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/41c4eb07ee1f4413a4e88dd4ce68d4ab"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/41c4eb07ee1f4413a4e88dd4ce68d4ab"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}] Oct 13 13:16:17.670295 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Tenant: tempest-VolumesSnapshotsTestJSON-870113179 Oct 13 13:16:17.670295 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Tenant-Id: 41c4eb07ee1f4413a4e88dd4ce68d4ab Oct 13 13:16:17.670295 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-870113179 Oct 13 13:16:17.670295 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-User: tempest-VolumesSnapshotsTestJSON-870113179-project Oct 13 13:16:17.670295 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-User-Domain-Id: default Oct 13 13:16:17.670295 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-User-Domain-Name: Default Oct 13 13:16:17.670295 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-User-Id: 1f6783ab86fa47859ba0fb45ff427a06 Oct 13 13:16:17.670295 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-User-Name: tempest-VolumesSnapshotsTestJSON-870113179-project Oct 13 13:16:17.670295 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: method: Oct 13 13:16:17.670295 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: exception: Snapshot d5136156-9931-445d-97d4-66a517ada981 could not be found. Oct 13 13:16:17.670295 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: action_args: {'id': 'd5136156-9931-445d-97d4-66a517ada981'} Oct 13 13:16:17.670295 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 13:16:17.671590 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 13:16:17.671590 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Oct 13 13:16:17.671590 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Oct 13 13:16:17.671590 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Oct 13 13:16:17.671590 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Oct 13 13:16:17.671590 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Oct 13 13:16:17.671590 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Oct 13 13:16:17.671590 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 13 13:16:17.671590 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 13 13:16:17.671590 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 13 13:16:17.671590 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 13 13:16:17.671590 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 13 13:16:17.671590 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 13 13:16:17.671590 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 13 13:16:17.671590 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 13 13:16:17.671590 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot d5136156-9931-445d-97d4-66a517ada981 could not be found. (HTTP 404) (Request-ID: req-a08c9d93-e64f-486e-b97b-c957523f0ac7) Oct 13 13:16:17.671590 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi Oct 13 13:16:17.671590 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 13:16:17.673183 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi Oct 13 13:16:17.673183 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 13:16:17.673183 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Oct 13 13:16:17.673183 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Oct 13 13:16:17.673183 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 13 13:16:17.673183 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 13 13:16:17.673183 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Oct 13 13:16:17.673183 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Oct 13 13:16:17.673183 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 13 13:16:17.673183 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 13 13:16:17.673183 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Oct 13 13:16:17.673183 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Oct 13 13:16:17.673183 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Oct 13 13:16:17.673183 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Oct 13 13:16:17.673183 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Oct 13 13:16:17.673183 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Oct 13 13:16:17.673183 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 13 13:16:17.673183 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 13 13:16:17.673183 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 13 13:16:17.674999 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 13 13:16:17.674999 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 13 13:16:17.674999 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 13 13:16:17.674999 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 13 13:16:17.674999 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 13 13:16:17.674999 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot d5136156-9931-445d-97d4-66a517ada981 could not be found. Oct 13 13:16:17.674999 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi Oct 13 13:16:17.674999 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 13:16:17.674999 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi Oct 13 13:16:17.674999 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 13:16:17.674999 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 13:16:17.674999 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 13:16:17.674999 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 13:16:17.674999 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 13:16:17.674999 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 13 13:16:17.674999 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 13 13:16:17.674999 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 13:16:17.674999 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 13:16:17.674999 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Oct 13 13:16:17.674999 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 13 13:16:17.676492 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot d5136156-9931-445d-97d4-66a517ada981 could not be found. Oct 13 13:16:17.676492 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi Oct 13 13:16:17.676492 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 13:16:17.676492 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi Oct 13 13:16:17.676492 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 13:16:17.676492 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 13:16:17.676492 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 13:16:17.676492 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 13:16:17.676492 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 13:16:17.676492 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot d5136156-9931-445d-97d4-66a517ada981 could not be found. Oct 13 13:16:17.676492 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi Oct 13 13:16:17.679691 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-369d3404-c59b-48b2-9dc3-1762b8e7387c tempest-VolumesSnapshotsTestJSON-870113179 tempest-VolumesSnapshotsTestJSON-870113179-project] Returning 404 to user: Snapshot d5136156-9931-445d-97d4-66a517ada981 could not be found. {{(pid=118815) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 13:16:17.679691 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-369d3404-c59b-48b2-9dc3-1762b8e7387c tempest-VolumesSnapshotsTestJSON-870113179 tempest-VolumesSnapshotsTestJSON-870113179-project] 10.222.0.23 "GET /compute/v2.1/os-snapshots/d5136156-9931-445d-97d4-66a517ada981" status: 404 len: 111 microversion: 2.1 time: 0.052688 Oct 13 13:16:17.679691 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 399/814] 10.222.0.23 () {58 vars in 1251 bytes} [Thu Oct 13 13:16:17 2022] GET /compute/v2.1/os-snapshots/d5136156-9931-445d-97d4-66a517ada981 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 13 13:16:17.688700 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-4ddd2dec-6a42-4b03-b389-2a594f7a54c8 tempest-VolumesSnapshotsTestJSON-870113179 tempest-VolumesSnapshotsTestJSON-870113179-project] Calling method '.version_select at 0x7f5093d691f0>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:16:17.762629 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-4ddd2dec-6a42-4b03-b389-2a594f7a54c8 tempest-VolumesSnapshotsTestJSON-870113179 tempest-VolumesSnapshotsTestJSON-870113179-project] 10.222.0.23 "DELETE /compute/v2.1/os-volumes/f7e45ea4-eef0-4484-af0e-dacd5c67331a" status: 202 len: 0 microversion: 2.1 time: 0.078455 Oct 13 13:16:17.763315 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 416/815] 10.222.0.23 () {58 vars in 1248 bytes} [Thu Oct 13 13:16:17 2022] DELETE /compute/v2.1/os-volumes/f7e45ea4-eef0-4484-af0e-dacd5c67331a => generated 0 bytes in 80 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 13 13:16:17.772485 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-50666a51-9f9c-41d4-a2e0-64b7fc7bf2f4 tempest-VolumesSnapshotsTestJSON-870113179 tempest-VolumesSnapshotsTestJSON-870113179-project] Calling method '.version_select at 0x7f5093b54dc0>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:16:17.837653 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-50666a51-9f9c-41d4-a2e0-64b7fc7bf2f4 tempest-VolumesSnapshotsTestJSON-870113179 tempest-VolumesSnapshotsTestJSON-870113179-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/f7e45ea4-eef0-4484-af0e-dacd5c67331a" status: 200 len: 345 microversion: 2.1 time: 0.069654 Oct 13 13:16:17.838329 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 400/816] 10.222.0.23 () {58 vars in 1245 bytes} [Thu Oct 13 13:16:17 2022] GET /compute/v2.1/os-volumes/f7e45ea4-eef0-4484-af0e-dacd5c67331a => generated 345 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 13:16:18.854880 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-b599242a-53e9-491a-9732-ec3840491740 tempest-VolumesSnapshotsTestJSON-870113179 tempest-VolumesSnapshotsTestJSON-870113179-project] Calling method '.version_select at 0x7f5093c4d9d0>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:16:18.888722 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.wsgi [None req-b599242a-53e9-491a-9732-ec3840491740 tempest-VolumesSnapshotsTestJSON-870113179 tempest-VolumesSnapshotsTestJSON-870113179-project] HTTP exception thrown: Volume f7e45ea4-eef0-4484-af0e-dacd5c67331a could not be found. Oct 13 13:16:18.891132 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-b599242a-53e9-491a-9732-ec3840491740 tempest-VolumesSnapshotsTestJSON-870113179 tempest-VolumesSnapshotsTestJSON-870113179-project] Request method failure captured: Oct 13 13:16:18.891132 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: request: GET /compute/v2.1/os-volumes/f7e45ea4-eef0-4484-af0e-dacd5c67331a HTTP/1.1 Oct 13 13:16:18.891132 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: Accept: application/json Oct 13 13:16:18.891132 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: Accept-Encoding: identity Oct 13 13:16:18.891132 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: Connection: close Oct 13 13:16:18.891132 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: Content-Length: 0 Oct 13 13:16:18.891132 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: Content-Type: application/json Oct 13 13:16:18.891132 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: Host: 10.222.0.23 Oct 13 13:16:18.891132 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: Openstack-System-Scope: None Oct 13 13:16:18.891132 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: User-Agent: python-urllib3/1.26.12 Oct 13 13:16:18.891132 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Auth-Token: gAAAAABjSA-Yq4BiTdsNlptAVQCRJu-0nZ1_knMttRH2D5krSkt8ZAxaIKqT4PtCH7bV7rm7wrauIL3uqHq3teNdGEs0eFhVvBk3WqumwLIZ2ssK_6N5CygfoLShSc_Mf0ZbM-4wZ86nRZht6J4YTk1L_qM8yazuL_lPgLl95ITTcriIDmyeoaQ Oct 13 13:16:18.891132 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Domain-Id: None Oct 13 13:16:18.891132 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Domain-Name: None Oct 13 13:16:18.891132 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Identity-Status: Confirmed Oct 13 13:16:18.891132 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Is-Admin-Project: True Oct 13 13:16:18.891132 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Project-Domain-Id: default Oct 13 13:16:18.891132 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Project-Domain-Name: Default Oct 13 13:16:18.891132 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Project-Id: 41c4eb07ee1f4413a4e88dd4ce68d4ab Oct 13 13:16:18.891132 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-870113179 Oct 13 13:16:18.891132 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Role: reader,member Oct 13 13:16:18.891132 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Roles: reader,member Oct 13 13:16:18.892776 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_41c4eb07ee1f4413a4e88dd4ce68d4ab"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/41c4eb07ee1f4413a4e88dd4ce68d4ab"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/41c4eb07ee1f4413a4e88dd4ce68d4ab"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/41c4eb07ee1f4413a4e88dd4ce68d4ab"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}] Oct 13 13:16:18.892776 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Tenant: tempest-VolumesSnapshotsTestJSON-870113179 Oct 13 13:16:18.892776 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Tenant-Id: 41c4eb07ee1f4413a4e88dd4ce68d4ab Oct 13 13:16:18.892776 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-870113179 Oct 13 13:16:18.892776 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-User: tempest-VolumesSnapshotsTestJSON-870113179-project Oct 13 13:16:18.892776 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-User-Domain-Id: default Oct 13 13:16:18.892776 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-User-Domain-Name: Default Oct 13 13:16:18.892776 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-User-Id: 1f6783ab86fa47859ba0fb45ff427a06 Oct 13 13:16:18.892776 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-User-Name: tempest-VolumesSnapshotsTestJSON-870113179-project Oct 13 13:16:18.892776 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: method: Oct 13 13:16:18.892776 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: exception: Volume f7e45ea4-eef0-4484-af0e-dacd5c67331a could not be found. Oct 13 13:16:18.892776 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: action_args: {'id': 'f7e45ea4-eef0-4484-af0e-dacd5c67331a'} Oct 13 13:16:18.892776 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 13:16:18.893774 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 13:16:18.893774 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 13 13:16:18.893774 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 13 13:16:18.893774 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 13 13:16:18.893774 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 13 13:16:18.893774 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 13 13:16:18.893774 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 13 13:16:18.893774 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 13 13:16:18.893774 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 13 13:16:18.893774 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 13 13:16:18.893774 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 13 13:16:18.893774 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 13 13:16:18.893774 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 13 13:16:18.893774 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 13 13:16:18.893774 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 13 13:16:18.893774 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume f7e45ea4-eef0-4484-af0e-dacd5c67331a could not be found. (HTTP 404) (Request-ID: req-505fc1dd-45e6-4a93-9ac0-c23d5742d069) Oct 13 13:16:18.893774 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi Oct 13 13:16:18.893774 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 13:16:18.893774 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi Oct 13 13:16:18.895538 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 13:16:18.895538 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 13 13:16:18.895538 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 13 13:16:18.895538 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 13 13:16:18.895538 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 13 13:16:18.895538 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 13 13:16:18.895538 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 13 13:16:18.895538 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 13 13:16:18.895538 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 13 13:16:18.895538 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 13 13:16:18.895538 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 13 13:16:18.895538 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 13 13:16:18.895538 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 13 13:16:18.895538 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 13 13:16:18.895538 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 13 13:16:18.895538 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 13 13:16:18.895538 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 13 13:16:18.895538 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 13 13:16:18.895538 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 13 13:16:18.897233 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 13 13:16:18.897233 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 13 13:16:18.897233 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 13 13:16:18.897233 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 13 13:16:18.897233 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume f7e45ea4-eef0-4484-af0e-dacd5c67331a could not be found. Oct 13 13:16:18.897233 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi Oct 13 13:16:18.897233 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 13:16:18.897233 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi Oct 13 13:16:18.897233 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 13:16:18.897233 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 13:16:18.897233 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 13:16:18.897233 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 13:16:18.897233 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 13:16:18.897233 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 13 13:16:18.897233 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 13 13:16:18.897233 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 13:16:18.897233 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 13:16:18.897233 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 13 13:16:18.897233 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 13 13:16:18.898872 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume f7e45ea4-eef0-4484-af0e-dacd5c67331a could not be found. Oct 13 13:16:18.898872 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi Oct 13 13:16:18.898872 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 13:16:18.898872 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi Oct 13 13:16:18.898872 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 13:16:18.898872 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 13:16:18.898872 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 13:16:18.898872 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 13:16:18.898872 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 13:16:18.898872 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume f7e45ea4-eef0-4484-af0e-dacd5c67331a could not be found. Oct 13 13:16:18.898872 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi Oct 13 13:16:18.898872 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-b599242a-53e9-491a-9732-ec3840491740 tempest-VolumesSnapshotsTestJSON-870113179 tempest-VolumesSnapshotsTestJSON-870113179-project] Returning 404 to user: Volume f7e45ea4-eef0-4484-af0e-dacd5c67331a could not be found. {{(pid=118814) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 13:16:18.898872 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-b599242a-53e9-491a-9732-ec3840491740 tempest-VolumesSnapshotsTestJSON-870113179 tempest-VolumesSnapshotsTestJSON-870113179-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/f7e45ea4-eef0-4484-af0e-dacd5c67331a" status: 404 len: 109 microversion: 2.1 time: 0.042562 Oct 13 13:16:18.910871 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-d79d6acd-ef09-4a57-878d-f7e8e8bab7c4 tempest-VolumesSnapshotsTestJSON-870113179 tempest-VolumesSnapshotsTestJSON-870113179-project] Calling method '.version_select at 0x7f5093c64f70>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:16:18.915261 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 417/817] 10.222.0.23 () {58 vars in 1245 bytes} [Thu Oct 13 13:16:18 2022] GET /compute/v2.1/os-volumes/f7e45ea4-eef0-4484-af0e-dacd5c67331a => generated 109 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 13 13:16:18.947849 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.wsgi [None req-d79d6acd-ef09-4a57-878d-f7e8e8bab7c4 tempest-VolumesSnapshotsTestJSON-870113179 tempest-VolumesSnapshotsTestJSON-870113179-project] HTTP exception thrown: Volume f7e45ea4-eef0-4484-af0e-dacd5c67331a could not be found. Oct 13 13:16:18.949935 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-d79d6acd-ef09-4a57-878d-f7e8e8bab7c4 tempest-VolumesSnapshotsTestJSON-870113179 tempest-VolumesSnapshotsTestJSON-870113179-project] Request method failure captured: Oct 13 13:16:18.949935 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: request: DELETE /compute/v2.1/os-volumes/f7e45ea4-eef0-4484-af0e-dacd5c67331a HTTP/1.1 Oct 13 13:16:18.949935 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: Accept: application/json Oct 13 13:16:18.949935 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: Accept-Encoding: identity Oct 13 13:16:18.949935 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: Connection: close Oct 13 13:16:18.949935 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: Content-Length: 0 Oct 13 13:16:18.949935 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: Content-Type: application/json Oct 13 13:16:18.949935 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: Host: 10.222.0.23 Oct 13 13:16:18.949935 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: Openstack-System-Scope: None Oct 13 13:16:18.949935 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: User-Agent: python-urllib3/1.26.12 Oct 13 13:16:18.949935 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Auth-Token: gAAAAABjSA-Yq4BiTdsNlptAVQCRJu-0nZ1_knMttRH2D5krSkt8ZAxaIKqT4PtCH7bV7rm7wrauIL3uqHq3teNdGEs0eFhVvBk3WqumwLIZ2ssK_6N5CygfoLShSc_Mf0ZbM-4wZ86nRZht6J4YTk1L_qM8yazuL_lPgLl95ITTcriIDmyeoaQ Oct 13 13:16:18.949935 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Domain-Id: None Oct 13 13:16:18.949935 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Domain-Name: None Oct 13 13:16:18.949935 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Identity-Status: Confirmed Oct 13 13:16:18.949935 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Is-Admin-Project: True Oct 13 13:16:18.949935 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Project-Domain-Id: default Oct 13 13:16:18.949935 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Project-Domain-Name: Default Oct 13 13:16:18.949935 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Project-Id: 41c4eb07ee1f4413a4e88dd4ce68d4ab Oct 13 13:16:18.949935 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-870113179 Oct 13 13:16:18.949935 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Role: reader,member Oct 13 13:16:18.949935 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Roles: reader,member Oct 13 13:16:18.951283 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_41c4eb07ee1f4413a4e88dd4ce68d4ab"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/41c4eb07ee1f4413a4e88dd4ce68d4ab"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/41c4eb07ee1f4413a4e88dd4ce68d4ab"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/41c4eb07ee1f4413a4e88dd4ce68d4ab"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}] Oct 13 13:16:18.951283 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Tenant: tempest-VolumesSnapshotsTestJSON-870113179 Oct 13 13:16:18.951283 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Tenant-Id: 41c4eb07ee1f4413a4e88dd4ce68d4ab Oct 13 13:16:18.951283 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-870113179 Oct 13 13:16:18.951283 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-User: tempest-VolumesSnapshotsTestJSON-870113179-project Oct 13 13:16:18.951283 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-User-Domain-Id: default Oct 13 13:16:18.951283 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-User-Domain-Name: Default Oct 13 13:16:18.951283 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-User-Id: 1f6783ab86fa47859ba0fb45ff427a06 Oct 13 13:16:18.951283 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-User-Name: tempest-VolumesSnapshotsTestJSON-870113179-project Oct 13 13:16:18.951283 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: method: Oct 13 13:16:18.951283 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: exception: Volume f7e45ea4-eef0-4484-af0e-dacd5c67331a could not be found. Oct 13 13:16:18.951283 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: action_args: {'id': 'f7e45ea4-eef0-4484-af0e-dacd5c67331a'} Oct 13 13:16:18.951283 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 13:16:18.952095 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 13:16:18.952095 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 13 13:16:18.952095 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 13 13:16:18.952095 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 13 13:16:18.952095 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 13 13:16:18.952095 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 13 13:16:18.952095 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 13 13:16:18.952095 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 13 13:16:18.952095 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 13 13:16:18.952095 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 13 13:16:18.952095 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 13 13:16:18.952095 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 13 13:16:18.952095 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 13 13:16:18.952095 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 13 13:16:18.952095 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 13 13:16:18.952095 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume f7e45ea4-eef0-4484-af0e-dacd5c67331a could not be found. (HTTP 404) (Request-ID: req-87bf2b97-cebf-428d-943f-c519545e20b6) Oct 13 13:16:18.952095 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi Oct 13 13:16:18.952095 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 13:16:18.952095 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi Oct 13 13:16:18.953534 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 13:16:18.953534 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Oct 13 13:16:18.953534 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Oct 13 13:16:18.953534 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 13 13:16:18.953534 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 13 13:16:18.953534 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 13 13:16:18.953534 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 13 13:16:18.953534 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 13 13:16:18.953534 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 13 13:16:18.953534 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 13 13:16:18.953534 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 13 13:16:18.953534 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 13 13:16:18.953534 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 13 13:16:18.953534 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 13 13:16:18.953534 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 13 13:16:18.953534 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 13 13:16:18.953534 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 13 13:16:18.953534 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 13 13:16:18.953534 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 13 13:16:18.954860 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 13 13:16:18.954860 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 13 13:16:18.954860 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 13 13:16:18.954860 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 13 13:16:18.954860 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume f7e45ea4-eef0-4484-af0e-dacd5c67331a could not be found. Oct 13 13:16:18.954860 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi Oct 13 13:16:18.954860 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 13:16:18.954860 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi Oct 13 13:16:18.954860 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 13:16:18.954860 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 13:16:18.954860 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 13:16:18.954860 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 13:16:18.954860 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 13:16:18.954860 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 13 13:16:18.954860 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 13 13:16:18.954860 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 13:16:18.954860 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 13:16:18.954860 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Oct 13 13:16:18.954860 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 13 13:16:18.957031 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume f7e45ea4-eef0-4484-af0e-dacd5c67331a could not be found. Oct 13 13:16:18.957031 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi Oct 13 13:16:18.957031 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 13:16:18.957031 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi Oct 13 13:16:18.957031 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 13:16:18.957031 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 13:16:18.957031 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 13:16:18.957031 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 13:16:18.957031 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 13:16:18.957031 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume f7e45ea4-eef0-4484-af0e-dacd5c67331a could not be found. Oct 13 13:16:18.957031 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi Oct 13 13:16:18.957031 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-d79d6acd-ef09-4a57-878d-f7e8e8bab7c4 tempest-VolumesSnapshotsTestJSON-870113179 tempest-VolumesSnapshotsTestJSON-870113179-project] Returning 404 to user: Volume f7e45ea4-eef0-4484-af0e-dacd5c67331a could not be found. {{(pid=118815) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 13:16:18.957031 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-d79d6acd-ef09-4a57-878d-f7e8e8bab7c4 tempest-VolumesSnapshotsTestJSON-870113179 tempest-VolumesSnapshotsTestJSON-870113179-project] 10.222.0.23 "DELETE /compute/v2.1/os-volumes/f7e45ea4-eef0-4484-af0e-dacd5c67331a" status: 404 len: 109 microversion: 2.1 time: 0.048207 Oct 13 13:16:18.957031 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 401/818] 10.222.0.23 () {58 vars in 1248 bytes} [Thu Oct 13 13:16:18 2022] DELETE /compute/v2.1/os-volumes/f7e45ea4-eef0-4484-af0e-dacd5c67331a => generated 109 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 13 13:16:18.964690 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-fd7e6f10-a9c7-43e4-a37a-d941be8b279c tempest-VolumesSnapshotsTestJSON-870113179 tempest-VolumesSnapshotsTestJSON-870113179-project] Calling method '.version_select at 0x7f5093c798b0>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:16:18.997995 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.wsgi [None req-fd7e6f10-a9c7-43e4-a37a-d941be8b279c tempest-VolumesSnapshotsTestJSON-870113179 tempest-VolumesSnapshotsTestJSON-870113179-project] HTTP exception thrown: Volume f7e45ea4-eef0-4484-af0e-dacd5c67331a could not be found. Oct 13 13:16:19.000951 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-fd7e6f10-a9c7-43e4-a37a-d941be8b279c tempest-VolumesSnapshotsTestJSON-870113179 tempest-VolumesSnapshotsTestJSON-870113179-project] Request method failure captured: Oct 13 13:16:19.000951 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: request: GET /compute/v2.1/os-volumes/f7e45ea4-eef0-4484-af0e-dacd5c67331a HTTP/1.1 Oct 13 13:16:19.000951 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: Accept: application/json Oct 13 13:16:19.000951 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: Accept-Encoding: identity Oct 13 13:16:19.000951 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: Connection: close Oct 13 13:16:19.000951 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: Content-Length: 0 Oct 13 13:16:19.000951 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: Content-Type: application/json Oct 13 13:16:19.000951 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: Host: 10.222.0.23 Oct 13 13:16:19.000951 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: Openstack-System-Scope: None Oct 13 13:16:19.000951 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: User-Agent: python-urllib3/1.26.12 Oct 13 13:16:19.000951 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Auth-Token: gAAAAABjSA-Yq4BiTdsNlptAVQCRJu-0nZ1_knMttRH2D5krSkt8ZAxaIKqT4PtCH7bV7rm7wrauIL3uqHq3teNdGEs0eFhVvBk3WqumwLIZ2ssK_6N5CygfoLShSc_Mf0ZbM-4wZ86nRZht6J4YTk1L_qM8yazuL_lPgLl95ITTcriIDmyeoaQ Oct 13 13:16:19.000951 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Domain-Id: None Oct 13 13:16:19.000951 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Domain-Name: None Oct 13 13:16:19.000951 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Identity-Status: Confirmed Oct 13 13:16:19.000951 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Is-Admin-Project: True Oct 13 13:16:19.000951 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Project-Domain-Id: default Oct 13 13:16:19.000951 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Project-Domain-Name: Default Oct 13 13:16:19.000951 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Project-Id: 41c4eb07ee1f4413a4e88dd4ce68d4ab Oct 13 13:16:19.000951 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-870113179 Oct 13 13:16:19.000951 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Role: reader,member Oct 13 13:16:19.000951 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Roles: reader,member Oct 13 13:16:19.002281 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_41c4eb07ee1f4413a4e88dd4ce68d4ab"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/41c4eb07ee1f4413a4e88dd4ce68d4ab"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/41c4eb07ee1f4413a4e88dd4ce68d4ab"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/41c4eb07ee1f4413a4e88dd4ce68d4ab"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}] Oct 13 13:16:19.002281 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Tenant: tempest-VolumesSnapshotsTestJSON-870113179 Oct 13 13:16:19.002281 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Tenant-Id: 41c4eb07ee1f4413a4e88dd4ce68d4ab Oct 13 13:16:19.002281 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-870113179 Oct 13 13:16:19.002281 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-User: tempest-VolumesSnapshotsTestJSON-870113179-project Oct 13 13:16:19.002281 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-User-Domain-Id: default Oct 13 13:16:19.002281 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-User-Domain-Name: Default Oct 13 13:16:19.002281 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-User-Id: 1f6783ab86fa47859ba0fb45ff427a06 Oct 13 13:16:19.002281 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-User-Name: tempest-VolumesSnapshotsTestJSON-870113179-project Oct 13 13:16:19.002281 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: method: Oct 13 13:16:19.002281 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: exception: Volume f7e45ea4-eef0-4484-af0e-dacd5c67331a could not be found. Oct 13 13:16:19.002281 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: action_args: {'id': 'f7e45ea4-eef0-4484-af0e-dacd5c67331a'} Oct 13 13:16:19.002281 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 13:16:19.003086 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 13:16:19.003086 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 13 13:16:19.003086 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 13 13:16:19.003086 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 13 13:16:19.003086 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 13 13:16:19.003086 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 13 13:16:19.003086 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 13 13:16:19.003086 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 13 13:16:19.003086 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 13 13:16:19.003086 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 13 13:16:19.003086 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 13 13:16:19.003086 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 13 13:16:19.003086 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 13 13:16:19.003086 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 13 13:16:19.003086 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 13 13:16:19.003086 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume f7e45ea4-eef0-4484-af0e-dacd5c67331a could not be found. (HTTP 404) (Request-ID: req-43e8da48-192a-4d98-9e90-d74969b22725) Oct 13 13:16:19.003086 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi Oct 13 13:16:19.003086 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 13:16:19.003086 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi Oct 13 13:16:19.004197 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 13:16:19.004197 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 13 13:16:19.004197 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 13 13:16:19.004197 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 13 13:16:19.004197 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 13 13:16:19.004197 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 13 13:16:19.004197 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 13 13:16:19.004197 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 13 13:16:19.004197 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 13 13:16:19.004197 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 13 13:16:19.004197 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 13 13:16:19.004197 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 13 13:16:19.004197 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 13 13:16:19.004197 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 13 13:16:19.004197 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 13 13:16:19.004197 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 13 13:16:19.004197 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 13 13:16:19.004197 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 13 13:16:19.004197 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 13 13:16:19.005320 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 13 13:16:19.005320 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 13 13:16:19.005320 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 13 13:16:19.005320 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 13 13:16:19.005320 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume f7e45ea4-eef0-4484-af0e-dacd5c67331a could not be found. Oct 13 13:16:19.005320 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi Oct 13 13:16:19.005320 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 13:16:19.005320 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi Oct 13 13:16:19.005320 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 13:16:19.005320 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 13:16:19.005320 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 13:16:19.005320 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 13:16:19.005320 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 13:16:19.005320 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 13 13:16:19.005320 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 13 13:16:19.005320 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 13:16:19.005320 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 13:16:19.005320 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 13 13:16:19.005320 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 13 13:16:19.006448 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume f7e45ea4-eef0-4484-af0e-dacd5c67331a could not be found. Oct 13 13:16:19.006448 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi Oct 13 13:16:19.006448 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 13:16:19.006448 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi Oct 13 13:16:19.006448 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 13:16:19.006448 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 13:16:19.006448 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 13:16:19.006448 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 13:16:19.006448 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 13:16:19.006448 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume f7e45ea4-eef0-4484-af0e-dacd5c67331a could not be found. Oct 13 13:16:19.006448 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi Oct 13 13:16:19.006448 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-fd7e6f10-a9c7-43e4-a37a-d941be8b279c tempest-VolumesSnapshotsTestJSON-870113179 tempest-VolumesSnapshotsTestJSON-870113179-project] Returning 404 to user: Volume f7e45ea4-eef0-4484-af0e-dacd5c67331a could not be found. {{(pid=118814) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 13:16:19.006448 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-fd7e6f10-a9c7-43e4-a37a-d941be8b279c tempest-VolumesSnapshotsTestJSON-870113179 tempest-VolumesSnapshotsTestJSON-870113179-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/f7e45ea4-eef0-4484-af0e-dacd5c67331a" status: 404 len: 109 microversion: 2.1 time: 0.042622 Oct 13 13:16:19.006448 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 418/819] 10.222.0.23 () {58 vars in 1245 bytes} [Thu Oct 13 13:16:18 2022] GET /compute/v2.1/os-volumes/f7e45ea4-eef0-4484-af0e-dacd5c67331a => generated 109 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 13 13:16:35.682012 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-1799ca7b-77fb-49b2-b0ab-b5e8c02ed2bc tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Calling method '>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:16:35.684471 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-1799ca7b-77fb-49b2-b0ab-b5e8c02ed2bc tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] [instance: c3478cd4-e4ab-4a7d-9f4d-65323c450348] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:16:35.690479 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-1799ca7b-77fb-49b2-b0ab-b5e8c02ed2bc tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:16:35.690956 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-1799ca7b-77fb-49b2-b0ab-b5e8c02ed2bc tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:16:35.691427 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-1799ca7b-77fb-49b2-b0ab-b5e8c02ed2bc tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:16:35.692107 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-1799ca7b-77fb-49b2-b0ab-b5e8c02ed2bc tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:16:35.692559 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-1799ca7b-77fb-49b2-b0ab-b5e8c02ed2bc tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:16:35.692980 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-1799ca7b-77fb-49b2-b0ab-b5e8c02ed2bc tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:16:35.721690 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-1799ca7b-77fb-49b2-b0ab-b5e8c02ed2bc tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] 10.222.0.23 "GET /compute/v2.1/servers/c3478cd4-e4ab-4a7d-9f4d-65323c450348/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.044667 Oct 13 13:16:35.722227 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 402/820] 10.222.0.23 () {60 vars in 1343 bytes} [Thu Oct 13 13:16:35 2022] GET /compute/v2.1/servers/c3478cd4-e4ab-4a7d-9f4d-65323c450348/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:16:35.785646 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-ee8a9053-4db0-48d2-b60e-5f646c3a7a06 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Calling method '>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:16:35.786328 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-ee8a9053-4db0-48d2-b60e-5f646c3a7a06 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] [instance: c3478cd4-e4ab-4a7d-9f4d-65323c450348] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:16:35.792667 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-ee8a9053-4db0-48d2-b60e-5f646c3a7a06 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:16:35.793155 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-ee8a9053-4db0-48d2-b60e-5f646c3a7a06 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:16:35.793598 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-ee8a9053-4db0-48d2-b60e-5f646c3a7a06 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:16:35.794956 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-ee8a9053-4db0-48d2-b60e-5f646c3a7a06 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:16:35.795442 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-ee8a9053-4db0-48d2-b60e-5f646c3a7a06 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:16:35.795873 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-ee8a9053-4db0-48d2-b60e-5f646c3a7a06 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:16:35.820875 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-ee8a9053-4db0-48d2-b60e-5f646c3a7a06 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] [instance: c3478cd4-e4ab-4a7d-9f4d-65323c450348] Going to try to terminate instance {{(pid=118814) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 13 13:16:35.895811 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-ee8a9053-4db0-48d2-b60e-5f646c3a7a06 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] 10.222.0.23 "DELETE /compute/v2.1/servers/c3478cd4-e4ab-4a7d-9f4d-65323c450348" status: 204 len: 0 microversion: 2.20 time: 0.115038 Oct 13 13:16:35.896544 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 419/821] 10.222.0.23 () {60 vars in 1280 bytes} [Thu Oct 13 13:16:35 2022] DELETE /compute/v2.1/servers/c3478cd4-e4ab-4a7d-9f4d-65323c450348 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 13 13:16:35.905171 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-01fba954-eb75-452a-b0bf-4fcf20c8ce55 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Calling method '>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:16:35.905773 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-01fba954-eb75-452a-b0bf-4fcf20c8ce55 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] [instance: c3478cd4-e4ab-4a7d-9f4d-65323c450348] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:16:35.912131 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-01fba954-eb75-452a-b0bf-4fcf20c8ce55 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:16:35.912131 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-01fba954-eb75-452a-b0bf-4fcf20c8ce55 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:16:35.912514 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-01fba954-eb75-452a-b0bf-4fcf20c8ce55 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:16:35.913193 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-01fba954-eb75-452a-b0bf-4fcf20c8ce55 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:16:35.913638 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-01fba954-eb75-452a-b0bf-4fcf20c8ce55 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:16:35.914055 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-01fba954-eb75-452a-b0bf-4fcf20c8ce55 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:16:36.046887 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-01fba954-eb75-452a-b0bf-4fcf20c8ce55 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:16:36.055236 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-01fba954-eb75-452a-b0bf-4fcf20c8ce55 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:16:36.056665 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-01fba954-eb75-452a-b0bf-4fcf20c8ce55 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:16:36.057804 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-01fba954-eb75-452a-b0bf-4fcf20c8ce55 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] 10.222.0.23 "GET /compute/v2.1/servers/c3478cd4-e4ab-4a7d-9f4d-65323c450348" status: 200 len: 1723 microversion: 2.20 time: 0.157087 Oct 13 13:16:36.058348 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 403/822] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 13:16:35 2022] GET /compute/v2.1/servers/c3478cd4-e4ab-4a7d-9f4d-65323c450348 => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 13 13:16:37.084029 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-c4c96fc8-c214-4724-b5e0-88035450adfe tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Calling method '>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:16:37.084734 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-c4c96fc8-c214-4724-b5e0-88035450adfe tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] [instance: c3478cd4-e4ab-4a7d-9f4d-65323c450348] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:16:37.090732 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-c4c96fc8-c214-4724-b5e0-88035450adfe tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:16:37.091264 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-c4c96fc8-c214-4724-b5e0-88035450adfe tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:16:37.091703 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-c4c96fc8-c214-4724-b5e0-88035450adfe tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:16:37.092386 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-c4c96fc8-c214-4724-b5e0-88035450adfe tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:16:37.092837 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-c4c96fc8-c214-4724-b5e0-88035450adfe tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:16:37.093264 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-c4c96fc8-c214-4724-b5e0-88035450adfe tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:16:37.235291 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-c4c96fc8-c214-4724-b5e0-88035450adfe tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:16:37.243388 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-c4c96fc8-c214-4724-b5e0-88035450adfe tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:16:37.244823 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-c4c96fc8-c214-4724-b5e0-88035450adfe tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:16:37.245972 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-c4c96fc8-c214-4724-b5e0-88035450adfe tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] 10.222.0.23 "GET /compute/v2.1/servers/c3478cd4-e4ab-4a7d-9f4d-65323c450348" status: 200 len: 1723 microversion: 2.20 time: 0.166195 Oct 13 13:16:37.246527 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 420/823] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 13:16:37 2022] GET /compute/v2.1/servers/c3478cd4-e4ab-4a7d-9f4d-65323c450348 => generated 1723 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 13:16:38.274840 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-9ac3e27e-fe9d-4099-b661-279903d62774 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Calling method '>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:16:38.276361 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-9ac3e27e-fe9d-4099-b661-279903d62774 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] [instance: c3478cd4-e4ab-4a7d-9f4d-65323c450348] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:16:38.285723 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-9ac3e27e-fe9d-4099-b661-279903d62774 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:16:38.286288 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-9ac3e27e-fe9d-4099-b661-279903d62774 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:16:38.286723 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-9ac3e27e-fe9d-4099-b661-279903d62774 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:16:38.287444 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-9ac3e27e-fe9d-4099-b661-279903d62774 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:16:38.287899 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-9ac3e27e-fe9d-4099-b661-279903d62774 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:16:38.288316 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-9ac3e27e-fe9d-4099-b661-279903d62774 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:16:38.327278 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [req-1d621bb0-d4fd-4738-a910-4a743d01ac6a req-bfa3d345-6322-4a52-aea0-a20b1fb02320 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c3478cd4-e4ab-4a7d-9f4d-65323c450348", "name": "network-vif-deleted", "tag": "ff57ee79-9921-43ed-817d-5ba082c97343"}]} {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 13:16:38.338410 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [req-1d621bb0-d4fd-4738-a910-4a743d01ac6a req-bfa3d345-6322-4a52-aea0-a20b1fb02320 service nova] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:16:38.339202 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [req-1d621bb0-d4fd-4738-a910-4a743d01ac6a req-bfa3d345-6322-4a52-aea0-a20b1fb02320 service nova] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:16:38.339882 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [req-1d621bb0-d4fd-4738-a910-4a743d01ac6a req-bfa3d345-6322-4a52-aea0-a20b1fb02320 service nova] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:16:38.353135 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.compute.server_external_events [req-1d621bb0-d4fd-4738-a910-4a743d01ac6a req-bfa3d345-6322-4a52-aea0-a20b1fb02320 service nova] Creating event network-vif-deleted:ff57ee79-9921-43ed-817d-5ba082c97343 for instance c3478cd4-e4ab-4a7d-9f4d-65323c450348 on hv-cinder-82660 Oct 13 13:16:38.359819 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-9ac3e27e-fe9d-4099-b661-279903d62774 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:16:38.365050 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [req-1d621bb0-d4fd-4738-a910-4a743d01ac6a req-bfa3d345-6322-4a52-aea0-a20b1fb02320 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040000 Oct 13 13:16:38.365956 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 421/824] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 13:16:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 13:16:38.370634 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-9ac3e27e-fe9d-4099-b661-279903d62774 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:16:38.372423 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-9ac3e27e-fe9d-4099-b661-279903d62774 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:16:38.373784 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-9ac3e27e-fe9d-4099-b661-279903d62774 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] 10.222.0.23 "GET /compute/v2.1/servers/c3478cd4-e4ab-4a7d-9f4d-65323c450348" status: 200 len: 1656 microversion: 2.20 time: 0.104195 Oct 13 13:16:38.374781 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 404/825] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 13:16:38 2022] GET /compute/v2.1/servers/c3478cd4-e4ab-4a7d-9f4d-65323c450348 => generated 1656 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 13:16:39.416292 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-4deaa664-14b7-403d-8084-a152aa1dc040 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Calling method '>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:16:39.416996 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-4deaa664-14b7-403d-8084-a152aa1dc040 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] [instance: c3478cd4-e4ab-4a7d-9f4d-65323c450348] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:16:39.423076 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-4deaa664-14b7-403d-8084-a152aa1dc040 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:16:39.423832 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-4deaa664-14b7-403d-8084-a152aa1dc040 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:16:39.424272 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-4deaa664-14b7-403d-8084-a152aa1dc040 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:16:39.424959 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-4deaa664-14b7-403d-8084-a152aa1dc040 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:16:39.425418 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-4deaa664-14b7-403d-8084-a152aa1dc040 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:16:39.425840 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-4deaa664-14b7-403d-8084-a152aa1dc040 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:16:39.489849 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-4deaa664-14b7-403d-8084-a152aa1dc040 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:16:39.498599 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-4deaa664-14b7-403d-8084-a152aa1dc040 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:16:39.500024 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-4deaa664-14b7-403d-8084-a152aa1dc040 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:16:39.501151 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-4deaa664-14b7-403d-8084-a152aa1dc040 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] 10.222.0.23 "GET /compute/v2.1/servers/c3478cd4-e4ab-4a7d-9f4d-65323c450348" status: 200 len: 1367 microversion: 2.20 time: 0.089548 Oct 13 13:16:39.501695 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 422/826] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 13:16:39 2022] GET /compute/v2.1/servers/c3478cd4-e4ab-4a7d-9f4d-65323c450348 => generated 1367 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 13:16:40.526146 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-449f2233-0392-42bf-8e1e-26af5cc95ef2 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Calling method '>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:16:40.526759 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-449f2233-0392-42bf-8e1e-26af5cc95ef2 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] [instance: c3478cd4-e4ab-4a7d-9f4d-65323c450348] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:16:40.533708 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-449f2233-0392-42bf-8e1e-26af5cc95ef2 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:16:40.534188 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-449f2233-0392-42bf-8e1e-26af5cc95ef2 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:16:40.534626 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-449f2233-0392-42bf-8e1e-26af5cc95ef2 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:16:40.535346 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-449f2233-0392-42bf-8e1e-26af5cc95ef2 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:16:40.535803 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-449f2233-0392-42bf-8e1e-26af5cc95ef2 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:16:40.536228 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-449f2233-0392-42bf-8e1e-26af5cc95ef2 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:16:40.605136 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-449f2233-0392-42bf-8e1e-26af5cc95ef2 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:16:40.613219 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-449f2233-0392-42bf-8e1e-26af5cc95ef2 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:16:40.614663 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-449f2233-0392-42bf-8e1e-26af5cc95ef2 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5dbaf53464b44fe8d9e16f5013587b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4b9833fd14a1f881610bbc90bbd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:16:40.615818 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-449f2233-0392-42bf-8e1e-26af5cc95ef2 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] 10.222.0.23 "GET /compute/v2.1/servers/c3478cd4-e4ab-4a7d-9f4d-65323c450348" status: 200 len: 1367 microversion: 2.20 time: 0.093682 Oct 13 13:16:40.616368 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 405/827] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 13:16:40 2022] GET /compute/v2.1/servers/c3478cd4-e4ab-4a7d-9f4d-65323c450348 => generated 1367 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 13:16:41.639935 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-cca21c50-6f72-4db0-9807-8d64054609a0 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Calling method '>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:16:41.640476 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-cca21c50-6f72-4db0-9807-8d64054609a0 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] [instance: c3478cd4-e4ab-4a7d-9f4d-65323c450348] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:16:41.646890 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-cca21c50-6f72-4db0-9807-8d64054609a0 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:16:41.647396 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-cca21c50-6f72-4db0-9807-8d64054609a0 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:16:41.647838 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-cca21c50-6f72-4db0-9807-8d64054609a0 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:16:41.648515 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-cca21c50-6f72-4db0-9807-8d64054609a0 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:16:41.648966 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-cca21c50-6f72-4db0-9807-8d64054609a0 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:16:41.649388 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-cca21c50-6f72-4db0-9807-8d64054609a0 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:16:41.663679 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.wsgi [None req-cca21c50-6f72-4db0-9807-8d64054609a0 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] HTTP exception thrown: Instance c3478cd4-e4ab-4a7d-9f4d-65323c450348 could not be found. Oct 13 13:16:41.665327 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-cca21c50-6f72-4db0-9807-8d64054609a0 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Request method failure captured: Oct 13 13:16:41.665327 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: request: GET /compute/v2.1/servers/c3478cd4-e4ab-4a7d-9f4d-65323c450348 HTTP/1.1 Oct 13 13:16:41.665327 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: Accept: application/json Oct 13 13:16:41.665327 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: Accept-Encoding: identity Oct 13 13:16:41.665327 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: Connection: close Oct 13 13:16:41.665327 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: Content-Length: 0 Oct 13 13:16:41.665327 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: Content-Type: application/json Oct 13 13:16:41.665327 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: Host: 10.222.0.23 Oct 13 13:16:41.665327 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: Openstack-System-Scope: None Oct 13 13:16:41.665327 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: User-Agent: python-urllib3/1.26.12 Oct 13 13:16:41.665327 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Auth-Token: gAAAAABjSA4tunBxxiLAsDcwzJnwD5icNArXVS2ALCK2Nvdw6H3lylo131jngSpW20VrB3U3uqD1tS775HGTmTQdbdvjmqKoRpB1Vocz90KRcx7_8rqcewdlzjgGcPlOm4Zdl2XeN-E8XYbc53rR87qrHwzD5wGkbh7UPN54dUXu2qfZrWBj3hg Oct 13 13:16:41.665327 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Domain-Id: None Oct 13 13:16:41.665327 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Domain-Name: None Oct 13 13:16:41.665327 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Identity-Status: Confirmed Oct 13 13:16:41.665327 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Is-Admin-Project: True Oct 13 13:16:41.665327 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Openstack-Nova-Api-Version: 2.20 Oct 13 13:16:41.665327 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Project-Domain-Id: default Oct 13 13:16:41.665327 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Project-Domain-Name: Default Oct 13 13:16:41.665327 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Project-Id: 4af4b9833fd14a1f881610bbc90bbd37 Oct 13 13:16:41.665327 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2099157911 Oct 13 13:16:41.665327 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Role: reader,member Oct 13 13:16:41.665327 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Roles: reader,member Oct 13 13:16:41.666843 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_4af4b9833fd14a1f881610bbc90bbd37"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/4af4b9833fd14a1f881610bbc90bbd37"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/4af4b9833fd14a1f881610bbc90bbd37"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/4af4b9833fd14a1f881610bbc90bbd37"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}] Oct 13 13:16:41.666843 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2099157911 Oct 13 13:16:41.666843 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Tenant-Id: 4af4b9833fd14a1f881610bbc90bbd37 Oct 13 13:16:41.666843 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2099157911 Oct 13 13:16:41.666843 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-User: tempest-AttachVolumeShelveTestJSON-2099157911-project Oct 13 13:16:41.666843 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-User-Domain-Id: default Oct 13 13:16:41.666843 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-User-Domain-Name: Default Oct 13 13:16:41.666843 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-User-Id: b5dbaf53464b44fe8d9e16f5013587b4 Oct 13 13:16:41.666843 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2099157911-project Oct 13 13:16:41.666843 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: method: > Oct 13 13:16:41.666843 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: exception: Instance c3478cd4-e4ab-4a7d-9f4d-65323c450348 could not be found. Oct 13 13:16:41.666843 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: action_args: {'id': 'c3478cd4-e4ab-4a7d-9f4d-65323c450348'} Oct 13 13:16:41.667802 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 13:16:41.667802 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 13:16:41.667802 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 13 13:16:41.667802 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 13 13:16:41.667802 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 13 13:16:41.667802 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 13 13:16:41.667802 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 13 13:16:41.667802 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 13 13:16:41.667802 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 13 13:16:41.667802 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 13 13:16:41.667802 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c3478cd4-e4ab-4a7d-9f4d-65323c450348 could not be found. Oct 13 13:16:41.667802 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi Oct 13 13:16:41.667802 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 13:16:41.667802 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi Oct 13 13:16:41.667802 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 13:16:41.667802 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 13:16:41.667802 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 13:16:41.667802 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 13:16:41.667802 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 13:16:41.667802 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 13:16:41.669726 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 13:16:41.669726 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 13 13:16:41.669726 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 13 13:16:41.669726 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 13 13:16:41.669726 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 13 13:16:41.669726 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 13 13:16:41.669726 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 13 13:16:41.669726 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c3478cd4-e4ab-4a7d-9f4d-65323c450348 could not be found. Oct 13 13:16:41.669726 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi Oct 13 13:16:41.669726 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 13:16:41.669726 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi Oct 13 13:16:41.669726 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 13:16:41.669726 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 13:16:41.669726 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 13:16:41.669726 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 13:16:41.669726 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 13:16:41.669726 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c3478cd4-e4ab-4a7d-9f4d-65323c450348 could not be found. Oct 13 13:16:41.669726 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi Oct 13 13:16:41.670877 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-cca21c50-6f72-4db0-9807-8d64054609a0 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Returning 404 to user: Instance c3478cd4-e4ab-4a7d-9f4d-65323c450348 could not be found. {{(pid=118814) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 13:16:41.670877 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-cca21c50-6f72-4db0-9807-8d64054609a0 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] 10.222.0.23 "GET /compute/v2.1/servers/c3478cd4-e4ab-4a7d-9f4d-65323c450348" status: 404 len: 111 microversion: 2.20 time: 0.030756 Oct 13 13:16:41.670877 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 423/828] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 13:16:41 2022] GET /compute/v2.1/servers/c3478cd4-e4ab-4a7d-9f4d-65323c450348 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 13 13:16:41.676400 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-bd66ec60-063c-4b14-b24f-7c4be1e40865 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Calling method '.version_select at 0x7f5093e0b160>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:16:41.695991 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-bd66ec60-063c-4b14-b24f-7c4be1e40865 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1069400532" status: 204 len: 0 microversion: 2.20 time: 0.023553 Oct 13 13:16:41.696567 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 406/829] 10.222.0.23 () {60 vars in 1262 bytes} [Thu Oct 13 13:16:41 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1069400532 => generated 0 bytes in 25 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Oct 13 13:16:43.463730 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-b8b8a1fa-9245-4201-9d18-cd9f2a06a1ea tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Calling method '>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:16:43.464212 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-b8b8a1fa-9245-4201-9d18-cd9f2a06a1ea tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] [instance: c3478cd4-e4ab-4a7d-9f4d-65323c450348] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:16:43.470467 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-b8b8a1fa-9245-4201-9d18-cd9f2a06a1ea tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:16:43.470940 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-b8b8a1fa-9245-4201-9d18-cd9f2a06a1ea tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:16:43.471417 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-b8b8a1fa-9245-4201-9d18-cd9f2a06a1ea tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:16:43.472101 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-b8b8a1fa-9245-4201-9d18-cd9f2a06a1ea tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:16:43.472551 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-b8b8a1fa-9245-4201-9d18-cd9f2a06a1ea tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:16:43.472971 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-b8b8a1fa-9245-4201-9d18-cd9f2a06a1ea tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:16:43.486590 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.wsgi [None req-b8b8a1fa-9245-4201-9d18-cd9f2a06a1ea tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] HTTP exception thrown: Instance c3478cd4-e4ab-4a7d-9f4d-65323c450348 could not be found. Oct 13 13:16:43.488128 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-b8b8a1fa-9245-4201-9d18-cd9f2a06a1ea tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Request method failure captured: Oct 13 13:16:43.488128 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: request: DELETE /compute/v2.1/servers/c3478cd4-e4ab-4a7d-9f4d-65323c450348 HTTP/1.1 Oct 13 13:16:43.488128 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: Accept: application/json Oct 13 13:16:43.488128 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: Accept-Encoding: identity Oct 13 13:16:43.488128 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: Connection: close Oct 13 13:16:43.488128 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: Content-Length: 0 Oct 13 13:16:43.488128 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: Content-Type: application/json Oct 13 13:16:43.488128 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: Host: 10.222.0.23 Oct 13 13:16:43.488128 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: Openstack-System-Scope: None Oct 13 13:16:43.488128 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: User-Agent: python-urllib3/1.26.12 Oct 13 13:16:43.488128 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Auth-Token: gAAAAABjSA4tunBxxiLAsDcwzJnwD5icNArXVS2ALCK2Nvdw6H3lylo131jngSpW20VrB3U3uqD1tS775HGTmTQdbdvjmqKoRpB1Vocz90KRcx7_8rqcewdlzjgGcPlOm4Zdl2XeN-E8XYbc53rR87qrHwzD5wGkbh7UPN54dUXu2qfZrWBj3hg Oct 13 13:16:43.488128 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Domain-Id: None Oct 13 13:16:43.488128 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Domain-Name: None Oct 13 13:16:43.488128 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Identity-Status: Confirmed Oct 13 13:16:43.488128 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Is-Admin-Project: True Oct 13 13:16:43.488128 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Openstack-Nova-Api-Version: 2.20 Oct 13 13:16:43.488128 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Project-Domain-Id: default Oct 13 13:16:43.488128 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Project-Domain-Name: Default Oct 13 13:16:43.488128 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Project-Id: 4af4b9833fd14a1f881610bbc90bbd37 Oct 13 13:16:43.488128 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2099157911 Oct 13 13:16:43.488128 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Role: reader,member Oct 13 13:16:43.488128 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Roles: reader,member Oct 13 13:16:43.489762 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_4af4b9833fd14a1f881610bbc90bbd37"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/4af4b9833fd14a1f881610bbc90bbd37"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/4af4b9833fd14a1f881610bbc90bbd37"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/4af4b9833fd14a1f881610bbc90bbd37"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}] Oct 13 13:16:43.489762 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2099157911 Oct 13 13:16:43.489762 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Tenant-Id: 4af4b9833fd14a1f881610bbc90bbd37 Oct 13 13:16:43.489762 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2099157911 Oct 13 13:16:43.489762 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-User: tempest-AttachVolumeShelveTestJSON-2099157911-project Oct 13 13:16:43.489762 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-User-Domain-Id: default Oct 13 13:16:43.489762 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-User-Domain-Name: Default Oct 13 13:16:43.489762 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-User-Id: b5dbaf53464b44fe8d9e16f5013587b4 Oct 13 13:16:43.489762 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2099157911-project Oct 13 13:16:43.489762 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: method: > Oct 13 13:16:43.489762 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: exception: Instance c3478cd4-e4ab-4a7d-9f4d-65323c450348 could not be found. Oct 13 13:16:43.489762 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: action_args: {'id': 'c3478cd4-e4ab-4a7d-9f4d-65323c450348'} Oct 13 13:16:43.490588 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 13:16:43.490588 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 13:16:43.490588 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 13 13:16:43.490588 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 13 13:16:43.490588 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 13 13:16:43.490588 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 13 13:16:43.490588 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 13 13:16:43.490588 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 13 13:16:43.490588 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 13 13:16:43.490588 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 13 13:16:43.490588 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c3478cd4-e4ab-4a7d-9f4d-65323c450348 could not be found. Oct 13 13:16:43.490588 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi Oct 13 13:16:43.490588 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 13:16:43.490588 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi Oct 13 13:16:43.490588 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 13:16:43.490588 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 13:16:43.490588 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 13:16:43.490588 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 13:16:43.490588 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 13:16:43.490588 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 13:16:43.492107 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 13:16:43.492107 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 13 13:16:43.492107 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 13 13:16:43.492107 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 13 13:16:43.492107 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 13 13:16:43.492107 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 13 13:16:43.492107 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 13 13:16:43.492107 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 13 13:16:43.492107 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 13 13:16:43.492107 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c3478cd4-e4ab-4a7d-9f4d-65323c450348 could not be found. Oct 13 13:16:43.492107 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi Oct 13 13:16:43.492107 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 13:16:43.492107 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi Oct 13 13:16:43.492107 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 13:16:43.492107 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 13:16:43.492107 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 13:16:43.492107 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 13:16:43.492107 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 13:16:43.492107 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c3478cd4-e4ab-4a7d-9f4d-65323c450348 could not be found. Oct 13 13:16:43.492107 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi Oct 13 13:16:43.493578 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-b8b8a1fa-9245-4201-9d18-cd9f2a06a1ea tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Returning 404 to user: Instance c3478cd4-e4ab-4a7d-9f4d-65323c450348 could not be found. {{(pid=118814) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 13:16:43.493578 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-b8b8a1fa-9245-4201-9d18-cd9f2a06a1ea tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] 10.222.0.23 "DELETE /compute/v2.1/servers/c3478cd4-e4ab-4a7d-9f4d-65323c450348" status: 404 len: 111 microversion: 2.20 time: 0.029578 Oct 13 13:16:43.493578 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 424/830] 10.222.0.23 () {60 vars in 1280 bytes} [Thu Oct 13 13:16:43 2022] DELETE /compute/v2.1/servers/c3478cd4-e4ab-4a7d-9f4d-65323c450348 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 13 13:16:43.499015 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-76aaa36f-ce0d-4483-acf5-2642b028caf9 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Calling method '>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:16:43.499658 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-76aaa36f-ce0d-4483-acf5-2642b028caf9 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] [instance: c3478cd4-e4ab-4a7d-9f4d-65323c450348] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:16:43.506022 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-76aaa36f-ce0d-4483-acf5-2642b028caf9 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:16:43.506539 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-76aaa36f-ce0d-4483-acf5-2642b028caf9 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:16:43.506976 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-76aaa36f-ce0d-4483-acf5-2642b028caf9 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:16:43.507700 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-76aaa36f-ce0d-4483-acf5-2642b028caf9 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:16:43.508144 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-76aaa36f-ce0d-4483-acf5-2642b028caf9 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:16:43.508565 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-76aaa36f-ce0d-4483-acf5-2642b028caf9 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:16:43.521370 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.wsgi [None req-76aaa36f-ce0d-4483-acf5-2642b028caf9 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] HTTP exception thrown: Instance c3478cd4-e4ab-4a7d-9f4d-65323c450348 could not be found. Oct 13 13:16:43.522882 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-76aaa36f-ce0d-4483-acf5-2642b028caf9 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Request method failure captured: Oct 13 13:16:43.522882 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: request: GET /compute/v2.1/servers/c3478cd4-e4ab-4a7d-9f4d-65323c450348 HTTP/1.1 Oct 13 13:16:43.522882 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: Accept: application/json Oct 13 13:16:43.522882 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: Accept-Encoding: identity Oct 13 13:16:43.522882 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: Connection: close Oct 13 13:16:43.522882 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: Content-Length: 0 Oct 13 13:16:43.522882 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: Content-Type: application/json Oct 13 13:16:43.522882 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: Host: 10.222.0.23 Oct 13 13:16:43.522882 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: Openstack-System-Scope: None Oct 13 13:16:43.522882 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: User-Agent: python-urllib3/1.26.12 Oct 13 13:16:43.522882 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Auth-Token: gAAAAABjSA4tunBxxiLAsDcwzJnwD5icNArXVS2ALCK2Nvdw6H3lylo131jngSpW20VrB3U3uqD1tS775HGTmTQdbdvjmqKoRpB1Vocz90KRcx7_8rqcewdlzjgGcPlOm4Zdl2XeN-E8XYbc53rR87qrHwzD5wGkbh7UPN54dUXu2qfZrWBj3hg Oct 13 13:16:43.522882 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Domain-Id: None Oct 13 13:16:43.522882 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Domain-Name: None Oct 13 13:16:43.522882 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Identity-Status: Confirmed Oct 13 13:16:43.522882 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Is-Admin-Project: True Oct 13 13:16:43.522882 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Openstack-Nova-Api-Version: 2.20 Oct 13 13:16:43.522882 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Project-Domain-Id: default Oct 13 13:16:43.522882 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Project-Domain-Name: Default Oct 13 13:16:43.522882 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Project-Id: 4af4b9833fd14a1f881610bbc90bbd37 Oct 13 13:16:43.522882 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2099157911 Oct 13 13:16:43.522882 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Role: reader,member Oct 13 13:16:43.522882 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Roles: reader,member Oct 13 13:16:43.524523 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_4af4b9833fd14a1f881610bbc90bbd37"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/4af4b9833fd14a1f881610bbc90bbd37"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/4af4b9833fd14a1f881610bbc90bbd37"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/4af4b9833fd14a1f881610bbc90bbd37"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}] Oct 13 13:16:43.524523 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2099157911 Oct 13 13:16:43.524523 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Tenant-Id: 4af4b9833fd14a1f881610bbc90bbd37 Oct 13 13:16:43.524523 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2099157911 Oct 13 13:16:43.524523 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-User: tempest-AttachVolumeShelveTestJSON-2099157911-project Oct 13 13:16:43.524523 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-User-Domain-Id: default Oct 13 13:16:43.524523 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-User-Domain-Name: Default Oct 13 13:16:43.524523 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-User-Id: b5dbaf53464b44fe8d9e16f5013587b4 Oct 13 13:16:43.524523 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2099157911-project Oct 13 13:16:43.524523 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: method: > Oct 13 13:16:43.524523 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: exception: Instance c3478cd4-e4ab-4a7d-9f4d-65323c450348 could not be found. Oct 13 13:16:43.524523 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: action_args: {'id': 'c3478cd4-e4ab-4a7d-9f4d-65323c450348'} Oct 13 13:16:43.525309 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 13:16:43.525309 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 13:16:43.525309 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 13 13:16:43.525309 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 13 13:16:43.525309 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 13 13:16:43.525309 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 13 13:16:43.525309 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 13 13:16:43.525309 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 13 13:16:43.525309 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 13 13:16:43.525309 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 13 13:16:43.525309 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c3478cd4-e4ab-4a7d-9f4d-65323c450348 could not be found. Oct 13 13:16:43.525309 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi Oct 13 13:16:43.525309 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 13:16:43.525309 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi Oct 13 13:16:43.525309 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 13:16:43.525309 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 13:16:43.525309 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 13:16:43.525309 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 13:16:43.525309 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 13:16:43.525309 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 13:16:43.526490 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 13:16:43.526490 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 13 13:16:43.526490 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 13 13:16:43.526490 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 13 13:16:43.526490 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 13 13:16:43.526490 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 13 13:16:43.526490 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 13 13:16:43.526490 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c3478cd4-e4ab-4a7d-9f4d-65323c450348 could not be found. Oct 13 13:16:43.526490 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi Oct 13 13:16:43.526490 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 13:16:43.526490 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi Oct 13 13:16:43.526490 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 13:16:43.526490 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 13:16:43.526490 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 13:16:43.526490 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 13:16:43.526490 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 13:16:43.526490 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c3478cd4-e4ab-4a7d-9f4d-65323c450348 could not be found. Oct 13 13:16:43.526490 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi Oct 13 13:16:43.527899 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-76aaa36f-ce0d-4483-acf5-2642b028caf9 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Returning 404 to user: Instance c3478cd4-e4ab-4a7d-9f4d-65323c450348 could not be found. {{(pid=118815) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 13:16:43.527899 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-76aaa36f-ce0d-4483-acf5-2642b028caf9 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] 10.222.0.23 "GET /compute/v2.1/servers/c3478cd4-e4ab-4a7d-9f4d-65323c450348" status: 404 len: 111 microversion: 2.20 time: 0.030166 Oct 13 13:16:43.527899 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 407/831] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 13:16:43 2022] GET /compute/v2.1/servers/c3478cd4-e4ab-4a7d-9f4d-65323c450348 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 13 13:16:47.819262 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-377c4757-cf67-4f79-8b29-721a14523096 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Calling method '>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:16:47.819732 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-377c4757-cf67-4f79-8b29-721a14523096 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] [instance: 26bd475b-3495-4669-9985-d4a7dedb4bbf] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:16:47.827435 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-377c4757-cf67-4f79-8b29-721a14523096 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:16:47.827905 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-377c4757-cf67-4f79-8b29-721a14523096 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:16:47.828333 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-377c4757-cf67-4f79-8b29-721a14523096 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:16:47.829009 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-377c4757-cf67-4f79-8b29-721a14523096 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:16:47.829728 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-377c4757-cf67-4f79-8b29-721a14523096 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:16:47.830149 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-377c4757-cf67-4f79-8b29-721a14523096 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:16:47.843485 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.wsgi [None req-377c4757-cf67-4f79-8b29-721a14523096 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] HTTP exception thrown: Instance 26bd475b-3495-4669-9985-d4a7dedb4bbf could not be found. Oct 13 13:16:47.845020 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-377c4757-cf67-4f79-8b29-721a14523096 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Request method failure captured: Oct 13 13:16:47.845020 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: request: DELETE /compute/v2.1/servers/26bd475b-3495-4669-9985-d4a7dedb4bbf HTTP/1.1 Oct 13 13:16:47.845020 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: Accept: application/json Oct 13 13:16:47.845020 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: Accept-Encoding: identity Oct 13 13:16:47.845020 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: Connection: close Oct 13 13:16:47.845020 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: Content-Length: 0 Oct 13 13:16:47.845020 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: Content-Type: application/json Oct 13 13:16:47.845020 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: Host: 10.222.0.23 Oct 13 13:16:47.845020 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: Openstack-System-Scope: None Oct 13 13:16:47.845020 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: User-Agent: python-urllib3/1.26.12 Oct 13 13:16:47.845020 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Auth-Token: gAAAAABjSA4tunBxxiLAsDcwzJnwD5icNArXVS2ALCK2Nvdw6H3lylo131jngSpW20VrB3U3uqD1tS775HGTmTQdbdvjmqKoRpB1Vocz90KRcx7_8rqcewdlzjgGcPlOm4Zdl2XeN-E8XYbc53rR87qrHwzD5wGkbh7UPN54dUXu2qfZrWBj3hg Oct 13 13:16:47.845020 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Domain-Id: None Oct 13 13:16:47.845020 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Domain-Name: None Oct 13 13:16:47.845020 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Identity-Status: Confirmed Oct 13 13:16:47.845020 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Is-Admin-Project: True Oct 13 13:16:47.845020 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Openstack-Nova-Api-Version: 2.20 Oct 13 13:16:47.845020 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Project-Domain-Id: default Oct 13 13:16:47.845020 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Project-Domain-Name: Default Oct 13 13:16:47.845020 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Project-Id: 4af4b9833fd14a1f881610bbc90bbd37 Oct 13 13:16:47.845020 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2099157911 Oct 13 13:16:47.845020 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Role: reader,member Oct 13 13:16:47.845020 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Roles: reader,member Oct 13 13:16:47.846732 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_4af4b9833fd14a1f881610bbc90bbd37"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/4af4b9833fd14a1f881610bbc90bbd37"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/4af4b9833fd14a1f881610bbc90bbd37"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/4af4b9833fd14a1f881610bbc90bbd37"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}] Oct 13 13:16:47.846732 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2099157911 Oct 13 13:16:47.846732 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Tenant-Id: 4af4b9833fd14a1f881610bbc90bbd37 Oct 13 13:16:47.846732 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2099157911 Oct 13 13:16:47.846732 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-User: tempest-AttachVolumeShelveTestJSON-2099157911-project Oct 13 13:16:47.846732 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-User-Domain-Id: default Oct 13 13:16:47.846732 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-User-Domain-Name: Default Oct 13 13:16:47.846732 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-User-Id: b5dbaf53464b44fe8d9e16f5013587b4 Oct 13 13:16:47.846732 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2099157911-project Oct 13 13:16:47.846732 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: method: > Oct 13 13:16:47.846732 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: exception: Instance 26bd475b-3495-4669-9985-d4a7dedb4bbf could not be found. Oct 13 13:16:47.846732 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: action_args: {'id': '26bd475b-3495-4669-9985-d4a7dedb4bbf'} Oct 13 13:16:47.847773 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 13:16:47.847773 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 13:16:47.847773 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 13 13:16:47.847773 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 13 13:16:47.847773 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 13 13:16:47.847773 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 13 13:16:47.847773 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 13 13:16:47.847773 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 13 13:16:47.847773 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 13 13:16:47.847773 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 13 13:16:47.847773 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 26bd475b-3495-4669-9985-d4a7dedb4bbf could not be found. Oct 13 13:16:47.847773 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi Oct 13 13:16:47.847773 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 13:16:47.847773 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi Oct 13 13:16:47.847773 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 13:16:47.847773 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 13:16:47.847773 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 13:16:47.847773 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 13:16:47.847773 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 13:16:47.847773 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 13:16:47.849291 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 13:16:47.849291 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 13 13:16:47.849291 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 13 13:16:47.849291 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 13 13:16:47.849291 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 13 13:16:47.849291 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 13 13:16:47.849291 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 13 13:16:47.849291 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 13 13:16:47.849291 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 13 13:16:47.849291 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 26bd475b-3495-4669-9985-d4a7dedb4bbf could not be found. Oct 13 13:16:47.849291 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi Oct 13 13:16:47.849291 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 13:16:47.849291 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi Oct 13 13:16:47.849291 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 13:16:47.849291 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 13:16:47.849291 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 13:16:47.849291 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 13:16:47.849291 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 13:16:47.849291 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 26bd475b-3495-4669-9985-d4a7dedb4bbf could not be found. Oct 13 13:16:47.849291 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi Oct 13 13:16:47.851018 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-377c4757-cf67-4f79-8b29-721a14523096 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Returning 404 to user: Instance 26bd475b-3495-4669-9985-d4a7dedb4bbf could not be found. {{(pid=118814) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 13:16:47.851018 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-377c4757-cf67-4f79-8b29-721a14523096 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] 10.222.0.23 "DELETE /compute/v2.1/servers/26bd475b-3495-4669-9985-d4a7dedb4bbf" status: 404 len: 111 microversion: 2.20 time: 0.030996 Oct 13 13:16:47.851018 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 425/832] 10.222.0.23 () {60 vars in 1280 bytes} [Thu Oct 13 13:16:47 2022] DELETE /compute/v2.1/servers/26bd475b-3495-4669-9985-d4a7dedb4bbf => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 13 13:16:47.854707 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-db83983f-8123-4cb1-b425-748f45d13508 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Calling method '>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:16:47.855344 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-db83983f-8123-4cb1-b425-748f45d13508 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] [instance: 26bd475b-3495-4669-9985-d4a7dedb4bbf] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:16:47.861628 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-db83983f-8123-4cb1-b425-748f45d13508 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:16:47.862096 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-db83983f-8123-4cb1-b425-748f45d13508 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:16:47.862525 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-db83983f-8123-4cb1-b425-748f45d13508 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:16:47.863247 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-db83983f-8123-4cb1-b425-748f45d13508 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:16:47.863877 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-db83983f-8123-4cb1-b425-748f45d13508 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:16:47.864327 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-db83983f-8123-4cb1-b425-748f45d13508 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:16:47.878408 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.wsgi [None req-db83983f-8123-4cb1-b425-748f45d13508 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] HTTP exception thrown: Instance 26bd475b-3495-4669-9985-d4a7dedb4bbf could not be found. Oct 13 13:16:47.879942 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-db83983f-8123-4cb1-b425-748f45d13508 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Request method failure captured: Oct 13 13:16:47.879942 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: request: GET /compute/v2.1/servers/26bd475b-3495-4669-9985-d4a7dedb4bbf HTTP/1.1 Oct 13 13:16:47.879942 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: Accept: application/json Oct 13 13:16:47.879942 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: Accept-Encoding: identity Oct 13 13:16:47.879942 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: Connection: close Oct 13 13:16:47.879942 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: Content-Length: 0 Oct 13 13:16:47.879942 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: Content-Type: application/json Oct 13 13:16:47.879942 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: Host: 10.222.0.23 Oct 13 13:16:47.879942 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: Openstack-System-Scope: None Oct 13 13:16:47.879942 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: User-Agent: python-urllib3/1.26.12 Oct 13 13:16:47.879942 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Auth-Token: gAAAAABjSA4tunBxxiLAsDcwzJnwD5icNArXVS2ALCK2Nvdw6H3lylo131jngSpW20VrB3U3uqD1tS775HGTmTQdbdvjmqKoRpB1Vocz90KRcx7_8rqcewdlzjgGcPlOm4Zdl2XeN-E8XYbc53rR87qrHwzD5wGkbh7UPN54dUXu2qfZrWBj3hg Oct 13 13:16:47.879942 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Domain-Id: None Oct 13 13:16:47.879942 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Domain-Name: None Oct 13 13:16:47.879942 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Identity-Status: Confirmed Oct 13 13:16:47.879942 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Is-Admin-Project: True Oct 13 13:16:47.879942 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Openstack-Nova-Api-Version: 2.20 Oct 13 13:16:47.879942 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Project-Domain-Id: default Oct 13 13:16:47.879942 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Project-Domain-Name: Default Oct 13 13:16:47.879942 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Project-Id: 4af4b9833fd14a1f881610bbc90bbd37 Oct 13 13:16:47.879942 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2099157911 Oct 13 13:16:47.879942 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Role: reader,member Oct 13 13:16:47.879942 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Roles: reader,member Oct 13 13:16:47.881576 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_4af4b9833fd14a1f881610bbc90bbd37"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/4af4b9833fd14a1f881610bbc90bbd37"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/4af4b9833fd14a1f881610bbc90bbd37"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/4af4b9833fd14a1f881610bbc90bbd37"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}] Oct 13 13:16:47.881576 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2099157911 Oct 13 13:16:47.881576 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Tenant-Id: 4af4b9833fd14a1f881610bbc90bbd37 Oct 13 13:16:47.881576 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2099157911 Oct 13 13:16:47.881576 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-User: tempest-AttachVolumeShelveTestJSON-2099157911-project Oct 13 13:16:47.881576 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-User-Domain-Id: default Oct 13 13:16:47.881576 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-User-Domain-Name: Default Oct 13 13:16:47.881576 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-User-Id: b5dbaf53464b44fe8d9e16f5013587b4 Oct 13 13:16:47.881576 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2099157911-project Oct 13 13:16:47.881576 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: method: > Oct 13 13:16:47.881576 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: exception: Instance 26bd475b-3495-4669-9985-d4a7dedb4bbf could not be found. Oct 13 13:16:47.881576 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: action_args: {'id': '26bd475b-3495-4669-9985-d4a7dedb4bbf'} Oct 13 13:16:47.882603 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 13:16:47.882603 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 13:16:47.882603 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 13 13:16:47.882603 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 13 13:16:47.882603 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 13 13:16:47.882603 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 13 13:16:47.882603 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 13 13:16:47.882603 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 13 13:16:47.882603 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 13 13:16:47.882603 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 13 13:16:47.882603 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 26bd475b-3495-4669-9985-d4a7dedb4bbf could not be found. Oct 13 13:16:47.882603 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi Oct 13 13:16:47.882603 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 13:16:47.882603 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi Oct 13 13:16:47.882603 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 13:16:47.882603 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 13:16:47.882603 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 13:16:47.882603 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 13:16:47.882603 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 13:16:47.882603 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 13:16:47.883836 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 13:16:47.883836 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 13 13:16:47.883836 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 13 13:16:47.883836 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 13 13:16:47.883836 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 13 13:16:47.883836 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 13 13:16:47.883836 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 13 13:16:47.883836 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 26bd475b-3495-4669-9985-d4a7dedb4bbf could not be found. Oct 13 13:16:47.883836 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi Oct 13 13:16:47.883836 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 13:16:47.883836 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi Oct 13 13:16:47.883836 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 13:16:47.883836 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 13:16:47.883836 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 13:16:47.883836 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 13:16:47.883836 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 13:16:47.883836 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 26bd475b-3495-4669-9985-d4a7dedb4bbf could not be found. Oct 13 13:16:47.883836 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi Oct 13 13:16:47.885066 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-db83983f-8123-4cb1-b425-748f45d13508 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] Returning 404 to user: Instance 26bd475b-3495-4669-9985-d4a7dedb4bbf could not be found. {{(pid=118815) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 13:16:47.885066 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-db83983f-8123-4cb1-b425-748f45d13508 tempest-AttachVolumeShelveTestJSON-2099157911 tempest-AttachVolumeShelveTestJSON-2099157911-project] 10.222.0.23 "GET /compute/v2.1/servers/26bd475b-3495-4669-9985-d4a7dedb4bbf" status: 404 len: 111 microversion: 2.20 time: 0.030527 Oct 13 13:16:47.885066 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 408/833] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 13:16:47 2022] GET /compute/v2.1/servers/26bd475b-3495-4669-9985-d4a7dedb4bbf => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Oct 13 13:16:57.150346 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-6d88f3fd-8303-47bf-bd62-142d680b584b tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Action: 'create', calling method: .version_select at 0x7f5093c09820>, body: {"keypair": {"name": "tempest-keypair-1136022806", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKdBS9Gd+3Lax+Z80rJmDB6hBvOQZB/Eyx9XDFUwVUeblrhOtXepjdp6JL0PiS7cjDXkcUpPvKhakruhOFDNvPb+gXZbYGv2GLOTWQTB+MpjJp0QQLprB3cOf2lmkfq/Qw=="}} {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 13:16:57.171691 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.quota [None req-6d88f3fd-8303-47bf-bd62-142d680b584b tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Getting quotas for project da546353194342439f9bc3f98f6737e0. Resources: {'key_pairs'} {{(pid=118814) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 13 13:16:57.176633 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.quota [None req-6d88f3fd-8303-47bf-bd62-142d680b584b tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Getting quotas for user 2cd12070eb954d6880f925957184a288 and project da546353194342439f9bc3f98f6737e0. Resources: {'key_pairs'} {{(pid=118814) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 13 13:16:57.210674 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-6d88f3fd-8303-47bf-bd62-142d680b584b tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.362201 Oct 13 13:16:57.211309 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 426/834] 10.222.0.23 () {60 vars in 1159 bytes} [Thu Oct 13 13:16:56 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 13:16:58.686048 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-0f16f0ea-3db8-4502-99f6-4a42310b930b tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-207703104", "imageRef": "e2cdd20b-2540-48bc-a05c-d6a2e7e9a66e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "60c7ab31-db51-4574-8d4e-94d8596d64ad"}], "security_groups": [{"name": "tempest-securitygroup--1363578431"}], "key_name": "tempest-keypair-1136022806", "user_data": "}} {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 13:16:58.695246 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG dbcounter [-] [118815] Writing DB stats nova_api:SELECT=15,nova_api:DELETE=1 {{(pid=118815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:16:58.695946 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG dbcounter [-] [118815] Writing DB stats nova_cell1:SELECT=28 {{(pid=118815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:16:58.818926 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.network.neutron [None req-0f16f0ea-3db8-4502-99f6-4a42310b930b tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] validate_networks() for [('60c7ab31-db51-4574-8d4e-94d8596d64ad', None, None, None, None, None)] {{(pid=118815) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 13 13:16:59.341678 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.virt.hardware [None req-0f16f0ea-3db8-4502-99f6-4a42310b930b tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Flavor limits 0:0:0 {{(pid=118815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 13 13:16:59.342046 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.virt.hardware [None req-0f16f0ea-3db8-4502-99f6-4a42310b930b tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Image limits 0:0:0 {{(pid=118815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 13 13:16:59.342516 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.virt.hardware [None req-0f16f0ea-3db8-4502-99f6-4a42310b930b tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Flavor pref 0:0:0 {{(pid=118815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 13 13:16:59.342927 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.virt.hardware [None req-0f16f0ea-3db8-4502-99f6-4a42310b930b tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Image pref 0:0:0 {{(pid=118815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 13 13:16:59.343382 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.virt.hardware [None req-0f16f0ea-3db8-4502-99f6-4a42310b930b tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 13 13:16:59.352025 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-0f16f0ea-3db8-4502-99f6-4a42310b930b tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:16:59.352506 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-0f16f0ea-3db8-4502-99f6-4a42310b930b tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:16:59.352939 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-0f16f0ea-3db8-4502-99f6-4a42310b930b tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:16:59.353668 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-0f16f0ea-3db8-4502-99f6-4a42310b930b tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:16:59.354125 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-0f16f0ea-3db8-4502-99f6-4a42310b930b tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:16:59.354546 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-0f16f0ea-3db8-4502-99f6-4a42310b930b tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:16:59.370914 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.quota [None req-0f16f0ea-3db8-4502-99f6-4a42310b930b tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Getting quotas for project da546353194342439f9bc3f98f6737e0. Resources: {'instances', 'cores', 'ram'} {{(pid=118815) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 13 13:16:59.374926 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.quota [None req-0f16f0ea-3db8-4502-99f6-4a42310b930b tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Getting quotas for user 2cd12070eb954d6880f925957184a288 and project da546353194342439f9bc3f98f6737e0. Resources: {'instances', 'cores', 'ram'} {{(pid=118815) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 13 13:16:59.385859 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-0f16f0ea-3db8-4502-99f6-4a42310b930b tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Going to run 1 instances... {{(pid=118815) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 13 13:16:59.388697 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-0f16f0ea-3db8-4502-99f6-4a42310b930b tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] [instance: 8a4e6f19-21f2-4ff8-af3d-bf93ec2488aa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e2cdd20b-2540-48bc-a05c-d6a2e7e9a66e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118815) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 13 13:16:59.438065 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-0f16f0ea-3db8-4502-99f6-4a42310b930b tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.756944 Oct 13 13:16:59.438948 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 409/835] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Oct 13 13:16:58 2022] POST /compute/v2.1/servers => generated 402 bytes in 758 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 13 13:16:59.446795 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG dbcounter [-] [118814] Writing DB stats nova_cell1:SELECT=34,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118814) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:16:59.452135 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-b1e4fa27-9c1b-4b93-b4b8-f1c046b16e70 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Calling method '>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:16:59.452607 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-b1e4fa27-9c1b-4b93-b4b8-f1c046b16e70 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] [instance: 8a4e6f19-21f2-4ff8-af3d-bf93ec2488aa] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:16:59.517105 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-b1e4fa27-9c1b-4b93-b4b8-f1c046b16e70 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd12070eb954d6880f925957184a288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da546353194342439f9bc3f98f6737e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:16:59.524908 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-b1e4fa27-9c1b-4b93-b4b8-f1c046b16e70 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] 10.222.0.23 "GET /compute/v2.1/servers/8a4e6f19-21f2-4ff8-af3d-bf93ec2488aa" status: 200 len: 1241 microversion: 2.1 time: 0.078954 Oct 13 13:16:59.525649 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 427/836] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:16:59 2022] GET /compute/v2.1/servers/8a4e6f19-21f2-4ff8-af3d-bf93ec2488aa => generated 1241 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:17:00.548754 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-3b2bb6de-0b26-48cf-a43c-87dd9fe02464 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Calling method '>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:17:00.550689 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-3b2bb6de-0b26-48cf-a43c-87dd9fe02464 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] [instance: 8a4e6f19-21f2-4ff8-af3d-bf93ec2488aa] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:17:00.558299 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-3b2bb6de-0b26-48cf-a43c-87dd9fe02464 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:17:00.558834 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-3b2bb6de-0b26-48cf-a43c-87dd9fe02464 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:17:00.559292 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-3b2bb6de-0b26-48cf-a43c-87dd9fe02464 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:17:00.559989 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-3b2bb6de-0b26-48cf-a43c-87dd9fe02464 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:17:00.560441 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-3b2bb6de-0b26-48cf-a43c-87dd9fe02464 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:17:00.560893 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-3b2bb6de-0b26-48cf-a43c-87dd9fe02464 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:17:00.624609 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-3b2bb6de-0b26-48cf-a43c-87dd9fe02464 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd12070eb954d6880f925957184a288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da546353194342439f9bc3f98f6737e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:17:00.632409 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-3b2bb6de-0b26-48cf-a43c-87dd9fe02464 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] 10.222.0.23 "GET /compute/v2.1/servers/8a4e6f19-21f2-4ff8-af3d-bf93ec2488aa" status: 200 len: 1293 microversion: 2.1 time: 0.088127 Oct 13 13:17:00.632975 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 410/837] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:17:00 2022] GET /compute/v2.1/servers/8a4e6f19-21f2-4ff8-af3d-bf93ec2488aa => generated 1293 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:17:01.656351 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-a6f40f7e-09dd-49b9-94d1-2d05239200b0 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Calling method '>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:17:01.657093 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-a6f40f7e-09dd-49b9-94d1-2d05239200b0 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] [instance: 8a4e6f19-21f2-4ff8-af3d-bf93ec2488aa] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:17:01.663626 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-a6f40f7e-09dd-49b9-94d1-2d05239200b0 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:17:01.664118 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-a6f40f7e-09dd-49b9-94d1-2d05239200b0 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:17:01.664565 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-a6f40f7e-09dd-49b9-94d1-2d05239200b0 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:17:01.665266 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-a6f40f7e-09dd-49b9-94d1-2d05239200b0 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:17:01.665725 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-a6f40f7e-09dd-49b9-94d1-2d05239200b0 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:17:01.666184 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-a6f40f7e-09dd-49b9-94d1-2d05239200b0 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:17:01.812402 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-a6f40f7e-09dd-49b9-94d1-2d05239200b0 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd12070eb954d6880f925957184a288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da546353194342439f9bc3f98f6737e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:17:01.820655 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-a6f40f7e-09dd-49b9-94d1-2d05239200b0 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] 10.222.0.23 "GET /compute/v2.1/servers/8a4e6f19-21f2-4ff8-af3d-bf93ec2488aa" status: 200 len: 1367 microversion: 2.1 time: 0.169002 Oct 13 13:17:01.821239 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 428/838] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:17:01 2022] GET /compute/v2.1/servers/8a4e6f19-21f2-4ff8-af3d-bf93ec2488aa => generated 1367 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:17:02.663630 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [req-a818549b-8f80-4b70-b530-f235a4d9c370 req-40e3714e-185b-4156-817d-809323082e5c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8a4e6f19-21f2-4ff8-af3d-bf93ec2488aa", "tag": "f712db69-8915-4f5c-b72c-2bbcb66d33ab"}]} {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 13:17:02.683589 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [req-a818549b-8f80-4b70-b530-f235a4d9c370 req-40e3714e-185b-4156-817d-809323082e5c service nova] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:17:02.684439 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [req-a818549b-8f80-4b70-b530-f235a4d9c370 req-40e3714e-185b-4156-817d-809323082e5c service nova] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:17:02.685168 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [req-a818549b-8f80-4b70-b530-f235a4d9c370 req-40e3714e-185b-4156-817d-809323082e5c service nova] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:17:02.704801 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.compute.server_external_events [req-a818549b-8f80-4b70-b530-f235a4d9c370 req-40e3714e-185b-4156-817d-809323082e5c service nova] Creating event network-changed:f712db69-8915-4f5c-b72c-2bbcb66d33ab for instance 8a4e6f19-21f2-4ff8-af3d-bf93ec2488aa on hv-cinder-82660 Oct 13 13:17:02.711440 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [req-a818549b-8f80-4b70-b530-f235a4d9c370 req-40e3714e-185b-4156-817d-809323082e5c service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054169 Oct 13 13:17:02.712190 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 411/839] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 13:17:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 13:17:02.846353 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-19b419a2-efe8-4116-9214-0ed6e96fddc1 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Calling method '>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:17:02.847386 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-19b419a2-efe8-4116-9214-0ed6e96fddc1 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] [instance: 8a4e6f19-21f2-4ff8-af3d-bf93ec2488aa] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:17:02.858249 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-19b419a2-efe8-4116-9214-0ed6e96fddc1 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:17:02.859622 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-19b419a2-efe8-4116-9214-0ed6e96fddc1 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:17:02.861284 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-19b419a2-efe8-4116-9214-0ed6e96fddc1 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:17:02.862004 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-19b419a2-efe8-4116-9214-0ed6e96fddc1 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:17:02.863010 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-19b419a2-efe8-4116-9214-0ed6e96fddc1 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:17:02.864848 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-19b419a2-efe8-4116-9214-0ed6e96fddc1 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:17:03.059297 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-19b419a2-efe8-4116-9214-0ed6e96fddc1 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd12070eb954d6880f925957184a288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da546353194342439f9bc3f98f6737e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:17:03.070812 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-19b419a2-efe8-4116-9214-0ed6e96fddc1 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] 10.222.0.23 "GET /compute/v2.1/servers/8a4e6f19-21f2-4ff8-af3d-bf93ec2488aa" status: 200 len: 1367 microversion: 2.1 time: 0.229005 Oct 13 13:17:03.071915 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 429/840] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:17:02 2022] GET /compute/v2.1/servers/8a4e6f19-21f2-4ff8-af3d-bf93ec2488aa => generated 1367 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:17:04.094597 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-dbcc324e-3325-45ec-8c93-b43e103fb202 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Calling method '>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:17:04.095341 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-dbcc324e-3325-45ec-8c93-b43e103fb202 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] [instance: 8a4e6f19-21f2-4ff8-af3d-bf93ec2488aa] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:17:04.101419 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-dbcc324e-3325-45ec-8c93-b43e103fb202 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:17:04.101910 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-dbcc324e-3325-45ec-8c93-b43e103fb202 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:17:04.102351 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-dbcc324e-3325-45ec-8c93-b43e103fb202 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:17:04.103043 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-dbcc324e-3325-45ec-8c93-b43e103fb202 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:17:04.103721 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-dbcc324e-3325-45ec-8c93-b43e103fb202 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:17:04.104153 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-dbcc324e-3325-45ec-8c93-b43e103fb202 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:17:04.247850 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-dbcc324e-3325-45ec-8c93-b43e103fb202 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd12070eb954d6880f925957184a288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da546353194342439f9bc3f98f6737e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:17:04.255567 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-dbcc324e-3325-45ec-8c93-b43e103fb202 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] 10.222.0.23 "GET /compute/v2.1/servers/8a4e6f19-21f2-4ff8-af3d-bf93ec2488aa" status: 200 len: 1367 microversion: 2.1 time: 0.165603 Oct 13 13:17:04.256127 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 412/841] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:17:04 2022] GET /compute/v2.1/servers/8a4e6f19-21f2-4ff8-af3d-bf93ec2488aa => generated 1367 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:17:05.277692 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-03f4db9f-f6bf-4fce-af85-a9abc083ba91 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Calling method '>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:17:05.278409 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-03f4db9f-f6bf-4fce-af85-a9abc083ba91 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] [instance: 8a4e6f19-21f2-4ff8-af3d-bf93ec2488aa] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:17:05.284712 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-03f4db9f-f6bf-4fce-af85-a9abc083ba91 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:17:05.285182 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-03f4db9f-f6bf-4fce-af85-a9abc083ba91 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:17:05.285713 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-03f4db9f-f6bf-4fce-af85-a9abc083ba91 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:17:05.286477 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-03f4db9f-f6bf-4fce-af85-a9abc083ba91 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:17:05.286931 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-03f4db9f-f6bf-4fce-af85-a9abc083ba91 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:17:05.287386 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-03f4db9f-f6bf-4fce-af85-a9abc083ba91 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:17:05.427041 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-03f4db9f-f6bf-4fce-af85-a9abc083ba91 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd12070eb954d6880f925957184a288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da546353194342439f9bc3f98f6737e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:17:05.434852 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-03f4db9f-f6bf-4fce-af85-a9abc083ba91 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] 10.222.0.23 "GET /compute/v2.1/servers/8a4e6f19-21f2-4ff8-af3d-bf93ec2488aa" status: 200 len: 1367 microversion: 2.1 time: 0.160968 Oct 13 13:17:05.435477 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 430/842] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:17:05 2022] GET /compute/v2.1/servers/8a4e6f19-21f2-4ff8-af3d-bf93ec2488aa => generated 1367 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:17:06.457848 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-29851195-4855-4c04-aee3-e290fba8a9dc tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Calling method '>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:17:06.458544 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-29851195-4855-4c04-aee3-e290fba8a9dc tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] [instance: 8a4e6f19-21f2-4ff8-af3d-bf93ec2488aa] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:17:06.465021 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-29851195-4855-4c04-aee3-e290fba8a9dc tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:17:06.465578 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-29851195-4855-4c04-aee3-e290fba8a9dc tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:17:06.466023 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-29851195-4855-4c04-aee3-e290fba8a9dc tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:17:06.466714 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-29851195-4855-4c04-aee3-e290fba8a9dc tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:17:06.467199 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-29851195-4855-4c04-aee3-e290fba8a9dc tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:17:06.467627 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-29851195-4855-4c04-aee3-e290fba8a9dc tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:17:06.602009 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-29851195-4855-4c04-aee3-e290fba8a9dc tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd12070eb954d6880f925957184a288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da546353194342439f9bc3f98f6737e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:17:06.609953 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-29851195-4855-4c04-aee3-e290fba8a9dc tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] 10.222.0.23 "GET /compute/v2.1/servers/8a4e6f19-21f2-4ff8-af3d-bf93ec2488aa" status: 200 len: 1367 microversion: 2.1 time: 0.156115 Oct 13 13:17:06.610503 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 413/843] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:17:06 2022] GET /compute/v2.1/servers/8a4e6f19-21f2-4ff8-af3d-bf93ec2488aa => generated 1367 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:17:07.633897 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-afdf866e-270c-4afd-b48f-ceb0422d2777 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Calling method '>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:17:07.634525 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-afdf866e-270c-4afd-b48f-ceb0422d2777 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] [instance: 8a4e6f19-21f2-4ff8-af3d-bf93ec2488aa] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:17:07.637230 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG dbcounter [-] [118814] Writing DB stats nova_api:SELECT=41,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=118814) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:17:07.643382 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-afdf866e-270c-4afd-b48f-ceb0422d2777 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:17:07.643896 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-afdf866e-270c-4afd-b48f-ceb0422d2777 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:17:07.644292 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-afdf866e-270c-4afd-b48f-ceb0422d2777 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:17:07.645205 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-afdf866e-270c-4afd-b48f-ceb0422d2777 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:17:07.645692 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-afdf866e-270c-4afd-b48f-ceb0422d2777 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:17:07.646115 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-afdf866e-270c-4afd-b48f-ceb0422d2777 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:17:07.792201 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-afdf866e-270c-4afd-b48f-ceb0422d2777 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd12070eb954d6880f925957184a288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da546353194342439f9bc3f98f6737e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:17:07.800155 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-afdf866e-270c-4afd-b48f-ceb0422d2777 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] 10.222.0.23 "GET /compute/v2.1/servers/8a4e6f19-21f2-4ff8-af3d-bf93ec2488aa" status: 200 len: 1367 microversion: 2.1 time: 0.170771 Oct 13 13:17:07.800712 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 431/844] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:17:07 2022] GET /compute/v2.1/servers/8a4e6f19-21f2-4ff8-af3d-bf93ec2488aa => generated 1367 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:17:08.821821 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-f8b54db6-7b10-40a3-942c-4d5e70bc10fa tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Calling method '>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:17:08.822431 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-f8b54db6-7b10-40a3-942c-4d5e70bc10fa tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] [instance: 8a4e6f19-21f2-4ff8-af3d-bf93ec2488aa] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:17:08.828939 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-f8b54db6-7b10-40a3-942c-4d5e70bc10fa tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:17:08.829428 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-f8b54db6-7b10-40a3-942c-4d5e70bc10fa tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:17:08.829865 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-f8b54db6-7b10-40a3-942c-4d5e70bc10fa tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:17:08.830546 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-f8b54db6-7b10-40a3-942c-4d5e70bc10fa tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:17:08.830998 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-f8b54db6-7b10-40a3-942c-4d5e70bc10fa tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:17:08.831455 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-f8b54db6-7b10-40a3-942c-4d5e70bc10fa tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:17:08.963798 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-f8b54db6-7b10-40a3-942c-4d5e70bc10fa tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd12070eb954d6880f925957184a288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da546353194342439f9bc3f98f6737e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:17:08.972172 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-f8b54db6-7b10-40a3-942c-4d5e70bc10fa tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] 10.222.0.23 "GET /compute/v2.1/servers/8a4e6f19-21f2-4ff8-af3d-bf93ec2488aa" status: 200 len: 1367 microversion: 2.1 time: 0.154213 Oct 13 13:17:08.972731 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 414/845] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:17:08 2022] GET /compute/v2.1/servers/8a4e6f19-21f2-4ff8-af3d-bf93ec2488aa => generated 1367 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:17:09.172954 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [req-f54b8342-5df0-4b37-a2d5-511791c7d2fb req-5921b4f8-4d5a-4173-a822-6ca6f7248783 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8a4e6f19-21f2-4ff8-af3d-bf93ec2488aa", "name": "network-vif-plugged", "status": "completed", "tag": "f712db69-8915-4f5c-b72c-2bbcb66d33ab"}]} {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 13:17:09.183650 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [req-f54b8342-5df0-4b37-a2d5-511791c7d2fb req-5921b4f8-4d5a-4173-a822-6ca6f7248783 service nova] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:17:09.184137 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [req-f54b8342-5df0-4b37-a2d5-511791c7d2fb req-5921b4f8-4d5a-4173-a822-6ca6f7248783 service nova] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:17:09.184573 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [req-f54b8342-5df0-4b37-a2d5-511791c7d2fb req-5921b4f8-4d5a-4173-a822-6ca6f7248783 service nova] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:17:09.197653 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.compute.server_external_events [req-f54b8342-5df0-4b37-a2d5-511791c7d2fb req-5921b4f8-4d5a-4173-a822-6ca6f7248783 service nova] Creating event network-vif-plugged:f712db69-8915-4f5c-b72c-2bbcb66d33ab for instance 8a4e6f19-21f2-4ff8-af3d-bf93ec2488aa on hv-cinder-82660 Oct 13 13:17:09.203240 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [req-f54b8342-5df0-4b37-a2d5-511791c7d2fb req-5921b4f8-4d5a-4173-a822-6ca6f7248783 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034088 Oct 13 13:17:09.204060 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 432/846] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 13:17:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 13:17:09.997392 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-0e3dcc35-081d-499b-95cb-d0b27c1d8de1 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Calling method '>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:17:09.998123 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-0e3dcc35-081d-499b-95cb-d0b27c1d8de1 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] [instance: 8a4e6f19-21f2-4ff8-af3d-bf93ec2488aa] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:17:10.008205 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG dbcounter [-] [118815] Writing DB stats nova_cell0:SELECT=2 {{(pid=118815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:17:10.010653 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG dbcounter [-] [118815] Writing DB stats nova_cell0:SELECT=6 {{(pid=118815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:17:10.012762 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-0e3dcc35-081d-499b-95cb-d0b27c1d8de1 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:17:10.013305 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-0e3dcc35-081d-499b-95cb-d0b27c1d8de1 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:17:10.013749 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-0e3dcc35-081d-499b-95cb-d0b27c1d8de1 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:17:10.014572 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-0e3dcc35-081d-499b-95cb-d0b27c1d8de1 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:17:10.016824 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-0e3dcc35-081d-499b-95cb-d0b27c1d8de1 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:17:10.017648 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-0e3dcc35-081d-499b-95cb-d0b27c1d8de1 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:17:10.173447 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-0e3dcc35-081d-499b-95cb-d0b27c1d8de1 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd12070eb954d6880f925957184a288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da546353194342439f9bc3f98f6737e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:17:10.181380 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-0e3dcc35-081d-499b-95cb-d0b27c1d8de1 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] 10.222.0.23 "GET /compute/v2.1/servers/8a4e6f19-21f2-4ff8-af3d-bf93ec2488aa" status: 200 len: 1367 microversion: 2.1 time: 0.189570 Oct 13 13:17:10.182411 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 415/847] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:17:09 2022] GET /compute/v2.1/servers/8a4e6f19-21f2-4ff8-af3d-bf93ec2488aa => generated 1367 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:17:11.204220 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG dbcounter [-] [118814] Writing DB stats nova_cell0:SELECT=6 {{(pid=118814) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:17:11.209033 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-c8ebab1c-e15e-47f6-a3e8-7c4d4c94f6bb tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Calling method '>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:17:11.209729 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-c8ebab1c-e15e-47f6-a3e8-7c4d4c94f6bb tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] [instance: 8a4e6f19-21f2-4ff8-af3d-bf93ec2488aa] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:17:11.217297 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-c8ebab1c-e15e-47f6-a3e8-7c4d4c94f6bb tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:17:11.217778 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-c8ebab1c-e15e-47f6-a3e8-7c4d4c94f6bb tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:17:11.218213 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-c8ebab1c-e15e-47f6-a3e8-7c4d4c94f6bb tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:17:11.218891 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-c8ebab1c-e15e-47f6-a3e8-7c4d4c94f6bb tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:17:11.219366 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-c8ebab1c-e15e-47f6-a3e8-7c4d4c94f6bb tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:17:11.219788 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-c8ebab1c-e15e-47f6-a3e8-7c4d4c94f6bb tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:17:11.354170 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-c8ebab1c-e15e-47f6-a3e8-7c4d4c94f6bb tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd12070eb954d6880f925957184a288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da546353194342439f9bc3f98f6737e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:17:11.362228 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-c8ebab1c-e15e-47f6-a3e8-7c4d4c94f6bb tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] 10.222.0.23 "GET /compute/v2.1/servers/8a4e6f19-21f2-4ff8-af3d-bf93ec2488aa" status: 200 len: 1367 microversion: 2.1 time: 0.158952 Oct 13 13:17:11.362806 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 433/848] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:17:11 2022] GET /compute/v2.1/servers/8a4e6f19-21f2-4ff8-af3d-bf93ec2488aa => generated 1367 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:17:12.385087 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-263d0c66-bb5d-456e-8e91-2ef592bf5030 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Calling method '>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:17:12.385686 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-263d0c66-bb5d-456e-8e91-2ef592bf5030 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] [instance: 8a4e6f19-21f2-4ff8-af3d-bf93ec2488aa] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:17:12.392683 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-263d0c66-bb5d-456e-8e91-2ef592bf5030 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:17:12.393162 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-263d0c66-bb5d-456e-8e91-2ef592bf5030 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:17:12.393593 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-263d0c66-bb5d-456e-8e91-2ef592bf5030 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:17:12.394276 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-263d0c66-bb5d-456e-8e91-2ef592bf5030 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:17:12.394731 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-263d0c66-bb5d-456e-8e91-2ef592bf5030 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:17:12.395185 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-263d0c66-bb5d-456e-8e91-2ef592bf5030 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:17:12.523958 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-263d0c66-bb5d-456e-8e91-2ef592bf5030 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd12070eb954d6880f925957184a288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da546353194342439f9bc3f98f6737e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:17:12.531640 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-263d0c66-bb5d-456e-8e91-2ef592bf5030 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] 10.222.0.23 "GET /compute/v2.1/servers/8a4e6f19-21f2-4ff8-af3d-bf93ec2488aa" status: 200 len: 1367 microversion: 2.1 time: 0.150402 Oct 13 13:17:12.532207 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 416/849] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:17:12 2022] GET /compute/v2.1/servers/8a4e6f19-21f2-4ff8-af3d-bf93ec2488aa => generated 1367 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:17:13.556320 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-a3f2cfeb-7329-4286-8fd2-61d82336b221 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Calling method '>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:17:13.556991 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-a3f2cfeb-7329-4286-8fd2-61d82336b221 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] [instance: 8a4e6f19-21f2-4ff8-af3d-bf93ec2488aa] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:17:13.563435 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-a3f2cfeb-7329-4286-8fd2-61d82336b221 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:17:13.563917 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-a3f2cfeb-7329-4286-8fd2-61d82336b221 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:17:13.564350 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-a3f2cfeb-7329-4286-8fd2-61d82336b221 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:17:13.565031 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-a3f2cfeb-7329-4286-8fd2-61d82336b221 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:17:13.565476 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-a3f2cfeb-7329-4286-8fd2-61d82336b221 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:17:13.565985 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-a3f2cfeb-7329-4286-8fd2-61d82336b221 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:17:13.698489 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-a3f2cfeb-7329-4286-8fd2-61d82336b221 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd12070eb954d6880f925957184a288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da546353194342439f9bc3f98f6737e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:17:13.707888 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-a3f2cfeb-7329-4286-8fd2-61d82336b221 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] 10.222.0.23 "GET /compute/v2.1/servers/8a4e6f19-21f2-4ff8-af3d-bf93ec2488aa" status: 200 len: 1367 microversion: 2.1 time: 0.155363 Oct 13 13:17:13.708456 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 434/850] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:17:13 2022] GET /compute/v2.1/servers/8a4e6f19-21f2-4ff8-af3d-bf93ec2488aa => generated 1367 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:17:14.730665 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-a565214f-4028-4ad2-9c56-fb55339bf4be tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Calling method '>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:17:14.731407 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-a565214f-4028-4ad2-9c56-fb55339bf4be tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] [instance: 8a4e6f19-21f2-4ff8-af3d-bf93ec2488aa] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:17:14.738364 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-a565214f-4028-4ad2-9c56-fb55339bf4be tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:17:14.738855 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-a565214f-4028-4ad2-9c56-fb55339bf4be tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:17:14.739339 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-a565214f-4028-4ad2-9c56-fb55339bf4be tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:17:14.740029 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-a565214f-4028-4ad2-9c56-fb55339bf4be tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:17:14.740481 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-a565214f-4028-4ad2-9c56-fb55339bf4be tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:17:14.740906 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-a565214f-4028-4ad2-9c56-fb55339bf4be tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:17:14.875912 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-a565214f-4028-4ad2-9c56-fb55339bf4be tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd12070eb954d6880f925957184a288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da546353194342439f9bc3f98f6737e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:17:14.883869 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-a565214f-4028-4ad2-9c56-fb55339bf4be tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] 10.222.0.23 "GET /compute/v2.1/servers/8a4e6f19-21f2-4ff8-af3d-bf93ec2488aa" status: 200 len: 1558 microversion: 2.1 time: 0.156950 Oct 13 13:17:14.884555 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 417/851] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:17:14 2022] GET /compute/v2.1/servers/8a4e6f19-21f2-4ff8-af3d-bf93ec2488aa => generated 1558 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:17:14.907465 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-b49f9f30-fc16-42c0-a0f5-e59a322ea636 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Calling method '>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:17:14.908117 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-b49f9f30-fc16-42c0-a0f5-e59a322ea636 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] [instance: 8a4e6f19-21f2-4ff8-af3d-bf93ec2488aa] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:17:14.914905 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-b49f9f30-fc16-42c0-a0f5-e59a322ea636 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:17:14.915434 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-b49f9f30-fc16-42c0-a0f5-e59a322ea636 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:17:14.915875 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-b49f9f30-fc16-42c0-a0f5-e59a322ea636 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:17:14.916574 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-b49f9f30-fc16-42c0-a0f5-e59a322ea636 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:17:14.917034 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-b49f9f30-fc16-42c0-a0f5-e59a322ea636 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:17:14.917458 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-b49f9f30-fc16-42c0-a0f5-e59a322ea636 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:17:15.003030 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-b49f9f30-fc16-42c0-a0f5-e59a322ea636 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] 10.222.0.23 "GET /compute/v2.1/servers/8a4e6f19-21f2-4ff8-af3d-bf93ec2488aa/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.099548 Oct 13 13:17:15.003672 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 435/852] 10.222.0.23 () {58 vars in 1275 bytes} [Thu Oct 13 13:17:14 2022] GET /compute/v2.1/servers/8a4e6f19-21f2-4ff8-af3d-bf93ec2488aa/os-interface => generated 285 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 13:17:15.965290 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [req-094b3537-d44c-469a-87d2-4843e20794b0 req-90d6ed38-109b-4f35-a755-f988dc040edd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8a4e6f19-21f2-4ff8-af3d-bf93ec2488aa", "tag": "f712db69-8915-4f5c-b72c-2bbcb66d33ab"}]} {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 13:17:15.975818 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [req-094b3537-d44c-469a-87d2-4843e20794b0 req-90d6ed38-109b-4f35-a755-f988dc040edd service nova] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:17:15.976146 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [req-094b3537-d44c-469a-87d2-4843e20794b0 req-90d6ed38-109b-4f35-a755-f988dc040edd service nova] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:17:15.976578 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [req-094b3537-d44c-469a-87d2-4843e20794b0 req-90d6ed38-109b-4f35-a755-f988dc040edd service nova] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:17:15.987909 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.compute.server_external_events [req-094b3537-d44c-469a-87d2-4843e20794b0 req-90d6ed38-109b-4f35-a755-f988dc040edd service nova] Creating event network-changed:f712db69-8915-4f5c-b72c-2bbcb66d33ab for instance 8a4e6f19-21f2-4ff8-af3d-bf93ec2488aa on hv-cinder-82660 Oct 13 13:17:15.992984 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [req-094b3537-d44c-469a-87d2-4843e20794b0 req-90d6ed38-109b-4f35-a755-f988dc040edd service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031256 Oct 13 13:17:15.995677 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 418/853] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 13:17:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 13:17:32.922507 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG dbcounter [-] [118814] Writing DB stats nova_api:SELECT=9 {{(pid=118814) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:17:32.923777 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG dbcounter [-] [118814] Writing DB stats nova_cell1:SELECT=42 {{(pid=118814) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:17:32.928362 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-dc137383-1272-4687-a3fe-0eee7c603238 tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 13:17:32.929104 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-dc137383-1272-4687-a3fe-0eee7c603238 tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] [instance: 5c481e0e-37eb-4457-813e-eb8a84932582] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:17:32.936067 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-dc137383-1272-4687-a3fe-0eee7c603238 tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:17:32.936632 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-dc137383-1272-4687-a3fe-0eee7c603238 tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:17:32.937068 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-dc137383-1272-4687-a3fe-0eee7c603238 tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:17:32.937785 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-dc137383-1272-4687-a3fe-0eee7c603238 tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:17:32.938287 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-dc137383-1272-4687-a3fe-0eee7c603238 tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:17:32.938757 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-dc137383-1272-4687-a3fe-0eee7c603238 tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:17:32.962085 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.objects.instance [None req-dc137383-1272-4687-a3fe-0eee7c603238 tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Lazy-loading 'flavor' on Instance uuid 5c481e0e-37eb-4457-813e-eb8a84932582 {{(pid=118814) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 13 13:17:33.034720 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-dc137383-1272-4687-a3fe-0eee7c603238 tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] 10.222.0.23 "POST /compute/v2.1/servers/5c481e0e-37eb-4457-813e-eb8a84932582/action" status: 202 len: 0 microversion: 2.1 time: 0.113313 Oct 13 13:17:33.035346 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 436/854] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Oct 13 13:17:32 2022] POST /compute/v2.1/servers/5c481e0e-37eb-4457-813e-eb8a84932582/action => generated 0 bytes in 115 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 13 13:17:33.044195 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-fe44af16-1873-4be1-9f53-bf55b40c3fa2 tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Calling method '>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:17:33.044904 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-fe44af16-1873-4be1-9f53-bf55b40c3fa2 tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] [instance: 5c481e0e-37eb-4457-813e-eb8a84932582] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:17:33.047710 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG dbcounter [-] [118815] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=3 {{(pid=118815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:17:33.048836 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG dbcounter [-] [118815] Writing DB stats nova_cell1:SELECT=48 {{(pid=118815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:17:33.055558 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-fe44af16-1873-4be1-9f53-bf55b40c3fa2 tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:17:33.056045 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-fe44af16-1873-4be1-9f53-bf55b40c3fa2 tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:17:33.056530 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-fe44af16-1873-4be1-9f53-bf55b40c3fa2 tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:17:33.057248 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-fe44af16-1873-4be1-9f53-bf55b40c3fa2 tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:17:33.057707 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-fe44af16-1873-4be1-9f53-bf55b40c3fa2 tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:17:33.058215 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-fe44af16-1873-4be1-9f53-bf55b40c3fa2 tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:17:33.196477 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-fe44af16-1873-4be1-9f53-bf55b40c3fa2 tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6723d3c8aa144452b46564649cf38ee3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aff81c38c17b4e82864854ceac6587df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:17:33.204354 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-fe44af16-1873-4be1-9f53-bf55b40c3fa2 tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] 10.222.0.23 "GET /compute/v2.1/servers/5c481e0e-37eb-4457-813e-eb8a84932582" status: 200 len: 1568 microversion: 2.1 time: 0.164421 Oct 13 13:17:33.205001 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 419/855] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:17:33 2022] GET /compute/v2.1/servers/5c481e0e-37eb-4457-813e-eb8a84932582 => generated 1568 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 13:17:34.228033 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-741438d6-15e6-44ed-bc5e-dcfd705d1245 tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Calling method '>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:17:34.228723 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-741438d6-15e6-44ed-bc5e-dcfd705d1245 tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] [instance: 5c481e0e-37eb-4457-813e-eb8a84932582] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:17:34.235017 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-741438d6-15e6-44ed-bc5e-dcfd705d1245 tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:17:34.235538 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-741438d6-15e6-44ed-bc5e-dcfd705d1245 tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:17:34.235984 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-741438d6-15e6-44ed-bc5e-dcfd705d1245 tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:17:34.236673 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-741438d6-15e6-44ed-bc5e-dcfd705d1245 tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:17:34.237269 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-741438d6-15e6-44ed-bc5e-dcfd705d1245 tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:17:34.237703 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-741438d6-15e6-44ed-bc5e-dcfd705d1245 tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:17:34.369838 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-741438d6-15e6-44ed-bc5e-dcfd705d1245 tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6723d3c8aa144452b46564649cf38ee3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aff81c38c17b4e82864854ceac6587df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:17:34.377879 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-741438d6-15e6-44ed-bc5e-dcfd705d1245 tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] 10.222.0.23 "GET /compute/v2.1/servers/5c481e0e-37eb-4457-813e-eb8a84932582" status: 200 len: 1568 microversion: 2.1 time: 0.154570 Oct 13 13:17:34.378382 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 437/856] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:17:34 2022] GET /compute/v2.1/servers/5c481e0e-37eb-4457-813e-eb8a84932582 => generated 1568 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:17:35.401589 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-f52adc24-ec87-405b-8af4-a6d95deb64e9 tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Calling method '>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:17:35.402201 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-f52adc24-ec87-405b-8af4-a6d95deb64e9 tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] [instance: 5c481e0e-37eb-4457-813e-eb8a84932582] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:17:35.408666 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-f52adc24-ec87-405b-8af4-a6d95deb64e9 tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:17:35.409143 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-f52adc24-ec87-405b-8af4-a6d95deb64e9 tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:17:35.409576 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-f52adc24-ec87-405b-8af4-a6d95deb64e9 tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:17:35.410838 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-f52adc24-ec87-405b-8af4-a6d95deb64e9 tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:17:35.411311 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-f52adc24-ec87-405b-8af4-a6d95deb64e9 tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:17:35.411732 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-f52adc24-ec87-405b-8af4-a6d95deb64e9 tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:17:35.557484 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-f52adc24-ec87-405b-8af4-a6d95deb64e9 tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6723d3c8aa144452b46564649cf38ee3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aff81c38c17b4e82864854ceac6587df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:17:35.565460 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-f52adc24-ec87-405b-8af4-a6d95deb64e9 tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] 10.222.0.23 "GET /compute/v2.1/servers/5c481e0e-37eb-4457-813e-eb8a84932582" status: 200 len: 1568 microversion: 2.1 time: 0.167743 Oct 13 13:17:35.566021 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 420/857] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:17:35 2022] GET /compute/v2.1/servers/5c481e0e-37eb-4457-813e-eb8a84932582 => generated 1568 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:17:36.590155 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-3143ca94-137a-4865-a080-084f5d8b10f6 tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Calling method '>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:17:36.591686 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-3143ca94-137a-4865-a080-084f5d8b10f6 tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] [instance: 5c481e0e-37eb-4457-813e-eb8a84932582] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:17:36.603778 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-3143ca94-137a-4865-a080-084f5d8b10f6 tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:17:36.604377 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-3143ca94-137a-4865-a080-084f5d8b10f6 tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:17:36.604829 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-3143ca94-137a-4865-a080-084f5d8b10f6 tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:17:36.605403 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-3143ca94-137a-4865-a080-084f5d8b10f6 tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:17:36.605844 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-3143ca94-137a-4865-a080-084f5d8b10f6 tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:17:36.606269 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-3143ca94-137a-4865-a080-084f5d8b10f6 tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:17:36.747241 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-3143ca94-137a-4865-a080-084f5d8b10f6 tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6723d3c8aa144452b46564649cf38ee3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aff81c38c17b4e82864854ceac6587df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:17:36.755217 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-3143ca94-137a-4865-a080-084f5d8b10f6 tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] 10.222.0.23 "GET /compute/v2.1/servers/5c481e0e-37eb-4457-813e-eb8a84932582" status: 200 len: 1568 microversion: 2.1 time: 0.169960 Oct 13 13:17:36.755782 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 438/858] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:17:36 2022] GET /compute/v2.1/servers/5c481e0e-37eb-4457-813e-eb8a84932582 => generated 1568 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:17:37.780517 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-e847f1f0-3e1e-4764-b973-00cd3a4af74c tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Calling method '>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:17:37.781735 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-e847f1f0-3e1e-4764-b973-00cd3a4af74c tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] [instance: 5c481e0e-37eb-4457-813e-eb8a84932582] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:17:37.788451 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-e847f1f0-3e1e-4764-b973-00cd3a4af74c tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:17:37.789023 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-e847f1f0-3e1e-4764-b973-00cd3a4af74c tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:17:37.789589 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-e847f1f0-3e1e-4764-b973-00cd3a4af74c tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:17:37.790983 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-e847f1f0-3e1e-4764-b973-00cd3a4af74c tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:17:37.791543 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-e847f1f0-3e1e-4764-b973-00cd3a4af74c tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:17:37.792041 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-e847f1f0-3e1e-4764-b973-00cd3a4af74c tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:17:37.995603 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-e847f1f0-3e1e-4764-b973-00cd3a4af74c tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6723d3c8aa144452b46564649cf38ee3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aff81c38c17b4e82864854ceac6587df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:17:38.004417 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-e847f1f0-3e1e-4764-b973-00cd3a4af74c tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] 10.222.0.23 "GET /compute/v2.1/servers/5c481e0e-37eb-4457-813e-eb8a84932582" status: 200 len: 1568 microversion: 2.1 time: 0.227611 Oct 13 13:17:38.005223 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 421/859] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:17:37 2022] GET /compute/v2.1/servers/5c481e0e-37eb-4457-813e-eb8a84932582 => generated 1568 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:17:39.031323 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-05d06f7a-e050-46c1-882c-f8fccf9a2dc9 tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Calling method '>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:17:39.032107 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-05d06f7a-e050-46c1-882c-f8fccf9a2dc9 tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] [instance: 5c481e0e-37eb-4457-813e-eb8a84932582] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:17:39.043784 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-05d06f7a-e050-46c1-882c-f8fccf9a2dc9 tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:17:39.044701 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-05d06f7a-e050-46c1-882c-f8fccf9a2dc9 tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:17:39.047752 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-05d06f7a-e050-46c1-882c-f8fccf9a2dc9 tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:17:39.049225 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-05d06f7a-e050-46c1-882c-f8fccf9a2dc9 tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:17:39.049978 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-05d06f7a-e050-46c1-882c-f8fccf9a2dc9 tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:17:39.052709 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-05d06f7a-e050-46c1-882c-f8fccf9a2dc9 tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:17:39.232280 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-05d06f7a-e050-46c1-882c-f8fccf9a2dc9 tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6723d3c8aa144452b46564649cf38ee3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aff81c38c17b4e82864854ceac6587df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:17:39.241544 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-05d06f7a-e050-46c1-882c-f8fccf9a2dc9 tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] 10.222.0.23 "GET /compute/v2.1/servers/5c481e0e-37eb-4457-813e-eb8a84932582" status: 200 len: 1568 microversion: 2.1 time: 0.216658 Oct 13 13:17:39.242133 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 439/860] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:17:39 2022] GET /compute/v2.1/servers/5c481e0e-37eb-4457-813e-eb8a84932582 => generated 1568 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 13:17:40.267245 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-ce2ace6e-be52-4da1-8d33-1f79a62bd5c5 tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Calling method '>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:17:40.268588 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-ce2ace6e-be52-4da1-8d33-1f79a62bd5c5 tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] [instance: 5c481e0e-37eb-4457-813e-eb8a84932582] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:17:40.276135 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-ce2ace6e-be52-4da1-8d33-1f79a62bd5c5 tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:17:40.277034 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-ce2ace6e-be52-4da1-8d33-1f79a62bd5c5 tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:17:40.277806 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-ce2ace6e-be52-4da1-8d33-1f79a62bd5c5 tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:17:40.278738 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-ce2ace6e-be52-4da1-8d33-1f79a62bd5c5 tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:17:40.279501 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-ce2ace6e-be52-4da1-8d33-1f79a62bd5c5 tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:17:40.280338 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-ce2ace6e-be52-4da1-8d33-1f79a62bd5c5 tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:17:40.568039 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-ce2ace6e-be52-4da1-8d33-1f79a62bd5c5 tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6723d3c8aa144452b46564649cf38ee3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aff81c38c17b4e82864854ceac6587df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:17:40.583838 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-ce2ace6e-be52-4da1-8d33-1f79a62bd5c5 tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] 10.222.0.23 "GET /compute/v2.1/servers/5c481e0e-37eb-4457-813e-eb8a84932582" status: 200 len: 1568 microversion: 2.1 time: 0.320499 Oct 13 13:17:40.585394 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 422/861] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:17:40 2022] GET /compute/v2.1/servers/5c481e0e-37eb-4457-813e-eb8a84932582 => generated 1568 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:17:41.608177 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-f193be76-bb96-48e8-82ff-c2c644de262b tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Calling method '>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:17:41.609845 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-f193be76-bb96-48e8-82ff-c2c644de262b tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] [instance: 5c481e0e-37eb-4457-813e-eb8a84932582] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:17:41.618176 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-f193be76-bb96-48e8-82ff-c2c644de262b tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:17:41.618861 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-f193be76-bb96-48e8-82ff-c2c644de262b tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:17:41.619446 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-f193be76-bb96-48e8-82ff-c2c644de262b tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:17:41.620142 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-f193be76-bb96-48e8-82ff-c2c644de262b tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:17:41.620727 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-f193be76-bb96-48e8-82ff-c2c644de262b tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:17:41.621153 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-f193be76-bb96-48e8-82ff-c2c644de262b tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:17:41.775299 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-f193be76-bb96-48e8-82ff-c2c644de262b tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6723d3c8aa144452b46564649cf38ee3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aff81c38c17b4e82864854ceac6587df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:17:41.783745 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-f193be76-bb96-48e8-82ff-c2c644de262b tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] 10.222.0.23 "GET /compute/v2.1/servers/5c481e0e-37eb-4457-813e-eb8a84932582" status: 200 len: 1568 microversion: 2.1 time: 0.179270 Oct 13 13:17:41.784646 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 440/862] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:17:41 2022] GET /compute/v2.1/servers/5c481e0e-37eb-4457-813e-eb8a84932582 => generated 1568 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:17:42.808348 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-bcbaa70d-dae5-4e2e-b119-4ae1faaf984e tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Calling method '>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:17:42.809710 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-bcbaa70d-dae5-4e2e-b119-4ae1faaf984e tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] [instance: 5c481e0e-37eb-4457-813e-eb8a84932582] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:17:42.817425 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-bcbaa70d-dae5-4e2e-b119-4ae1faaf984e tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:17:42.818224 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-bcbaa70d-dae5-4e2e-b119-4ae1faaf984e tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:17:42.819030 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-bcbaa70d-dae5-4e2e-b119-4ae1faaf984e tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:17:42.820111 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-bcbaa70d-dae5-4e2e-b119-4ae1faaf984e tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:17:42.820955 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-bcbaa70d-dae5-4e2e-b119-4ae1faaf984e tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:17:42.821593 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-bcbaa70d-dae5-4e2e-b119-4ae1faaf984e tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:17:43.011798 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-bcbaa70d-dae5-4e2e-b119-4ae1faaf984e tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6723d3c8aa144452b46564649cf38ee3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aff81c38c17b4e82864854ceac6587df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:17:43.027334 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-bcbaa70d-dae5-4e2e-b119-4ae1faaf984e tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] 10.222.0.23 "GET /compute/v2.1/servers/5c481e0e-37eb-4457-813e-eb8a84932582" status: 200 len: 1568 microversion: 2.1 time: 0.223186 Oct 13 13:17:43.027928 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 423/863] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:17:42 2022] GET /compute/v2.1/servers/5c481e0e-37eb-4457-813e-eb8a84932582 => generated 1568 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:17:44.052785 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-777f5922-2606-4dd2-9da9-5b9d9ef15a26 tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Calling method '>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:17:44.054057 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-777f5922-2606-4dd2-9da9-5b9d9ef15a26 tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] [instance: 5c481e0e-37eb-4457-813e-eb8a84932582] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:17:44.064344 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-777f5922-2606-4dd2-9da9-5b9d9ef15a26 tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:17:44.067582 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-777f5922-2606-4dd2-9da9-5b9d9ef15a26 tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:17:44.068140 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-777f5922-2606-4dd2-9da9-5b9d9ef15a26 tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:17:44.069187 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-777f5922-2606-4dd2-9da9-5b9d9ef15a26 tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:17:44.071457 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-777f5922-2606-4dd2-9da9-5b9d9ef15a26 tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:17:44.072186 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-777f5922-2606-4dd2-9da9-5b9d9ef15a26 tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:17:44.328171 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-777f5922-2606-4dd2-9da9-5b9d9ef15a26 tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6723d3c8aa144452b46564649cf38ee3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aff81c38c17b4e82864854ceac6587df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:17:44.336343 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-777f5922-2606-4dd2-9da9-5b9d9ef15a26 tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] 10.222.0.23 "GET /compute/v2.1/servers/5c481e0e-37eb-4457-813e-eb8a84932582" status: 200 len: 1568 microversion: 2.1 time: 0.288829 Oct 13 13:17:44.336911 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 441/864] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:17:44 2022] GET /compute/v2.1/servers/5c481e0e-37eb-4457-813e-eb8a84932582 => generated 1568 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:17:45.361246 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-d86c533a-0d4e-42da-8fbb-63a242021bb7 tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Calling method '>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:17:45.362435 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-d86c533a-0d4e-42da-8fbb-63a242021bb7 tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] [instance: 5c481e0e-37eb-4457-813e-eb8a84932582] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:17:45.377678 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-d86c533a-0d4e-42da-8fbb-63a242021bb7 tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:17:45.379276 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-d86c533a-0d4e-42da-8fbb-63a242021bb7 tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:17:45.379971 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-d86c533a-0d4e-42da-8fbb-63a242021bb7 tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:17:45.382247 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-d86c533a-0d4e-42da-8fbb-63a242021bb7 tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:17:45.383012 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-d86c533a-0d4e-42da-8fbb-63a242021bb7 tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:17:45.384639 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-d86c533a-0d4e-42da-8fbb-63a242021bb7 tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:17:45.700474 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-d86c533a-0d4e-42da-8fbb-63a242021bb7 tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6723d3c8aa144452b46564649cf38ee3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aff81c38c17b4e82864854ceac6587df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:17:45.711826 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-d86c533a-0d4e-42da-8fbb-63a242021bb7 tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] 10.222.0.23 "GET /compute/v2.1/servers/5c481e0e-37eb-4457-813e-eb8a84932582" status: 200 len: 1568 microversion: 2.1 time: 0.353929 Oct 13 13:17:45.712981 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 424/865] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:17:45 2022] GET /compute/v2.1/servers/5c481e0e-37eb-4457-813e-eb8a84932582 => generated 1568 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:17:46.736283 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-a5539fef-75a3-4086-894f-3fdec4b56009 tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Calling method '>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:17:46.736902 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-a5539fef-75a3-4086-894f-3fdec4b56009 tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] [instance: 5c481e0e-37eb-4457-813e-eb8a84932582] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:17:46.746957 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-a5539fef-75a3-4086-894f-3fdec4b56009 tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:17:46.747762 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-a5539fef-75a3-4086-894f-3fdec4b56009 tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:17:46.749028 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-a5539fef-75a3-4086-894f-3fdec4b56009 tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:17:46.749898 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-a5539fef-75a3-4086-894f-3fdec4b56009 tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:17:46.750655 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-a5539fef-75a3-4086-894f-3fdec4b56009 tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:17:46.751302 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-a5539fef-75a3-4086-894f-3fdec4b56009 tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:17:47.220370 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-a5539fef-75a3-4086-894f-3fdec4b56009 tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6723d3c8aa144452b46564649cf38ee3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aff81c38c17b4e82864854ceac6587df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:17:47.233146 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-a5539fef-75a3-4086-894f-3fdec4b56009 tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] 10.222.0.23 "GET /compute/v2.1/servers/5c481e0e-37eb-4457-813e-eb8a84932582" status: 200 len: 1568 microversion: 2.1 time: 0.500952 Oct 13 13:17:47.233960 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 442/866] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:17:46 2022] GET /compute/v2.1/servers/5c481e0e-37eb-4457-813e-eb8a84932582 => generated 1568 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:17:47.494879 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-81985e54-389d-49b8-9789-5b01405d71e9 tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Action: 'create', calling method: .version_select at 0x7f5093e0b0d0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1602157845", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN1HgKO92NQijUHNRIIKMOODnljjgdPoHwdG7QTKoKGrf1isp3ifO8AZYAW7hq2xKjac+c0pasdjDBUM3CrYSuPWrmfGlKgX1n2YhXzdnpzw8iFToiM0nJB/r7c6Csiv6A=="}} {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 13:17:47.546688 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.quota [None req-81985e54-389d-49b8-9789-5b01405d71e9 tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Getting quotas for project 17e1654782ac4100b0353d561496db51. Resources: {'key_pairs'} {{(pid=118815) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 13 13:17:47.551494 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.quota [None req-81985e54-389d-49b8-9789-5b01405d71e9 tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Getting quotas for user cd005dcc25944dfc9aeda1eb1468a0ea and project 17e1654782ac4100b0353d561496db51. Resources: {'key_pairs'} {{(pid=118815) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 13 13:17:47.583228 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-81985e54-389d-49b8-9789-5b01405d71e9 tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.280394 Oct 13 13:17:47.590376 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 425/867] 10.222.0.23 () {60 vars in 1159 bytes} [Thu Oct 13 13:17:47 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 13:17:48.258920 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-a2eefe7b-d20b-4f51-abec-0d037f21883d tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Calling method '>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:17:48.259760 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-a2eefe7b-d20b-4f51-abec-0d037f21883d tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] [instance: 5c481e0e-37eb-4457-813e-eb8a84932582] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:17:48.266637 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-a2eefe7b-d20b-4f51-abec-0d037f21883d tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:17:48.267251 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-a2eefe7b-d20b-4f51-abec-0d037f21883d tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:17:48.267759 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-a2eefe7b-d20b-4f51-abec-0d037f21883d tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:17:48.268701 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-a2eefe7b-d20b-4f51-abec-0d037f21883d tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:17:48.269361 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-a2eefe7b-d20b-4f51-abec-0d037f21883d tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:17:48.269989 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-a2eefe7b-d20b-4f51-abec-0d037f21883d tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:17:48.417950 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-a2eefe7b-d20b-4f51-abec-0d037f21883d tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6723d3c8aa144452b46564649cf38ee3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aff81c38c17b4e82864854ceac6587df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:17:48.427220 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-a2eefe7b-d20b-4f51-abec-0d037f21883d tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] 10.222.0.23 "GET /compute/v2.1/servers/5c481e0e-37eb-4457-813e-eb8a84932582" status: 200 len: 1568 microversion: 2.1 time: 0.173075 Oct 13 13:17:48.427805 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 443/868] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:17:48 2022] GET /compute/v2.1/servers/5c481e0e-37eb-4457-813e-eb8a84932582 => generated 1568 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:17:49.450742 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-fb98ed6e-01b5-47c1-bff0-115e69c1e4f7 tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Calling method '>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:17:49.451453 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-fb98ed6e-01b5-47c1-bff0-115e69c1e4f7 tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] [instance: 5c481e0e-37eb-4457-813e-eb8a84932582] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:17:49.458567 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-fb98ed6e-01b5-47c1-bff0-115e69c1e4f7 tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:17:49.459050 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-fb98ed6e-01b5-47c1-bff0-115e69c1e4f7 tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:17:49.459509 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-fb98ed6e-01b5-47c1-bff0-115e69c1e4f7 tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:17:49.460195 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-fb98ed6e-01b5-47c1-bff0-115e69c1e4f7 tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:17:49.460653 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-fb98ed6e-01b5-47c1-bff0-115e69c1e4f7 tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:17:49.461097 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-fb98ed6e-01b5-47c1-bff0-115e69c1e4f7 tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:17:49.594307 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-fb98ed6e-01b5-47c1-bff0-115e69c1e4f7 tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6723d3c8aa144452b46564649cf38ee3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aff81c38c17b4e82864854ceac6587df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:17:49.602728 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-fb98ed6e-01b5-47c1-bff0-115e69c1e4f7 tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] 10.222.0.23 "GET /compute/v2.1/servers/5c481e0e-37eb-4457-813e-eb8a84932582" status: 200 len: 1568 microversion: 2.1 time: 0.156342 Oct 13 13:17:49.603453 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 426/869] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:17:49 2022] GET /compute/v2.1/servers/5c481e0e-37eb-4457-813e-eb8a84932582 => generated 1568 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:17:50.625546 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-ba1b4d94-d8df-418d-a57b-c444e43ca78c tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Calling method '>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:17:50.626161 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-ba1b4d94-d8df-418d-a57b-c444e43ca78c tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] [instance: 5c481e0e-37eb-4457-813e-eb8a84932582] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:17:50.632576 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-ba1b4d94-d8df-418d-a57b-c444e43ca78c tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:17:50.633065 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-ba1b4d94-d8df-418d-a57b-c444e43ca78c tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:17:50.633502 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-ba1b4d94-d8df-418d-a57b-c444e43ca78c tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:17:50.634192 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-ba1b4d94-d8df-418d-a57b-c444e43ca78c tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:17:50.634649 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-ba1b4d94-d8df-418d-a57b-c444e43ca78c tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:17:50.635150 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-ba1b4d94-d8df-418d-a57b-c444e43ca78c tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:17:50.764811 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-ba1b4d94-d8df-418d-a57b-c444e43ca78c tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6723d3c8aa144452b46564649cf38ee3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aff81c38c17b4e82864854ceac6587df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:17:50.772593 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-ba1b4d94-d8df-418d-a57b-c444e43ca78c tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] 10.222.0.23 "GET /compute/v2.1/servers/5c481e0e-37eb-4457-813e-eb8a84932582" status: 200 len: 1568 microversion: 2.1 time: 0.150961 Oct 13 13:17:50.773153 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 444/870] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:17:50 2022] GET /compute/v2.1/servers/5c481e0e-37eb-4457-813e-eb8a84932582 => generated 1568 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:17:51.796249 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-451a136e-7fc0-4e92-a139-a5240c3bb381 tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Calling method '>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:17:51.796860 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-451a136e-7fc0-4e92-a139-a5240c3bb381 tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] [instance: 5c481e0e-37eb-4457-813e-eb8a84932582] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:17:51.804815 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-451a136e-7fc0-4e92-a139-a5240c3bb381 tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:17:51.805311 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-451a136e-7fc0-4e92-a139-a5240c3bb381 tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:17:51.805936 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-451a136e-7fc0-4e92-a139-a5240c3bb381 tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:17:51.806739 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-451a136e-7fc0-4e92-a139-a5240c3bb381 tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:17:51.807439 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-451a136e-7fc0-4e92-a139-a5240c3bb381 tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:17:51.807884 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-451a136e-7fc0-4e92-a139-a5240c3bb381 tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:17:51.949914 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-451a136e-7fc0-4e92-a139-a5240c3bb381 tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6723d3c8aa144452b46564649cf38ee3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aff81c38c17b4e82864854ceac6587df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:17:51.958164 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-451a136e-7fc0-4e92-a139-a5240c3bb381 tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] 10.222.0.23 "GET /compute/v2.1/servers/5c481e0e-37eb-4457-813e-eb8a84932582" status: 200 len: 1568 microversion: 2.1 time: 0.165802 Oct 13 13:17:51.958781 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 427/871] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:17:51 2022] GET /compute/v2.1/servers/5c481e0e-37eb-4457-813e-eb8a84932582 => generated 1568 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:17:52.983543 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-1c4b6468-c9a9-4edd-9ac0-270071436d9e tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Calling method '>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:17:52.984173 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-1c4b6468-c9a9-4edd-9ac0-270071436d9e tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] [instance: 5c481e0e-37eb-4457-813e-eb8a84932582] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:17:52.990788 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-1c4b6468-c9a9-4edd-9ac0-270071436d9e tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:17:52.991321 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-1c4b6468-c9a9-4edd-9ac0-270071436d9e tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:17:52.991764 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-1c4b6468-c9a9-4edd-9ac0-270071436d9e tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:17:52.992464 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-1c4b6468-c9a9-4edd-9ac0-270071436d9e tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:17:52.992921 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-1c4b6468-c9a9-4edd-9ac0-270071436d9e tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:17:52.993352 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-1c4b6468-c9a9-4edd-9ac0-270071436d9e tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:17:53.125151 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-1c4b6468-c9a9-4edd-9ac0-270071436d9e tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6723d3c8aa144452b46564649cf38ee3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aff81c38c17b4e82864854ceac6587df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:17:53.133573 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-1c4b6468-c9a9-4edd-9ac0-270071436d9e tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] 10.222.0.23 "GET /compute/v2.1/servers/5c481e0e-37eb-4457-813e-eb8a84932582" status: 200 len: 1568 microversion: 2.1 time: 0.153982 Oct 13 13:17:53.134139 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 445/872] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:17:52 2022] GET /compute/v2.1/servers/5c481e0e-37eb-4457-813e-eb8a84932582 => generated 1568 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 13:17:54.158053 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-d4f277ea-efb7-4c6a-ba75-fe4224fa1988 tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Calling method '>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:17:54.158663 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-d4f277ea-efb7-4c6a-ba75-fe4224fa1988 tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] [instance: 5c481e0e-37eb-4457-813e-eb8a84932582] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:17:54.165776 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-d4f277ea-efb7-4c6a-ba75-fe4224fa1988 tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:17:54.166265 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-d4f277ea-efb7-4c6a-ba75-fe4224fa1988 tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:17:54.166704 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-d4f277ea-efb7-4c6a-ba75-fe4224fa1988 tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:17:54.167421 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-d4f277ea-efb7-4c6a-ba75-fe4224fa1988 tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:17:54.167877 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-d4f277ea-efb7-4c6a-ba75-fe4224fa1988 tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:17:54.168328 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-d4f277ea-efb7-4c6a-ba75-fe4224fa1988 tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:17:54.304467 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-d4f277ea-efb7-4c6a-ba75-fe4224fa1988 tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6723d3c8aa144452b46564649cf38ee3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aff81c38c17b4e82864854ceac6587df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:17:54.318579 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-d4f277ea-efb7-4c6a-ba75-fe4224fa1988 tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] 10.222.0.23 "GET /compute/v2.1/servers/5c481e0e-37eb-4457-813e-eb8a84932582" status: 200 len: 1568 microversion: 2.1 time: 0.160347 Oct 13 13:17:54.318579 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 428/873] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:17:54 2022] GET /compute/v2.1/servers/5c481e0e-37eb-4457-813e-eb8a84932582 => generated 1568 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:17:55.338946 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-d67c0bcf-0cf1-49da-9b10-5c919bd9f594 tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Calling method '>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:17:55.338946 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-d67c0bcf-0cf1-49da-9b10-5c919bd9f594 tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] [instance: 5c481e0e-37eb-4457-813e-eb8a84932582] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:17:55.346869 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-d67c0bcf-0cf1-49da-9b10-5c919bd9f594 tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:17:55.347552 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-d67c0bcf-0cf1-49da-9b10-5c919bd9f594 tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:17:55.347996 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-d67c0bcf-0cf1-49da-9b10-5c919bd9f594 tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:17:55.348698 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-d67c0bcf-0cf1-49da-9b10-5c919bd9f594 tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:17:55.349333 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-d67c0bcf-0cf1-49da-9b10-5c919bd9f594 tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:17:55.349761 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-d67c0bcf-0cf1-49da-9b10-5c919bd9f594 tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:17:55.512258 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-d67c0bcf-0cf1-49da-9b10-5c919bd9f594 tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6723d3c8aa144452b46564649cf38ee3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aff81c38c17b4e82864854ceac6587df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:17:55.521079 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-d67c0bcf-0cf1-49da-9b10-5c919bd9f594 tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] 10.222.0.23 "GET /compute/v2.1/servers/5c481e0e-37eb-4457-813e-eb8a84932582" status: 200 len: 1568 microversion: 2.1 time: 0.186940 Oct 13 13:17:55.521986 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 446/874] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:17:55 2022] GET /compute/v2.1/servers/5c481e0e-37eb-4457-813e-eb8a84932582 => generated 1568 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:17:56.544315 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-16615ccf-8314-4951-b2ed-ce6df3774791 tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Calling method '>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:17:56.544968 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-16615ccf-8314-4951-b2ed-ce6df3774791 tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] [instance: 5c481e0e-37eb-4457-813e-eb8a84932582] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:17:56.553829 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-16615ccf-8314-4951-b2ed-ce6df3774791 tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:17:56.554405 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-16615ccf-8314-4951-b2ed-ce6df3774791 tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:17:56.554914 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-16615ccf-8314-4951-b2ed-ce6df3774791 tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:17:56.555831 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-16615ccf-8314-4951-b2ed-ce6df3774791 tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:17:56.556307 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-16615ccf-8314-4951-b2ed-ce6df3774791 tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:17:56.557002 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-16615ccf-8314-4951-b2ed-ce6df3774791 tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:17:56.688725 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-16615ccf-8314-4951-b2ed-ce6df3774791 tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6723d3c8aa144452b46564649cf38ee3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aff81c38c17b4e82864854ceac6587df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:17:56.697346 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-16615ccf-8314-4951-b2ed-ce6df3774791 tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] 10.222.0.23 "GET /compute/v2.1/servers/5c481e0e-37eb-4457-813e-eb8a84932582" status: 200 len: 1509 microversion: 2.1 time: 0.156996 Oct 13 13:17:56.697905 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 429/875] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:17:56 2022] GET /compute/v2.1/servers/5c481e0e-37eb-4457-813e-eb8a84932582 => generated 1509 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:17:56.720025 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-cd6988fa-818b-4f51-8509-a6b1d39f944e tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 13:17:56.720622 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-cd6988fa-818b-4f51-8509-a6b1d39f944e tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] [instance: 5c481e0e-37eb-4457-813e-eb8a84932582] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:17:56.727017 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-cd6988fa-818b-4f51-8509-a6b1d39f944e tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:17:56.727544 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-cd6988fa-818b-4f51-8509-a6b1d39f944e tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:17:56.728020 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-cd6988fa-818b-4f51-8509-a6b1d39f944e tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:17:56.728705 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-cd6988fa-818b-4f51-8509-a6b1d39f944e tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:17:56.729162 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-cd6988fa-818b-4f51-8509-a6b1d39f944e tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:17:56.729589 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-cd6988fa-818b-4f51-8509-a6b1d39f944e tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:17:56.758836 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-cd6988fa-818b-4f51-8509-a6b1d39f944e tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] [instance: 5c481e0e-37eb-4457-813e-eb8a84932582] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=118814) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 13 13:17:56.826226 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-cd6988fa-818b-4f51-8509-a6b1d39f944e tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] 10.222.0.23 "POST /compute/v2.1/servers/5c481e0e-37eb-4457-813e-eb8a84932582/action" status: 202 len: 0 microversion: 2.1 time: 0.109484 Oct 13 13:17:56.829342 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 447/876] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Oct 13 13:17:56 2022] POST /compute/v2.1/servers/5c481e0e-37eb-4457-813e-eb8a84932582/action => generated 0 bytes in 111 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 13 13:17:56.834349 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-e9ea8023-e4fd-4683-a626-f5d3ed9e6733 tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Calling method '>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:17:56.835071 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-e9ea8023-e4fd-4683-a626-f5d3ed9e6733 tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] [instance: 5c481e0e-37eb-4457-813e-eb8a84932582] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:17:56.842080 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-e9ea8023-e4fd-4683-a626-f5d3ed9e6733 tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:17:56.842657 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-e9ea8023-e4fd-4683-a626-f5d3ed9e6733 tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:17:56.843303 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-e9ea8023-e4fd-4683-a626-f5d3ed9e6733 tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:17:56.844111 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-e9ea8023-e4fd-4683-a626-f5d3ed9e6733 tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:17:56.844574 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-e9ea8023-e4fd-4683-a626-f5d3ed9e6733 tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:17:56.845080 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-e9ea8023-e4fd-4683-a626-f5d3ed9e6733 tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:17:56.994732 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-e9ea8023-e4fd-4683-a626-f5d3ed9e6733 tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6723d3c8aa144452b46564649cf38ee3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aff81c38c17b4e82864854ceac6587df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:17:57.004803 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-e9ea8023-e4fd-4683-a626-f5d3ed9e6733 tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] 10.222.0.23 "GET /compute/v2.1/servers/5c481e0e-37eb-4457-813e-eb8a84932582" status: 200 len: 1517 microversion: 2.1 time: 0.172101 Oct 13 13:17:57.004803 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 430/877] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:17:56 2022] GET /compute/v2.1/servers/5c481e0e-37eb-4457-813e-eb8a84932582 => generated 1517 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 13:17:58.027123 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-7606cd58-fcad-412a-85f1-e1df3f015084 tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Calling method '>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:17:58.028344 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-7606cd58-fcad-412a-85f1-e1df3f015084 tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] [instance: 5c481e0e-37eb-4457-813e-eb8a84932582] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:17:58.034800 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-7606cd58-fcad-412a-85f1-e1df3f015084 tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:17:58.035417 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-7606cd58-fcad-412a-85f1-e1df3f015084 tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:17:58.035952 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-7606cd58-fcad-412a-85f1-e1df3f015084 tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:17:58.036723 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-7606cd58-fcad-412a-85f1-e1df3f015084 tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:17:58.037249 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-7606cd58-fcad-412a-85f1-e1df3f015084 tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:17:58.037758 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-7606cd58-fcad-412a-85f1-e1df3f015084 tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:17:58.183955 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-7606cd58-fcad-412a-85f1-e1df3f015084 tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6723d3c8aa144452b46564649cf38ee3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aff81c38c17b4e82864854ceac6587df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:17:58.196683 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-7606cd58-fcad-412a-85f1-e1df3f015084 tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] 10.222.0.23 "GET /compute/v2.1/servers/5c481e0e-37eb-4457-813e-eb8a84932582" status: 200 len: 1519 microversion: 2.1 time: 0.174711 Oct 13 13:17:58.197258 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 448/878] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:17:58 2022] GET /compute/v2.1/servers/5c481e0e-37eb-4457-813e-eb8a84932582 => generated 1519 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:17:58.475709 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [req-d775ec1e-2238-4211-9cb9-e8d8eb0f8da4 req-34ac7ad3-e64a-4666-ade2-1eaf755d750c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5c481e0e-37eb-4457-813e-eb8a84932582", "name": "network-vif-unplugged", "status": "completed", "tag": "386e505c-fee6-4a1d-9fa8-236b241cf782"}]} {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 13:17:58.489503 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG dbcounter [-] [118815] Writing DB stats nova_cell0:SELECT=4 {{(pid=118815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:17:58.493540 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [req-d775ec1e-2238-4211-9cb9-e8d8eb0f8da4 req-34ac7ad3-e64a-4666-ade2-1eaf755d750c service nova] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:17:58.494322 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [req-d775ec1e-2238-4211-9cb9-e8d8eb0f8da4 req-34ac7ad3-e64a-4666-ade2-1eaf755d750c service nova] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:17:58.495519 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [req-d775ec1e-2238-4211-9cb9-e8d8eb0f8da4 req-34ac7ad3-e64a-4666-ade2-1eaf755d750c service nova] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:17:58.515616 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.compute.server_external_events [req-d775ec1e-2238-4211-9cb9-e8d8eb0f8da4 req-34ac7ad3-e64a-4666-ade2-1eaf755d750c service nova] Creating event network-vif-unplugged:386e505c-fee6-4a1d-9fa8-236b241cf782 for instance 5c481e0e-37eb-4457-813e-eb8a84932582 on hv-cinder-82660 Oct 13 13:17:58.530284 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [req-d775ec1e-2238-4211-9cb9-e8d8eb0f8da4 req-34ac7ad3-e64a-4666-ade2-1eaf755d750c service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.058984 Oct 13 13:17:58.531770 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 431/879] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 13:17:58 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 13:17:59.222524 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-2bfa7908-2c68-4b55-b8d7-35dd78f70a32 tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Calling method '>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:17:59.223212 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-2bfa7908-2c68-4b55-b8d7-35dd78f70a32 tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] [instance: 5c481e0e-37eb-4457-813e-eb8a84932582] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:17:59.230075 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-2bfa7908-2c68-4b55-b8d7-35dd78f70a32 tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:17:59.230621 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-2bfa7908-2c68-4b55-b8d7-35dd78f70a32 tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:17:59.231183 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-2bfa7908-2c68-4b55-b8d7-35dd78f70a32 tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:17:59.231869 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-2bfa7908-2c68-4b55-b8d7-35dd78f70a32 tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:17:59.232324 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-2bfa7908-2c68-4b55-b8d7-35dd78f70a32 tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:17:59.232745 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-2bfa7908-2c68-4b55-b8d7-35dd78f70a32 tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:17:59.251333 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG dbcounter [-] [118814] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=118814) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:17:59.385300 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-2bfa7908-2c68-4b55-b8d7-35dd78f70a32 tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6723d3c8aa144452b46564649cf38ee3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aff81c38c17b4e82864854ceac6587df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:17:59.393873 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-2bfa7908-2c68-4b55-b8d7-35dd78f70a32 tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] 10.222.0.23 "GET /compute/v2.1/servers/5c481e0e-37eb-4457-813e-eb8a84932582" status: 200 len: 1575 microversion: 2.1 time: 0.175350 Oct 13 13:17:59.394445 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 449/880] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:17:59 2022] GET /compute/v2.1/servers/5c481e0e-37eb-4457-813e-eb8a84932582 => generated 1575 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:17:59.738412 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-27e5c5ea-3897-4de4-a2ad-c6c7051b8500 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Calling method '>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:17:59.738930 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-27e5c5ea-3897-4de4-a2ad-c6c7051b8500 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] [instance: 8a4e6f19-21f2-4ff8-af3d-bf93ec2488aa] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:17:59.746055 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-27e5c5ea-3897-4de4-a2ad-c6c7051b8500 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:17:59.746744 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-27e5c5ea-3897-4de4-a2ad-c6c7051b8500 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:17:59.747434 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-27e5c5ea-3897-4de4-a2ad-c6c7051b8500 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:17:59.748151 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-27e5c5ea-3897-4de4-a2ad-c6c7051b8500 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:17:59.748607 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-27e5c5ea-3897-4de4-a2ad-c6c7051b8500 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:17:59.749034 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-27e5c5ea-3897-4de4-a2ad-c6c7051b8500 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:17:59.774543 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-27e5c5ea-3897-4de4-a2ad-c6c7051b8500 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] 10.222.0.23 "GET /compute/v2.1/servers/8a4e6f19-21f2-4ff8-af3d-bf93ec2488aa/ips" status: 200 len: 150 microversion: 2.1 time: 0.041019 Oct 13 13:17:59.775160 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 432/881] 10.222.0.23 () {58 vars in 1248 bytes} [Thu Oct 13 13:17:59 2022] GET /compute/v2.1/servers/8a4e6f19-21f2-4ff8-af3d-bf93ec2488aa/ips => generated 150 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 13:18:00.419470 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-791de629-260d-4089-9440-33e5521349b4 tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Calling method '>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:18:00.420089 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-791de629-260d-4089-9440-33e5521349b4 tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] [instance: 5c481e0e-37eb-4457-813e-eb8a84932582] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:18:00.427675 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-791de629-260d-4089-9440-33e5521349b4 tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:18:00.428318 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-791de629-260d-4089-9440-33e5521349b4 tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:18:00.428805 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-791de629-260d-4089-9440-33e5521349b4 tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:18:00.429754 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-791de629-260d-4089-9440-33e5521349b4 tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:18:00.430356 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-791de629-260d-4089-9440-33e5521349b4 tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:18:00.430992 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-791de629-260d-4089-9440-33e5521349b4 tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:18:00.563698 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-791de629-260d-4089-9440-33e5521349b4 tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6723d3c8aa144452b46564649cf38ee3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aff81c38c17b4e82864854ceac6587df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:18:00.571384 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-791de629-260d-4089-9440-33e5521349b4 tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] 10.222.0.23 "GET /compute/v2.1/servers/5c481e0e-37eb-4457-813e-eb8a84932582" status: 200 len: 1575 microversion: 2.1 time: 0.155783 Oct 13 13:18:00.571938 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 450/882] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:18:00 2022] GET /compute/v2.1/servers/5c481e0e-37eb-4457-813e-eb8a84932582 => generated 1575 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:18:01.189386 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-e11452e0-f997-4924-892f-c1326c8a2408 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2dab83bf-a88b-4b2f-babc-91fbb0985a53"}} {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 13:18:01.191743 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-e11452e0-f997-4924-892f-c1326c8a2408 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] [instance: 8a4e6f19-21f2-4ff8-af3d-bf93ec2488aa] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:18:01.198094 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-e11452e0-f997-4924-892f-c1326c8a2408 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:18:01.198580 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-e11452e0-f997-4924-892f-c1326c8a2408 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:18:01.199016 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-e11452e0-f997-4924-892f-c1326c8a2408 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:18:01.199728 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-e11452e0-f997-4924-892f-c1326c8a2408 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:18:01.200183 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-e11452e0-f997-4924-892f-c1326c8a2408 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:18:01.200610 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-e11452e0-f997-4924-892f-c1326c8a2408 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:18:01.595242 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-cfa9bf87-f4b3-485d-b239-fb1368b15b33 tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Calling method '>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:18:01.595853 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-cfa9bf87-f4b3-485d-b239-fb1368b15b33 tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] [instance: 5c481e0e-37eb-4457-813e-eb8a84932582] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:18:01.603324 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-cfa9bf87-f4b3-485d-b239-fb1368b15b33 tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:18:01.603807 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-cfa9bf87-f4b3-485d-b239-fb1368b15b33 tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:18:01.604247 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-cfa9bf87-f4b3-485d-b239-fb1368b15b33 tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:18:01.604924 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-cfa9bf87-f4b3-485d-b239-fb1368b15b33 tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:18:01.605377 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-cfa9bf87-f4b3-485d-b239-fb1368b15b33 tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:18:01.605805 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-cfa9bf87-f4b3-485d-b239-fb1368b15b33 tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:18:01.739821 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-cfa9bf87-f4b3-485d-b239-fb1368b15b33 tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6723d3c8aa144452b46564649cf38ee3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aff81c38c17b4e82864854ceac6587df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:18:01.747632 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-cfa9bf87-f4b3-485d-b239-fb1368b15b33 tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] 10.222.0.23 "GET /compute/v2.1/servers/5c481e0e-37eb-4457-813e-eb8a84932582" status: 200 len: 1575 microversion: 2.1 time: 0.156359 Oct 13 13:18:01.748181 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 451/883] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:18:01 2022] GET /compute/v2.1/servers/5c481e0e-37eb-4457-813e-eb8a84932582 => generated 1575 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 13:18:02.771357 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-4b5a143b-58cd-4368-9e33-ed1d60e00f05 tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Calling method '>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:18:02.771957 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-4b5a143b-58cd-4368-9e33-ed1d60e00f05 tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] [instance: 5c481e0e-37eb-4457-813e-eb8a84932582] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:18:02.778255 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-4b5a143b-58cd-4368-9e33-ed1d60e00f05 tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:18:02.778734 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-4b5a143b-58cd-4368-9e33-ed1d60e00f05 tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:18:02.779199 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-4b5a143b-58cd-4368-9e33-ed1d60e00f05 tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:18:02.779877 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-4b5a143b-58cd-4368-9e33-ed1d60e00f05 tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:18:02.780377 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-4b5a143b-58cd-4368-9e33-ed1d60e00f05 tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:18:02.780727 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-4b5a143b-58cd-4368-9e33-ed1d60e00f05 tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:18:02.914932 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-4b5a143b-58cd-4368-9e33-ed1d60e00f05 tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6723d3c8aa144452b46564649cf38ee3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aff81c38c17b4e82864854ceac6587df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:18:02.922582 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-4b5a143b-58cd-4368-9e33-ed1d60e00f05 tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] 10.222.0.23 "GET /compute/v2.1/servers/5c481e0e-37eb-4457-813e-eb8a84932582" status: 200 len: 1575 microversion: 2.1 time: 0.155546 Oct 13 13:18:02.923443 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 452/884] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:18:02 2022] GET /compute/v2.1/servers/5c481e0e-37eb-4457-813e-eb8a84932582 => generated 1575 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 13:18:03.353558 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG dbcounter [-] [118815] Writing DB stats nova_cell1:SELECT=79 {{(pid=118815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:18:03.468378 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-e11452e0-f997-4924-892f-c1326c8a2408 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] 10.222.0.23 "POST /compute/v2.1/servers/8a4e6f19-21f2-4ff8-af3d-bf93ec2488aa/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.282844 Oct 13 13:18:03.468973 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 433/885] 10.222.0.23 () {60 vars in 1323 bytes} [Thu Oct 13 13:18:01 2022] POST /compute/v2.1/servers/8a4e6f19-21f2-4ff8-af3d-bf93ec2488aa/os-volume_attachments => generated 194 bytes in 2284 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 13:18:03.944842 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-c956c160-d296-4ffe-97a9-1595927df52b tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Calling method '>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:18:03.945468 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-c956c160-d296-4ffe-97a9-1595927df52b tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] [instance: 5c481e0e-37eb-4457-813e-eb8a84932582] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:18:03.947789 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG dbcounter [-] [118814] Writing DB stats nova_api:SELECT=39,nova_api:UPDATE=1 {{(pid=118814) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:18:03.953147 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-c956c160-d296-4ffe-97a9-1595927df52b tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:18:03.953711 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-c956c160-d296-4ffe-97a9-1595927df52b tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:18:03.954157 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-c956c160-d296-4ffe-97a9-1595927df52b tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:18:03.954873 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-c956c160-d296-4ffe-97a9-1595927df52b tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:18:03.955351 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-c956c160-d296-4ffe-97a9-1595927df52b tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:18:03.955774 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-c956c160-d296-4ffe-97a9-1595927df52b tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:18:04.236170 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-c956c160-d296-4ffe-97a9-1595927df52b tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6723d3c8aa144452b46564649cf38ee3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aff81c38c17b4e82864854ceac6587df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:18:04.244492 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-c956c160-d296-4ffe-97a9-1595927df52b tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] 10.222.0.23 "GET /compute/v2.1/servers/5c481e0e-37eb-4457-813e-eb8a84932582" status: 200 len: 1575 microversion: 2.1 time: 0.303529 Oct 13 13:18:04.245052 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 453/886] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:18:03 2022] GET /compute/v2.1/servers/5c481e0e-37eb-4457-813e-eb8a84932582 => generated 1575 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:18:05.267732 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-52e03b48-3f71-4aa1-be59-9a1f4c60c83c tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Calling method '>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:18:05.268418 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-52e03b48-3f71-4aa1-be59-9a1f4c60c83c tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] [instance: 5c481e0e-37eb-4457-813e-eb8a84932582] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:18:05.270841 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG dbcounter [-] [118815] Writing DB stats nova_api:SELECT=40,nova_api:INSERT=1 {{(pid=118815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:18:05.276824 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-52e03b48-3f71-4aa1-be59-9a1f4c60c83c tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:18:05.277310 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-52e03b48-3f71-4aa1-be59-9a1f4c60c83c tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:18:05.277745 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-52e03b48-3f71-4aa1-be59-9a1f4c60c83c tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:18:05.278430 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-52e03b48-3f71-4aa1-be59-9a1f4c60c83c tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:18:05.278885 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-52e03b48-3f71-4aa1-be59-9a1f4c60c83c tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:18:05.279340 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-52e03b48-3f71-4aa1-be59-9a1f4c60c83c tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:18:05.419266 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-52e03b48-3f71-4aa1-be59-9a1f4c60c83c tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6723d3c8aa144452b46564649cf38ee3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aff81c38c17b4e82864854ceac6587df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:18:05.427269 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-52e03b48-3f71-4aa1-be59-9a1f4c60c83c tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] 10.222.0.23 "GET /compute/v2.1/servers/5c481e0e-37eb-4457-813e-eb8a84932582" status: 200 len: 1575 microversion: 2.1 time: 0.164317 Oct 13 13:18:05.427826 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 434/887] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:18:05 2022] GET /compute/v2.1/servers/5c481e0e-37eb-4457-813e-eb8a84932582 => generated 1575 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:18:06.450399 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-614ff349-ed6e-4d19-94fc-baf30957f153 tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Calling method '>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:18:06.451012 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-614ff349-ed6e-4d19-94fc-baf30957f153 tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] [instance: 5c481e0e-37eb-4457-813e-eb8a84932582] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:18:06.458161 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-614ff349-ed6e-4d19-94fc-baf30957f153 tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:18:06.458638 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-614ff349-ed6e-4d19-94fc-baf30957f153 tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:18:06.459092 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-614ff349-ed6e-4d19-94fc-baf30957f153 tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:18:06.459789 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-614ff349-ed6e-4d19-94fc-baf30957f153 tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:18:06.460366 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-614ff349-ed6e-4d19-94fc-baf30957f153 tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:18:06.460791 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-614ff349-ed6e-4d19-94fc-baf30957f153 tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:18:06.592012 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-614ff349-ed6e-4d19-94fc-baf30957f153 tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6723d3c8aa144452b46564649cf38ee3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aff81c38c17b4e82864854ceac6587df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:18:06.599786 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-614ff349-ed6e-4d19-94fc-baf30957f153 tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] 10.222.0.23 "GET /compute/v2.1/servers/5c481e0e-37eb-4457-813e-eb8a84932582" status: 200 len: 1575 microversion: 2.1 time: 0.153245 Oct 13 13:18:06.600344 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 454/888] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:18:06 2022] GET /compute/v2.1/servers/5c481e0e-37eb-4457-813e-eb8a84932582 => generated 1575 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:18:07.624053 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-8dffe429-93d6-41ec-a424-82a6041b49da tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Calling method '>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:18:07.624776 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-8dffe429-93d6-41ec-a424-82a6041b49da tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] [instance: 5c481e0e-37eb-4457-813e-eb8a84932582] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:18:07.633078 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-8dffe429-93d6-41ec-a424-82a6041b49da tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:18:07.633583 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-8dffe429-93d6-41ec-a424-82a6041b49da tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:18:07.634008 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-8dffe429-93d6-41ec-a424-82a6041b49da tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:18:07.634733 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-8dffe429-93d6-41ec-a424-82a6041b49da tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:18:07.635240 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-8dffe429-93d6-41ec-a424-82a6041b49da tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:18:07.635671 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-8dffe429-93d6-41ec-a424-82a6041b49da tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:18:07.810481 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-8dffe429-93d6-41ec-a424-82a6041b49da tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6723d3c8aa144452b46564649cf38ee3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aff81c38c17b4e82864854ceac6587df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:18:07.821373 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-8dffe429-93d6-41ec-a424-82a6041b49da tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] 10.222.0.23 "GET /compute/v2.1/servers/5c481e0e-37eb-4457-813e-eb8a84932582" status: 200 len: 1575 microversion: 2.1 time: 0.201198 Oct 13 13:18:07.821946 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 435/889] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:18:07 2022] GET /compute/v2.1/servers/5c481e0e-37eb-4457-813e-eb8a84932582 => generated 1575 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:18:08.246433 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-1b545299-f1fc-44a1-80bb-551405bbd41f tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1518824356", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1602157845", "security_groups": [{"name": "tempest-secgroup-smoke-1972725413"}], "block_device_mapping_v2": [{"uuid": "904d1ffc-67e2-4c0b-a0fe-8a1984528560", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "2fc51ab6-7e9b-491d-a490-ff80ae554bf0"}]}} {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 13:18:08.355681 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.network.neutron [None req-1b545299-f1fc-44a1-80bb-551405bbd41f tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] validate_networks() for [('2fc51ab6-7e9b-491d-a490-ff80ae554bf0', None, None, None, None, None)] {{(pid=118814) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 13 13:18:08.545480 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [req-fb0c1853-f3ca-428e-900e-88bacd0a0613 req-0e4767b3-de0f-4717-8280-f329d2029886 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5c481e0e-37eb-4457-813e-eb8a84932582", "name": "network-vif-plugged", "status": "completed", "tag": "386e505c-fee6-4a1d-9fa8-236b241cf782"}]} {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 13:18:08.557489 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [req-fb0c1853-f3ca-428e-900e-88bacd0a0613 req-0e4767b3-de0f-4717-8280-f329d2029886 service nova] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:18:08.557969 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [req-fb0c1853-f3ca-428e-900e-88bacd0a0613 req-0e4767b3-de0f-4717-8280-f329d2029886 service nova] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:18:08.558395 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [req-fb0c1853-f3ca-428e-900e-88bacd0a0613 req-0e4767b3-de0f-4717-8280-f329d2029886 service nova] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:18:08.571628 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.compute.server_external_events [req-fb0c1853-f3ca-428e-900e-88bacd0a0613 req-0e4767b3-de0f-4717-8280-f329d2029886 service nova] Creating event network-vif-plugged:386e505c-fee6-4a1d-9fa8-236b241cf782 for instance 5c481e0e-37eb-4457-813e-eb8a84932582 on hv-cinder-82660 Oct 13 13:18:08.577009 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [req-fb0c1853-f3ca-428e-900e-88bacd0a0613 req-0e4767b3-de0f-4717-8280-f329d2029886 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035171 Oct 13 13:18:08.577930 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 436/890] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 13:18:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 13 13:18:08.734757 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.virt.hardware [None req-1b545299-f1fc-44a1-80bb-551405bbd41f tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Flavor limits 0:0:0 {{(pid=118814) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 13 13:18:08.735235 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.virt.hardware [None req-1b545299-f1fc-44a1-80bb-551405bbd41f tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Image limits 0:0:0 {{(pid=118814) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 13 13:18:08.735769 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.virt.hardware [None req-1b545299-f1fc-44a1-80bb-551405bbd41f tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Flavor pref 0:0:0 {{(pid=118814) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 13 13:18:08.736206 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.virt.hardware [None req-1b545299-f1fc-44a1-80bb-551405bbd41f tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Image pref 0:0:0 {{(pid=118814) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 13 13:18:08.736621 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.virt.hardware [None req-1b545299-f1fc-44a1-80bb-551405bbd41f tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118814) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 13 13:18:08.746578 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-1b545299-f1fc-44a1-80bb-551405bbd41f tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:18:08.747080 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-1b545299-f1fc-44a1-80bb-551405bbd41f tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:18:08.747555 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-1b545299-f1fc-44a1-80bb-551405bbd41f tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:18:08.748286 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-1b545299-f1fc-44a1-80bb-551405bbd41f tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:18:08.748748 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-1b545299-f1fc-44a1-80bb-551405bbd41f tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:18:08.749175 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-1b545299-f1fc-44a1-80bb-551405bbd41f tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:18:08.765760 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.quota [None req-1b545299-f1fc-44a1-80bb-551405bbd41f tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Getting quotas for project 17e1654782ac4100b0353d561496db51. Resources: {'instances', 'cores', 'ram'} {{(pid=118814) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 13 13:18:08.770217 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.quota [None req-1b545299-f1fc-44a1-80bb-551405bbd41f tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Getting quotas for user cd005dcc25944dfc9aeda1eb1468a0ea and project 17e1654782ac4100b0353d561496db51. Resources: {'instances', 'cores', 'ram'} {{(pid=118814) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 13 13:18:08.830088 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-1b545299-f1fc-44a1-80bb-551405bbd41f tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Going to run 1 instances... {{(pid=118814) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 13 13:18:08.832821 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-1b545299-f1fc-44a1-80bb-551405bbd41f tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] [instance: ebf57cc9-d371-41c8-b3a4-82b67889d57d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='904d1ffc-67e2-4c0b-a0fe-8a1984528560',volume_size=None,volume_type=None)] {{(pid=118814) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 13 13:18:08.848835 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-fb827064-2d02-46c5-b31e-c5fe5d9bc7e6 tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Calling method '>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:18:08.849801 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-fb827064-2d02-46c5-b31e-c5fe5d9bc7e6 tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] [instance: 5c481e0e-37eb-4457-813e-eb8a84932582] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:18:08.856223 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-fb827064-2d02-46c5-b31e-c5fe5d9bc7e6 tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:18:08.856864 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-fb827064-2d02-46c5-b31e-c5fe5d9bc7e6 tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:18:08.857416 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-fb827064-2d02-46c5-b31e-c5fe5d9bc7e6 tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:18:08.858107 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-fb827064-2d02-46c5-b31e-c5fe5d9bc7e6 tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:18:08.858605 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-fb827064-2d02-46c5-b31e-c5fe5d9bc7e6 tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:18:08.859029 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-fb827064-2d02-46c5-b31e-c5fe5d9bc7e6 tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:18:08.969171 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-1b545299-f1fc-44a1-80bb-551405bbd41f tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.726788 Oct 13 13:18:08.969838 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 455/891] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Oct 13 13:18:08 2022] POST /compute/v2.1/servers => generated 406 bytes in 728 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 13 13:18:08.981242 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-5419bb3f-f35e-48cb-ac4e-84801f61242d tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Calling method '>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:18:08.981853 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-5419bb3f-f35e-48cb-ac4e-84801f61242d tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] [instance: ebf57cc9-d371-41c8-b3a4-82b67889d57d] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:18:09.006170 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-fb827064-2d02-46c5-b31e-c5fe5d9bc7e6 tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6723d3c8aa144452b46564649cf38ee3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aff81c38c17b4e82864854ceac6587df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:18:09.014355 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-fb827064-2d02-46c5-b31e-c5fe5d9bc7e6 tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] 10.222.0.23 "GET /compute/v2.1/servers/5c481e0e-37eb-4457-813e-eb8a84932582" status: 200 len: 1575 microversion: 2.1 time: 0.172159 Oct 13 13:18:09.014829 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 437/892] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:18:08 2022] GET /compute/v2.1/servers/5c481e0e-37eb-4457-813e-eb8a84932582 => generated 1575 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 13:18:09.035871 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-5419bb3f-f35e-48cb-ac4e-84801f61242d tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd005dcc25944dfc9aeda1eb1468a0ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e1654782ac4100b0353d561496db51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:18:09.042736 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-5419bb3f-f35e-48cb-ac4e-84801f61242d tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] 10.222.0.23 "GET /compute/v2.1/servers/ebf57cc9-d371-41c8-b3a4-82b67889d57d" status: 200 len: 1095 microversion: 2.1 time: 0.065170 Oct 13 13:18:09.043239 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 456/893] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:18:08 2022] GET /compute/v2.1/servers/ebf57cc9-d371-41c8-b3a4-82b67889d57d => generated 1095 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:18:10.037749 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-98407dc0-0f2e-46b3-9ef8-ee120b9d1eb9 tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Calling method '>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:18:10.038364 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-98407dc0-0f2e-46b3-9ef8-ee120b9d1eb9 tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] [instance: 5c481e0e-37eb-4457-813e-eb8a84932582] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:18:10.044775 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-98407dc0-0f2e-46b3-9ef8-ee120b9d1eb9 tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:18:10.045260 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-98407dc0-0f2e-46b3-9ef8-ee120b9d1eb9 tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:18:10.045698 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-98407dc0-0f2e-46b3-9ef8-ee120b9d1eb9 tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:18:10.046393 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-98407dc0-0f2e-46b3-9ef8-ee120b9d1eb9 tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:18:10.046851 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-98407dc0-0f2e-46b3-9ef8-ee120b9d1eb9 tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:18:10.047312 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-98407dc0-0f2e-46b3-9ef8-ee120b9d1eb9 tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:18:10.065042 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-281a9fa3-8c05-404d-aee8-bd6ff3d51dae tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Calling method '>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:18:10.065739 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-281a9fa3-8c05-404d-aee8-bd6ff3d51dae tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] [instance: ebf57cc9-d371-41c8-b3a4-82b67889d57d] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:18:10.072865 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-281a9fa3-8c05-404d-aee8-bd6ff3d51dae tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:18:10.073346 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-281a9fa3-8c05-404d-aee8-bd6ff3d51dae tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:18:10.073778 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-281a9fa3-8c05-404d-aee8-bd6ff3d51dae tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:18:10.074465 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-281a9fa3-8c05-404d-aee8-bd6ff3d51dae tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:18:10.074939 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-281a9fa3-8c05-404d-aee8-bd6ff3d51dae tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:18:10.075384 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-281a9fa3-8c05-404d-aee8-bd6ff3d51dae tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:18:10.140413 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-281a9fa3-8c05-404d-aee8-bd6ff3d51dae tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd005dcc25944dfc9aeda1eb1468a0ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e1654782ac4100b0353d561496db51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:18:10.148693 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-281a9fa3-8c05-404d-aee8-bd6ff3d51dae tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] 10.222.0.23 "GET /compute/v2.1/servers/ebf57cc9-d371-41c8-b3a4-82b67889d57d" status: 200 len: 1137 microversion: 2.1 time: 0.087484 Oct 13 13:18:10.149255 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 457/894] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:18:10 2022] GET /compute/v2.1/servers/ebf57cc9-d371-41c8-b3a4-82b67889d57d => generated 1137 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 13:18:10.200355 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-98407dc0-0f2e-46b3-9ef8-ee120b9d1eb9 tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6723d3c8aa144452b46564649cf38ee3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aff81c38c17b4e82864854ceac6587df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:18:10.208677 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-98407dc0-0f2e-46b3-9ef8-ee120b9d1eb9 tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] 10.222.0.23 "GET /compute/v2.1/servers/5c481e0e-37eb-4457-813e-eb8a84932582" status: 200 len: 1562 microversion: 2.1 time: 0.174828 Oct 13 13:18:10.209246 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 438/895] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:18:10 2022] GET /compute/v2.1/servers/5c481e0e-37eb-4457-813e-eb8a84932582 => generated 1562 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 13:18:11.051872 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-9c962dfd-b692-4aa6-bcbb-be20d71242db tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Action: 'create', calling method: .version_select at 0x7f5093c4daf0>, body: {"keypair": {"name": "tempest-keypair-2106463252", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJMeShnHTl6fYQ19/+XoXEwpVexPy0sK8at97DjiMvfIsK/TnKD3cMX/r/dLfDqWaGFX8nNAlZ8lAnPUzI7AoSaog/nk7Lhk+CANUSGH8POgPnJorA+0duZaxG9R86Ahmw=="}} {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 13:18:11.067437 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.quota [None req-9c962dfd-b692-4aa6-bcbb-be20d71242db tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Getting quotas for project da546353194342439f9bc3f98f6737e0. Resources: {'key_pairs'} {{(pid=118814) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 13 13:18:11.072014 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.quota [None req-9c962dfd-b692-4aa6-bcbb-be20d71242db tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Getting quotas for user 2cd12070eb954d6880f925957184a288 and project da546353194342439f9bc3f98f6737e0. Resources: {'key_pairs'} {{(pid=118814) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 13 13:18:11.097074 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-9c962dfd-b692-4aa6-bcbb-be20d71242db tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.049202 Oct 13 13:18:11.098738 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 458/896] 10.222.0.23 () {60 vars in 1159 bytes} [Thu Oct 13 13:18:11 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 13:18:11.172580 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-767fd925-4075-468b-9256-4cab85cb221f tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Calling method '>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:18:11.174040 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-767fd925-4075-468b-9256-4cab85cb221f tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] [instance: ebf57cc9-d371-41c8-b3a4-82b67889d57d] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:18:11.181310 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-767fd925-4075-468b-9256-4cab85cb221f tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:18:11.182091 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-767fd925-4075-468b-9256-4cab85cb221f tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:18:11.182544 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-767fd925-4075-468b-9256-4cab85cb221f tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:18:11.183514 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-767fd925-4075-468b-9256-4cab85cb221f tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:18:11.183974 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-767fd925-4075-468b-9256-4cab85cb221f tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:18:11.184590 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-767fd925-4075-468b-9256-4cab85cb221f tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:18:11.278243 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-767fd925-4075-468b-9256-4cab85cb221f tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd005dcc25944dfc9aeda1eb1468a0ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e1654782ac4100b0353d561496db51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:18:11.287440 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-767fd925-4075-468b-9256-4cab85cb221f tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] 10.222.0.23 "GET /compute/v2.1/servers/ebf57cc9-d371-41c8-b3a4-82b67889d57d" status: 200 len: 1211 microversion: 2.1 time: 0.119917 Oct 13 13:18:11.303639 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 439/897] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:18:11 2022] GET /compute/v2.1/servers/ebf57cc9-d371-41c8-b3a4-82b67889d57d => generated 1211 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:18:12.313696 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-51f72e64-3ec3-455d-9402-768a96cef41f tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Calling method '>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:18:12.314908 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-51f72e64-3ec3-455d-9402-768a96cef41f tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] [instance: ebf57cc9-d371-41c8-b3a4-82b67889d57d] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:18:12.322655 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-51f72e64-3ec3-455d-9402-768a96cef41f tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:18:12.323172 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-51f72e64-3ec3-455d-9402-768a96cef41f tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:18:12.323611 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-51f72e64-3ec3-455d-9402-768a96cef41f tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:18:12.324298 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-51f72e64-3ec3-455d-9402-768a96cef41f tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:18:12.325309 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-51f72e64-3ec3-455d-9402-768a96cef41f tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:18:12.325741 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-51f72e64-3ec3-455d-9402-768a96cef41f tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:18:12.394866 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [req-48f9e436-a2e6-4841-9db4-ab675c22a0b6 req-1023df1a-56de-49ef-96de-077ff06ce2a3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ebf57cc9-d371-41c8-b3a4-82b67889d57d", "tag": "de381234-2018-4c2f-93d9-84a4a3ab32c8"}]} {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 13:18:12.422933 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [req-48f9e436-a2e6-4841-9db4-ab675c22a0b6 req-1023df1a-56de-49ef-96de-077ff06ce2a3 service nova] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:18:12.423496 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [req-48f9e436-a2e6-4841-9db4-ab675c22a0b6 req-1023df1a-56de-49ef-96de-077ff06ce2a3 service nova] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:18:12.428870 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [req-48f9e436-a2e6-4841-9db4-ab675c22a0b6 req-1023df1a-56de-49ef-96de-077ff06ce2a3 service nova] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:18:12.451034 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.compute.server_external_events [req-48f9e436-a2e6-4841-9db4-ab675c22a0b6 req-1023df1a-56de-49ef-96de-077ff06ce2a3 service nova] Creating event network-changed:de381234-2018-4c2f-93d9-84a4a3ab32c8 for instance ebf57cc9-d371-41c8-b3a4-82b67889d57d on hv-cinder-82660 Oct 13 13:18:12.459655 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [req-48f9e436-a2e6-4841-9db4-ab675c22a0b6 req-1023df1a-56de-49ef-96de-077ff06ce2a3 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068774 Oct 13 13:18:12.460254 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 440/898] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 13:18:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 13:18:12.490065 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-51f72e64-3ec3-455d-9402-768a96cef41f tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd005dcc25944dfc9aeda1eb1468a0ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e1654782ac4100b0353d561496db51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:18:12.498114 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-51f72e64-3ec3-455d-9402-768a96cef41f tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] 10.222.0.23 "GET /compute/v2.1/servers/ebf57cc9-d371-41c8-b3a4-82b67889d57d" status: 200 len: 1267 microversion: 2.1 time: 0.189116 Oct 13 13:18:12.498680 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 459/899] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:18:12 2022] GET /compute/v2.1/servers/ebf57cc9-d371-41c8-b3a4-82b67889d57d => generated 1267 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:18:12.559408 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-69a58337-9821-4424-920f-72aad8466d04 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1818359895", "imageRef": "e2cdd20b-2540-48bc-a05c-d6a2e7e9a66e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "60c7ab31-db51-4574-8d4e-94d8596d64ad"}], "security_groups": [{"name": "tempest-securitygroup--974567388"}], "key_name": "tempest-keypair-2106463252", "user_data": "}} {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 13:18:12.664118 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.network.neutron [None req-69a58337-9821-4424-920f-72aad8466d04 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] validate_networks() for [('60c7ab31-db51-4574-8d4e-94d8596d64ad', None, None, None, None, None)] {{(pid=118815) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 13 13:18:13.035418 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.virt.hardware [None req-69a58337-9821-4424-920f-72aad8466d04 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Flavor limits 0:0:0 {{(pid=118815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 13 13:18:13.036251 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.virt.hardware [None req-69a58337-9821-4424-920f-72aad8466d04 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Image limits 0:0:0 {{(pid=118815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 13 13:18:13.036772 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.virt.hardware [None req-69a58337-9821-4424-920f-72aad8466d04 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Flavor pref 0:0:0 {{(pid=118815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 13 13:18:13.037254 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.virt.hardware [None req-69a58337-9821-4424-920f-72aad8466d04 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Image pref 0:0:0 {{(pid=118815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 13 13:18:13.037872 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.virt.hardware [None req-69a58337-9821-4424-920f-72aad8466d04 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 13 13:18:13.047315 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-69a58337-9821-4424-920f-72aad8466d04 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:18:13.048172 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-69a58337-9821-4424-920f-72aad8466d04 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:18:13.048604 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-69a58337-9821-4424-920f-72aad8466d04 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:18:13.049348 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-69a58337-9821-4424-920f-72aad8466d04 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:18:13.049804 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-69a58337-9821-4424-920f-72aad8466d04 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:18:13.050996 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-69a58337-9821-4424-920f-72aad8466d04 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:18:13.068130 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.quota [None req-69a58337-9821-4424-920f-72aad8466d04 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Getting quotas for project da546353194342439f9bc3f98f6737e0. Resources: {'instances', 'cores', 'ram'} {{(pid=118815) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 13 13:18:13.072196 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.quota [None req-69a58337-9821-4424-920f-72aad8466d04 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Getting quotas for user 2cd12070eb954d6880f925957184a288 and project da546353194342439f9bc3f98f6737e0. Resources: {'instances', 'cores', 'ram'} {{(pid=118815) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 13 13:18:13.083109 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-69a58337-9821-4424-920f-72aad8466d04 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Going to run 1 instances... {{(pid=118815) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 13 13:18:13.085497 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-69a58337-9821-4424-920f-72aad8466d04 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] [instance: b18f33d7-defb-4cea-9e29-20d49213f35c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e2cdd20b-2540-48bc-a05c-d6a2e7e9a66e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118815) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 13 13:18:13.132996 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-69a58337-9821-4424-920f-72aad8466d04 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.578247 Oct 13 13:18:13.133804 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 441/900] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Oct 13 13:18:12 2022] POST /compute/v2.1/servers => generated 401 bytes in 580 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 13 13:18:13.144838 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-94b50abb-ba39-4eb3-937f-f4c008283a36 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Calling method '>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:18:13.145719 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-94b50abb-ba39-4eb3-937f-f4c008283a36 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] [instance: b18f33d7-defb-4cea-9e29-20d49213f35c] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:18:13.211042 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-94b50abb-ba39-4eb3-937f-f4c008283a36 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd12070eb954d6880f925957184a288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da546353194342439f9bc3f98f6737e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:18:13.218664 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-94b50abb-ba39-4eb3-937f-f4c008283a36 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] 10.222.0.23 "GET /compute/v2.1/servers/b18f33d7-defb-4cea-9e29-20d49213f35c" status: 200 len: 1242 microversion: 2.1 time: 0.077659 Oct 13 13:18:13.226074 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 460/901] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:18:13 2022] GET /compute/v2.1/servers/b18f33d7-defb-4cea-9e29-20d49213f35c => generated 1242 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:18:13.521457 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-7178b9c6-3771-4243-8154-a4cdcefbc25a tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Calling method '>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:18:13.522080 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-7178b9c6-3771-4243-8154-a4cdcefbc25a tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] [instance: ebf57cc9-d371-41c8-b3a4-82b67889d57d] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:18:13.529446 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-7178b9c6-3771-4243-8154-a4cdcefbc25a tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:18:13.529879 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-7178b9c6-3771-4243-8154-a4cdcefbc25a tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:18:13.530930 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-7178b9c6-3771-4243-8154-a4cdcefbc25a tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:18:13.531710 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-7178b9c6-3771-4243-8154-a4cdcefbc25a tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:18:13.532263 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-7178b9c6-3771-4243-8154-a4cdcefbc25a tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:18:13.532708 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-7178b9c6-3771-4243-8154-a4cdcefbc25a tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:18:13.666452 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-7178b9c6-3771-4243-8154-a4cdcefbc25a tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd005dcc25944dfc9aeda1eb1468a0ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e1654782ac4100b0353d561496db51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:18:13.674696 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-7178b9c6-3771-4243-8154-a4cdcefbc25a tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] 10.222.0.23 "GET /compute/v2.1/servers/ebf57cc9-d371-41c8-b3a4-82b67889d57d" status: 200 len: 1267 microversion: 2.1 time: 0.157716 Oct 13 13:18:13.675891 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 442/902] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:18:13 2022] GET /compute/v2.1/servers/ebf57cc9-d371-41c8-b3a4-82b67889d57d => generated 1267 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:18:14.241996 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-38b322b8-ea98-4b45-9ad0-615d63e035b4 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Calling method '>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:18:14.242618 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-38b322b8-ea98-4b45-9ad0-615d63e035b4 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] [instance: b18f33d7-defb-4cea-9e29-20d49213f35c] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:18:14.249288 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-38b322b8-ea98-4b45-9ad0-615d63e035b4 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:18:14.250001 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-38b322b8-ea98-4b45-9ad0-615d63e035b4 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:18:14.250473 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-38b322b8-ea98-4b45-9ad0-615d63e035b4 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:18:14.251200 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-38b322b8-ea98-4b45-9ad0-615d63e035b4 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:18:14.251660 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-38b322b8-ea98-4b45-9ad0-615d63e035b4 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:18:14.252088 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-38b322b8-ea98-4b45-9ad0-615d63e035b4 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:18:14.318773 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-38b322b8-ea98-4b45-9ad0-615d63e035b4 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd12070eb954d6880f925957184a288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da546353194342439f9bc3f98f6737e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:18:14.328347 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-38b322b8-ea98-4b45-9ad0-615d63e035b4 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] 10.222.0.23 "GET /compute/v2.1/servers/b18f33d7-defb-4cea-9e29-20d49213f35c" status: 200 len: 1312 microversion: 2.1 time: 0.090437 Oct 13 13:18:14.329271 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 461/903] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:18:14 2022] GET /compute/v2.1/servers/b18f33d7-defb-4cea-9e29-20d49213f35c => generated 1312 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:18:14.698410 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-6887f8ee-2d09-44c1-94cc-d673933ed96d tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Calling method '>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:18:14.699014 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-6887f8ee-2d09-44c1-94cc-d673933ed96d tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] [instance: ebf57cc9-d371-41c8-b3a4-82b67889d57d] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:18:14.705593 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-6887f8ee-2d09-44c1-94cc-d673933ed96d tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:18:14.706073 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-6887f8ee-2d09-44c1-94cc-d673933ed96d tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:18:14.707101 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-6887f8ee-2d09-44c1-94cc-d673933ed96d tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:18:14.707814 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-6887f8ee-2d09-44c1-94cc-d673933ed96d tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:18:14.708266 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-6887f8ee-2d09-44c1-94cc-d673933ed96d tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:18:14.708685 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-6887f8ee-2d09-44c1-94cc-d673933ed96d tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:18:14.842216 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-6887f8ee-2d09-44c1-94cc-d673933ed96d tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd005dcc25944dfc9aeda1eb1468a0ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e1654782ac4100b0353d561496db51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:18:14.856396 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-6887f8ee-2d09-44c1-94cc-d673933ed96d tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] 10.222.0.23 "GET /compute/v2.1/servers/ebf57cc9-d371-41c8-b3a4-82b67889d57d" status: 200 len: 1267 microversion: 2.1 time: 0.161615 Oct 13 13:18:14.857064 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 443/904] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:18:14 2022] GET /compute/v2.1/servers/ebf57cc9-d371-41c8-b3a4-82b67889d57d => generated 1267 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:18:15.352437 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-9a52ad63-7696-4359-ade6-771462dad5c2 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Calling method '>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:18:15.353176 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-9a52ad63-7696-4359-ade6-771462dad5c2 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] [instance: b18f33d7-defb-4cea-9e29-20d49213f35c] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:18:15.359566 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-9a52ad63-7696-4359-ade6-771462dad5c2 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:18:15.360051 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-9a52ad63-7696-4359-ade6-771462dad5c2 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:18:15.360493 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-9a52ad63-7696-4359-ade6-771462dad5c2 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:18:15.361178 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-9a52ad63-7696-4359-ade6-771462dad5c2 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:18:15.361667 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-9a52ad63-7696-4359-ade6-771462dad5c2 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:18:15.362093 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-9a52ad63-7696-4359-ade6-771462dad5c2 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:18:15.499205 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-9a52ad63-7696-4359-ade6-771462dad5c2 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd12070eb954d6880f925957184a288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da546353194342439f9bc3f98f6737e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:18:15.506775 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-9a52ad63-7696-4359-ade6-771462dad5c2 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] 10.222.0.23 "GET /compute/v2.1/servers/b18f33d7-defb-4cea-9e29-20d49213f35c" status: 200 len: 1367 microversion: 2.1 time: 0.158333 Oct 13 13:18:15.507379 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 462/905] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:18:15 2022] GET /compute/v2.1/servers/b18f33d7-defb-4cea-9e29-20d49213f35c => generated 1367 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:18:15.590468 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [req-f9234dde-ebd6-4fc3-8f73-8087759fa00b req-364083d3-b5fa-4fc9-9775-a01611ecb6aa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b18f33d7-defb-4cea-9e29-20d49213f35c", "tag": "47f769d3-bbeb-4693-bf62-e39b171194ca"}]} {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 13:18:15.600960 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [req-f9234dde-ebd6-4fc3-8f73-8087759fa00b req-364083d3-b5fa-4fc9-9775-a01611ecb6aa service nova] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:18:15.601540 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [req-f9234dde-ebd6-4fc3-8f73-8087759fa00b req-364083d3-b5fa-4fc9-9775-a01611ecb6aa service nova] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:18:15.602060 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [req-f9234dde-ebd6-4fc3-8f73-8087759fa00b req-364083d3-b5fa-4fc9-9775-a01611ecb6aa service nova] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:18:15.613225 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.compute.server_external_events [req-f9234dde-ebd6-4fc3-8f73-8087759fa00b req-364083d3-b5fa-4fc9-9775-a01611ecb6aa service nova] Creating event network-changed:47f769d3-bbeb-4693-bf62-e39b171194ca for instance b18f33d7-defb-4cea-9e29-20d49213f35c on hv-cinder-82660 Oct 13 13:18:15.618523 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [req-f9234dde-ebd6-4fc3-8f73-8087759fa00b req-364083d3-b5fa-4fc9-9775-a01611ecb6aa service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032372 Oct 13 13:18:15.619158 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 444/906] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 13:18:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 13 13:18:15.879566 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-f43620bd-cd28-460a-b9a8-73c0f69bc523 tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Calling method '>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:18:15.880102 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-f43620bd-cd28-460a-b9a8-73c0f69bc523 tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] [instance: ebf57cc9-d371-41c8-b3a4-82b67889d57d] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:18:15.886281 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-f43620bd-cd28-460a-b9a8-73c0f69bc523 tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:18:15.886766 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-f43620bd-cd28-460a-b9a8-73c0f69bc523 tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:18:15.887248 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-f43620bd-cd28-460a-b9a8-73c0f69bc523 tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:18:15.888076 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-f43620bd-cd28-460a-b9a8-73c0f69bc523 tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:18:15.888535 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-f43620bd-cd28-460a-b9a8-73c0f69bc523 tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:18:15.888993 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-f43620bd-cd28-460a-b9a8-73c0f69bc523 tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:18:16.023448 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-f43620bd-cd28-460a-b9a8-73c0f69bc523 tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd005dcc25944dfc9aeda1eb1468a0ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e1654782ac4100b0353d561496db51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:18:16.031228 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-f43620bd-cd28-460a-b9a8-73c0f69bc523 tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] 10.222.0.23 "GET /compute/v2.1/servers/ebf57cc9-d371-41c8-b3a4-82b67889d57d" status: 200 len: 1267 microversion: 2.1 time: 0.156568 Oct 13 13:18:16.031782 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 463/907] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:18:15 2022] GET /compute/v2.1/servers/ebf57cc9-d371-41c8-b3a4-82b67889d57d => generated 1267 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:18:16.530793 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-9d99b3b2-b10f-41f3-b4a1-e4dac3b6741e tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Calling method '>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:18:16.531518 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-9d99b3b2-b10f-41f3-b4a1-e4dac3b6741e tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] [instance: b18f33d7-defb-4cea-9e29-20d49213f35c] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:18:16.538260 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-9d99b3b2-b10f-41f3-b4a1-e4dac3b6741e tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:18:16.538743 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-9d99b3b2-b10f-41f3-b4a1-e4dac3b6741e tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:18:16.539217 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-9d99b3b2-b10f-41f3-b4a1-e4dac3b6741e tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:18:16.539907 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-9d99b3b2-b10f-41f3-b4a1-e4dac3b6741e tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:18:16.540361 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-9d99b3b2-b10f-41f3-b4a1-e4dac3b6741e tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:18:16.540788 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-9d99b3b2-b10f-41f3-b4a1-e4dac3b6741e tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:18:16.668197 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-9d99b3b2-b10f-41f3-b4a1-e4dac3b6741e tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd12070eb954d6880f925957184a288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da546353194342439f9bc3f98f6737e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:18:16.676182 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-9d99b3b2-b10f-41f3-b4a1-e4dac3b6741e tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] 10.222.0.23 "GET /compute/v2.1/servers/b18f33d7-defb-4cea-9e29-20d49213f35c" status: 200 len: 1367 microversion: 2.1 time: 0.150113 Oct 13 13:18:16.676746 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 445/908] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:18:16 2022] GET /compute/v2.1/servers/b18f33d7-defb-4cea-9e29-20d49213f35c => generated 1367 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:18:17.056998 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-2b75f710-69f1-4dc6-8069-045ab65cb446 tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Calling method '>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:18:17.058187 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-2b75f710-69f1-4dc6-8069-045ab65cb446 tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] [instance: ebf57cc9-d371-41c8-b3a4-82b67889d57d] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:18:17.064911 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-2b75f710-69f1-4dc6-8069-045ab65cb446 tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:18:17.065480 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-2b75f710-69f1-4dc6-8069-045ab65cb446 tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:18:17.066804 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-2b75f710-69f1-4dc6-8069-045ab65cb446 tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:18:17.067567 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-2b75f710-69f1-4dc6-8069-045ab65cb446 tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:18:17.068020 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-2b75f710-69f1-4dc6-8069-045ab65cb446 tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:18:17.068498 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-2b75f710-69f1-4dc6-8069-045ab65cb446 tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:18:17.202779 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-2b75f710-69f1-4dc6-8069-045ab65cb446 tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd005dcc25944dfc9aeda1eb1468a0ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e1654782ac4100b0353d561496db51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:18:17.211416 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-2b75f710-69f1-4dc6-8069-045ab65cb446 tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] 10.222.0.23 "GET /compute/v2.1/servers/ebf57cc9-d371-41c8-b3a4-82b67889d57d" status: 200 len: 1267 microversion: 2.1 time: 0.158291 Oct 13 13:18:17.212320 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 464/909] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:18:17 2022] GET /compute/v2.1/servers/ebf57cc9-d371-41c8-b3a4-82b67889d57d => generated 1267 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:18:17.700318 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-fb736be6-417b-4d4e-bbdc-a9e11fe2eb9b tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Calling method '>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:18:17.700981 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-fb736be6-417b-4d4e-bbdc-a9e11fe2eb9b tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] [instance: b18f33d7-defb-4cea-9e29-20d49213f35c] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:18:17.707948 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-fb736be6-417b-4d4e-bbdc-a9e11fe2eb9b tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:18:17.708431 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-fb736be6-417b-4d4e-bbdc-a9e11fe2eb9b tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:18:17.708868 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-fb736be6-417b-4d4e-bbdc-a9e11fe2eb9b tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:18:17.709553 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-fb736be6-417b-4d4e-bbdc-a9e11fe2eb9b tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:18:17.710018 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-fb736be6-417b-4d4e-bbdc-a9e11fe2eb9b tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:18:17.710442 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-fb736be6-417b-4d4e-bbdc-a9e11fe2eb9b tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:18:17.834882 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-fb736be6-417b-4d4e-bbdc-a9e11fe2eb9b tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd12070eb954d6880f925957184a288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da546353194342439f9bc3f98f6737e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:18:17.842505 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-fb736be6-417b-4d4e-bbdc-a9e11fe2eb9b tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] 10.222.0.23 "GET /compute/v2.1/servers/b18f33d7-defb-4cea-9e29-20d49213f35c" status: 200 len: 1367 microversion: 2.1 time: 0.146211 Oct 13 13:18:17.843080 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 446/910] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:18:17 2022] GET /compute/v2.1/servers/b18f33d7-defb-4cea-9e29-20d49213f35c => generated 1367 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:18:18.233883 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-b46988e5-1885-4ae7-b4a2-520b57c575a7 tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Calling method '>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:18:18.234484 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-b46988e5-1885-4ae7-b4a2-520b57c575a7 tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] [instance: ebf57cc9-d371-41c8-b3a4-82b67889d57d] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:18:18.241356 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-b46988e5-1885-4ae7-b4a2-520b57c575a7 tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:18:18.241834 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-b46988e5-1885-4ae7-b4a2-520b57c575a7 tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:18:18.242264 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-b46988e5-1885-4ae7-b4a2-520b57c575a7 tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:18:18.242940 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-b46988e5-1885-4ae7-b4a2-520b57c575a7 tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:18:18.243423 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-b46988e5-1885-4ae7-b4a2-520b57c575a7 tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:18:18.243848 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-b46988e5-1885-4ae7-b4a2-520b57c575a7 tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:18:18.369024 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-b46988e5-1885-4ae7-b4a2-520b57c575a7 tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd005dcc25944dfc9aeda1eb1468a0ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e1654782ac4100b0353d561496db51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:18:18.376582 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-b46988e5-1885-4ae7-b4a2-520b57c575a7 tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] 10.222.0.23 "GET /compute/v2.1/servers/ebf57cc9-d371-41c8-b3a4-82b67889d57d" status: 200 len: 1267 microversion: 2.1 time: 0.146755 Oct 13 13:18:18.377138 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 465/911] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:18:18 2022] GET /compute/v2.1/servers/ebf57cc9-d371-41c8-b3a4-82b67889d57d => generated 1267 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:18:18.865067 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-cf05c330-869e-4300-a0fd-aa7ab7ccc958 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Calling method '>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:18:18.865682 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-cf05c330-869e-4300-a0fd-aa7ab7ccc958 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] [instance: b18f33d7-defb-4cea-9e29-20d49213f35c] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:18:18.872196 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-cf05c330-869e-4300-a0fd-aa7ab7ccc958 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:18:18.872684 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-cf05c330-869e-4300-a0fd-aa7ab7ccc958 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:18:18.873121 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-cf05c330-869e-4300-a0fd-aa7ab7ccc958 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:18:18.873813 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-cf05c330-869e-4300-a0fd-aa7ab7ccc958 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:18:18.874267 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-cf05c330-869e-4300-a0fd-aa7ab7ccc958 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:18:18.874691 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-cf05c330-869e-4300-a0fd-aa7ab7ccc958 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:18:19.005204 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-cf05c330-869e-4300-a0fd-aa7ab7ccc958 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd12070eb954d6880f925957184a288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da546353194342439f9bc3f98f6737e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:18:19.012781 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-cf05c330-869e-4300-a0fd-aa7ab7ccc958 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] 10.222.0.23 "GET /compute/v2.1/servers/b18f33d7-defb-4cea-9e29-20d49213f35c" status: 200 len: 1367 microversion: 2.1 time: 0.151697 Oct 13 13:18:19.013339 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 447/912] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:18:18 2022] GET /compute/v2.1/servers/b18f33d7-defb-4cea-9e29-20d49213f35c => generated 1367 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:18:19.399227 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-3ddddbf4-da34-499a-b8ac-47cee6d7402c tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Calling method '>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:18:19.399891 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-3ddddbf4-da34-499a-b8ac-47cee6d7402c tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] [instance: ebf57cc9-d371-41c8-b3a4-82b67889d57d] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:18:19.401686 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG dbcounter [-] [118814] Writing DB stats nova_cell0:SELECT=2 {{(pid=118814) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:18:19.407466 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-3ddddbf4-da34-499a-b8ac-47cee6d7402c tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:18:19.407943 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-3ddddbf4-da34-499a-b8ac-47cee6d7402c tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:18:19.408373 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-3ddddbf4-da34-499a-b8ac-47cee6d7402c tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:18:19.409047 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-3ddddbf4-da34-499a-b8ac-47cee6d7402c tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:18:19.409496 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-3ddddbf4-da34-499a-b8ac-47cee6d7402c tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:18:19.409916 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-3ddddbf4-da34-499a-b8ac-47cee6d7402c tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:18:19.536876 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-3ddddbf4-da34-499a-b8ac-47cee6d7402c tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd005dcc25944dfc9aeda1eb1468a0ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e1654782ac4100b0353d561496db51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:18:19.544387 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-3ddddbf4-da34-499a-b8ac-47cee6d7402c tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] 10.222.0.23 "GET /compute/v2.1/servers/ebf57cc9-d371-41c8-b3a4-82b67889d57d" status: 200 len: 1267 microversion: 2.1 time: 0.149054 Oct 13 13:18:19.544941 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 466/913] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:18:19 2022] GET /compute/v2.1/servers/ebf57cc9-d371-41c8-b3a4-82b67889d57d => generated 1267 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:18:20.036620 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-f966c6fe-2ef1-4b86-b2ef-9870f32033cb tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Calling method '>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:18:20.037235 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-f966c6fe-2ef1-4b86-b2ef-9870f32033cb tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] [instance: b18f33d7-defb-4cea-9e29-20d49213f35c] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:18:20.043722 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-f966c6fe-2ef1-4b86-b2ef-9870f32033cb tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:18:20.044210 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-f966c6fe-2ef1-4b86-b2ef-9870f32033cb tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:18:20.044652 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-f966c6fe-2ef1-4b86-b2ef-9870f32033cb tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:18:20.045342 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-f966c6fe-2ef1-4b86-b2ef-9870f32033cb tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:18:20.045803 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-f966c6fe-2ef1-4b86-b2ef-9870f32033cb tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:18:20.046255 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-f966c6fe-2ef1-4b86-b2ef-9870f32033cb tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:18:20.175690 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-f966c6fe-2ef1-4b86-b2ef-9870f32033cb tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd12070eb954d6880f925957184a288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da546353194342439f9bc3f98f6737e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:18:20.183300 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-f966c6fe-2ef1-4b86-b2ef-9870f32033cb tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] 10.222.0.23 "GET /compute/v2.1/servers/b18f33d7-defb-4cea-9e29-20d49213f35c" status: 200 len: 1367 microversion: 2.1 time: 0.151234 Oct 13 13:18:20.183867 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 448/914] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:18:20 2022] GET /compute/v2.1/servers/b18f33d7-defb-4cea-9e29-20d49213f35c => generated 1367 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:18:20.567751 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-5a3d827c-a0c3-4749-b64c-f8bb70c34354 tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Calling method '>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:18:20.568482 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-5a3d827c-a0c3-4749-b64c-f8bb70c34354 tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] [instance: ebf57cc9-d371-41c8-b3a4-82b67889d57d] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:18:20.575371 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-5a3d827c-a0c3-4749-b64c-f8bb70c34354 tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:18:20.576071 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-5a3d827c-a0c3-4749-b64c-f8bb70c34354 tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:18:20.576517 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-5a3d827c-a0c3-4749-b64c-f8bb70c34354 tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:18:20.577209 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-5a3d827c-a0c3-4749-b64c-f8bb70c34354 tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:18:20.577667 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-5a3d827c-a0c3-4749-b64c-f8bb70c34354 tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:18:20.578112 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-5a3d827c-a0c3-4749-b64c-f8bb70c34354 tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:18:20.710049 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-5a3d827c-a0c3-4749-b64c-f8bb70c34354 tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd005dcc25944dfc9aeda1eb1468a0ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e1654782ac4100b0353d561496db51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:18:20.717872 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-5a3d827c-a0c3-4749-b64c-f8bb70c34354 tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] 10.222.0.23 "GET /compute/v2.1/servers/ebf57cc9-d371-41c8-b3a4-82b67889d57d" status: 200 len: 1267 microversion: 2.1 time: 0.154588 Oct 13 13:18:20.718433 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 467/915] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:18:20 2022] GET /compute/v2.1/servers/ebf57cc9-d371-41c8-b3a4-82b67889d57d => generated 1267 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:18:20.738609 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [req-19c97523-78c7-4e73-9657-cd90b008dae9 req-50695b42-92d9-4b90-90c6-71867b1f7af9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b18f33d7-defb-4cea-9e29-20d49213f35c", "name": "network-vif-plugged", "status": "completed", "tag": "47f769d3-bbeb-4693-bf62-e39b171194ca"}]} {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 13:18:20.747964 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [req-19c97523-78c7-4e73-9657-cd90b008dae9 req-50695b42-92d9-4b90-90c6-71867b1f7af9 service nova] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:18:20.748444 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [req-19c97523-78c7-4e73-9657-cd90b008dae9 req-50695b42-92d9-4b90-90c6-71867b1f7af9 service nova] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:18:20.748871 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [req-19c97523-78c7-4e73-9657-cd90b008dae9 req-50695b42-92d9-4b90-90c6-71867b1f7af9 service nova] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:18:20.760714 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.compute.server_external_events [req-19c97523-78c7-4e73-9657-cd90b008dae9 req-50695b42-92d9-4b90-90c6-71867b1f7af9 service nova] Creating event network-vif-plugged:47f769d3-bbeb-4693-bf62-e39b171194ca for instance b18f33d7-defb-4cea-9e29-20d49213f35c on hv-cinder-82660 Oct 13 13:18:20.765117 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [req-19c97523-78c7-4e73-9657-cd90b008dae9 req-50695b42-92d9-4b90-90c6-71867b1f7af9 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030155 Oct 13 13:18:20.765708 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 449/916] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 13:18:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 13 13:18:21.206164 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-ea0bd045-1c2a-4dda-8ab5-ebec5af411cb tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Calling method '>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:18:21.207030 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-ea0bd045-1c2a-4dda-8ab5-ebec5af411cb tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] [instance: b18f33d7-defb-4cea-9e29-20d49213f35c] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:18:21.213481 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-ea0bd045-1c2a-4dda-8ab5-ebec5af411cb tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:18:21.213674 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-ea0bd045-1c2a-4dda-8ab5-ebec5af411cb tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:18:21.214056 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-ea0bd045-1c2a-4dda-8ab5-ebec5af411cb tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:18:21.214946 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-ea0bd045-1c2a-4dda-8ab5-ebec5af411cb tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:18:21.215593 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-ea0bd045-1c2a-4dda-8ab5-ebec5af411cb tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:18:21.216035 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-ea0bd045-1c2a-4dda-8ab5-ebec5af411cb tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:18:21.346100 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-ea0bd045-1c2a-4dda-8ab5-ebec5af411cb tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd12070eb954d6880f925957184a288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da546353194342439f9bc3f98f6737e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:18:21.354305 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-ea0bd045-1c2a-4dda-8ab5-ebec5af411cb tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] 10.222.0.23 "GET /compute/v2.1/servers/b18f33d7-defb-4cea-9e29-20d49213f35c" status: 200 len: 1367 microversion: 2.1 time: 0.152361 Oct 13 13:18:21.354864 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 468/917] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:18:21 2022] GET /compute/v2.1/servers/b18f33d7-defb-4cea-9e29-20d49213f35c => generated 1367 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:18:21.740657 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-aa2831d2-00ff-4215-8aea-5f94708b174e tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Calling method '>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:18:21.741358 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-aa2831d2-00ff-4215-8aea-5f94708b174e tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] [instance: ebf57cc9-d371-41c8-b3a4-82b67889d57d] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:18:21.747547 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-aa2831d2-00ff-4215-8aea-5f94708b174e tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:18:21.748061 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-aa2831d2-00ff-4215-8aea-5f94708b174e tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:18:21.748530 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-aa2831d2-00ff-4215-8aea-5f94708b174e tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:18:21.749220 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-aa2831d2-00ff-4215-8aea-5f94708b174e tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:18:21.749687 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-aa2831d2-00ff-4215-8aea-5f94708b174e tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:18:21.750117 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-aa2831d2-00ff-4215-8aea-5f94708b174e tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:18:21.879890 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-aa2831d2-00ff-4215-8aea-5f94708b174e tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd005dcc25944dfc9aeda1eb1468a0ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e1654782ac4100b0353d561496db51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:18:21.887512 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-aa2831d2-00ff-4215-8aea-5f94708b174e tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] 10.222.0.23 "GET /compute/v2.1/servers/ebf57cc9-d371-41c8-b3a4-82b67889d57d" status: 200 len: 1267 microversion: 2.1 time: 0.151536 Oct 13 13:18:21.888077 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 450/918] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:18:21 2022] GET /compute/v2.1/servers/ebf57cc9-d371-41c8-b3a4-82b67889d57d => generated 1267 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:18:22.377597 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-1b32b2ac-c4ff-4033-aa1a-7cdce6bd6c05 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Calling method '>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:18:22.378862 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-1b32b2ac-c4ff-4033-aa1a-7cdce6bd6c05 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] [instance: b18f33d7-defb-4cea-9e29-20d49213f35c] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:18:22.385344 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-1b32b2ac-c4ff-4033-aa1a-7cdce6bd6c05 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:18:22.385827 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-1b32b2ac-c4ff-4033-aa1a-7cdce6bd6c05 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:18:22.386266 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-1b32b2ac-c4ff-4033-aa1a-7cdce6bd6c05 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:18:22.386953 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-1b32b2ac-c4ff-4033-aa1a-7cdce6bd6c05 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:18:22.387441 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-1b32b2ac-c4ff-4033-aa1a-7cdce6bd6c05 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:18:22.387865 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-1b32b2ac-c4ff-4033-aa1a-7cdce6bd6c05 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:18:22.515873 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-1b32b2ac-c4ff-4033-aa1a-7cdce6bd6c05 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd12070eb954d6880f925957184a288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da546353194342439f9bc3f98f6737e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:18:22.519325 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG dbcounter [-] [118814] Writing DB stats nova_cell1:SELECT=100 {{(pid=118814) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:18:22.524817 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-1b32b2ac-c4ff-4033-aa1a-7cdce6bd6c05 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] 10.222.0.23 "GET /compute/v2.1/servers/b18f33d7-defb-4cea-9e29-20d49213f35c" status: 200 len: 1558 microversion: 2.1 time: 0.151053 Oct 13 13:18:22.525384 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 469/919] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:18:22 2022] GET /compute/v2.1/servers/b18f33d7-defb-4cea-9e29-20d49213f35c => generated 1558 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:18:22.548732 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-0869a925-dc8e-4f56-a9cf-50a628f13159 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Calling method '>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:18:22.549282 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-0869a925-dc8e-4f56-a9cf-50a628f13159 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] [instance: b18f33d7-defb-4cea-9e29-20d49213f35c] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:18:22.556010 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-0869a925-dc8e-4f56-a9cf-50a628f13159 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:18:22.556499 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-0869a925-dc8e-4f56-a9cf-50a628f13159 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:18:22.556932 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-0869a925-dc8e-4f56-a9cf-50a628f13159 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:18:22.557631 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-0869a925-dc8e-4f56-a9cf-50a628f13159 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:18:22.558084 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-0869a925-dc8e-4f56-a9cf-50a628f13159 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:18:22.558510 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-0869a925-dc8e-4f56-a9cf-50a628f13159 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:18:22.642659 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-0869a925-dc8e-4f56-a9cf-50a628f13159 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] 10.222.0.23 "GET /compute/v2.1/servers/b18f33d7-defb-4cea-9e29-20d49213f35c/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.098512 Oct 13 13:18:22.643294 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 451/920] 10.222.0.23 () {58 vars in 1275 bytes} [Thu Oct 13 13:18:22 2022] GET /compute/v2.1/servers/b18f33d7-defb-4cea-9e29-20d49213f35c/os-interface => generated 285 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 13:18:22.799914 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [req-676681b0-1058-4c11-871e-5b0d4c88c1c2 req-eece20ea-5b3c-4f5a-b3f6-b95094e51df7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ebf57cc9-d371-41c8-b3a4-82b67889d57d", "name": "network-vif-plugged", "status": "completed", "tag": "de381234-2018-4c2f-93d9-84a4a3ab32c8"}]} {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 13:18:22.810428 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [req-676681b0-1058-4c11-871e-5b0d4c88c1c2 req-eece20ea-5b3c-4f5a-b3f6-b95094e51df7 service nova] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:18:22.811035 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [req-676681b0-1058-4c11-871e-5b0d4c88c1c2 req-eece20ea-5b3c-4f5a-b3f6-b95094e51df7 service nova] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:18:22.811600 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [req-676681b0-1058-4c11-871e-5b0d4c88c1c2 req-eece20ea-5b3c-4f5a-b3f6-b95094e51df7 service nova] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:18:22.823780 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.compute.server_external_events [req-676681b0-1058-4c11-871e-5b0d4c88c1c2 req-eece20ea-5b3c-4f5a-b3f6-b95094e51df7 service nova] Creating event network-vif-plugged:de381234-2018-4c2f-93d9-84a4a3ab32c8 for instance ebf57cc9-d371-41c8-b3a4-82b67889d57d on hv-cinder-82660 Oct 13 13:18:22.829598 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [req-676681b0-1058-4c11-871e-5b0d4c88c1c2 req-eece20ea-5b3c-4f5a-b3f6-b95094e51df7 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033353 Oct 13 13:18:22.830715 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 470/921] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 13:18:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 13:18:22.912526 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-39a41f5f-b34e-4df1-bfe9-8257d563513a tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Calling method '>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:18:22.912915 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-39a41f5f-b34e-4df1-bfe9-8257d563513a tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] [instance: ebf57cc9-d371-41c8-b3a4-82b67889d57d] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:18:22.918982 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-39a41f5f-b34e-4df1-bfe9-8257d563513a tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:18:22.919574 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-39a41f5f-b34e-4df1-bfe9-8257d563513a tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:18:22.920084 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-39a41f5f-b34e-4df1-bfe9-8257d563513a tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:18:22.920790 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-39a41f5f-b34e-4df1-bfe9-8257d563513a tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:18:22.921246 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-39a41f5f-b34e-4df1-bfe9-8257d563513a tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:18:22.921678 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-39a41f5f-b34e-4df1-bfe9-8257d563513a tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:18:23.057752 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG dbcounter [-] [118815] Writing DB stats nova_cell0:SELECT=2 {{(pid=118815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:18:23.078311 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG dbcounter [-] [118815] Writing DB stats nova_cell0:SELECT=6 {{(pid=118815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:18:23.146110 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-39a41f5f-b34e-4df1-bfe9-8257d563513a tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd005dcc25944dfc9aeda1eb1468a0ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e1654782ac4100b0353d561496db51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:18:23.154043 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-39a41f5f-b34e-4df1-bfe9-8257d563513a tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] 10.222.0.23 "GET /compute/v2.1/servers/ebf57cc9-d371-41c8-b3a4-82b67889d57d" status: 200 len: 1267 microversion: 2.1 time: 0.246922 Oct 13 13:18:23.169684 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 452/922] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:18:22 2022] GET /compute/v2.1/servers/ebf57cc9-d371-41c8-b3a4-82b67889d57d => generated 1267 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:18:23.896298 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG dbcounter [-] [118814] Writing DB stats nova_cell0:SELECT=14 {{(pid=118814) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:18:23.900961 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [req-0acd196a-3ce0-40aa-b43c-7775084d2aff req-38d9bce7-f5a0-495c-ab2c-f003ef0d6b30 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b18f33d7-defb-4cea-9e29-20d49213f35c", "tag": "47f769d3-bbeb-4693-bf62-e39b171194ca"}]} {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 13:18:23.911282 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [req-0acd196a-3ce0-40aa-b43c-7775084d2aff req-38d9bce7-f5a0-495c-ab2c-f003ef0d6b30 service nova] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:18:23.911758 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [req-0acd196a-3ce0-40aa-b43c-7775084d2aff req-38d9bce7-f5a0-495c-ab2c-f003ef0d6b30 service nova] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:18:23.912180 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [req-0acd196a-3ce0-40aa-b43c-7775084d2aff req-38d9bce7-f5a0-495c-ab2c-f003ef0d6b30 service nova] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:18:23.923764 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.compute.server_external_events [req-0acd196a-3ce0-40aa-b43c-7775084d2aff req-38d9bce7-f5a0-495c-ab2c-f003ef0d6b30 service nova] Creating event network-changed:47f769d3-bbeb-4693-bf62-e39b171194ca for instance b18f33d7-defb-4cea-9e29-20d49213f35c on hv-cinder-82660 Oct 13 13:18:23.928476 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [req-0acd196a-3ce0-40aa-b43c-7775084d2aff req-38d9bce7-f5a0-495c-ab2c-f003ef0d6b30 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032998 Oct 13 13:18:23.929403 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 471/923] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 13:18:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 13:18:24.176678 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-6b98dbd6-8e77-48af-83c5-aab69d715f49 tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Calling method '>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:18:24.177296 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-6b98dbd6-8e77-48af-83c5-aab69d715f49 tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] [instance: ebf57cc9-d371-41c8-b3a4-82b67889d57d] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:18:24.183611 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-6b98dbd6-8e77-48af-83c5-aab69d715f49 tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:18:24.184094 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-6b98dbd6-8e77-48af-83c5-aab69d715f49 tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:18:24.184547 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-6b98dbd6-8e77-48af-83c5-aab69d715f49 tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:18:24.185220 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-6b98dbd6-8e77-48af-83c5-aab69d715f49 tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:18:24.186256 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-6b98dbd6-8e77-48af-83c5-aab69d715f49 tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:18:24.186689 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-6b98dbd6-8e77-48af-83c5-aab69d715f49 tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:18:24.191143 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG dbcounter [-] [118815] Writing DB stats nova_cell1:UPDATE=2,nova_cell1:SELECT=97,nova_cell1:INSERT=1 {{(pid=118815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:18:24.319422 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-6b98dbd6-8e77-48af-83c5-aab69d715f49 tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd005dcc25944dfc9aeda1eb1468a0ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e1654782ac4100b0353d561496db51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:18:24.327274 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-6b98dbd6-8e77-48af-83c5-aab69d715f49 tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] 10.222.0.23 "GET /compute/v2.1/servers/ebf57cc9-d371-41c8-b3a4-82b67889d57d" status: 200 len: 1267 microversion: 2.1 time: 0.154763 Oct 13 13:18:24.327839 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 453/924] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:18:24 2022] GET /compute/v2.1/servers/ebf57cc9-d371-41c8-b3a4-82b67889d57d => generated 1267 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:18:25.350963 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-8b7bcddf-18ec-48ca-8b04-f1dc3414cd27 tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Calling method '>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:18:25.351693 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-8b7bcddf-18ec-48ca-8b04-f1dc3414cd27 tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] [instance: ebf57cc9-d371-41c8-b3a4-82b67889d57d] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:18:25.358336 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-8b7bcddf-18ec-48ca-8b04-f1dc3414cd27 tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:18:25.358821 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-8b7bcddf-18ec-48ca-8b04-f1dc3414cd27 tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:18:25.359304 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-8b7bcddf-18ec-48ca-8b04-f1dc3414cd27 tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:18:25.359991 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-8b7bcddf-18ec-48ca-8b04-f1dc3414cd27 tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:18:25.360449 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-8b7bcddf-18ec-48ca-8b04-f1dc3414cd27 tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:18:25.360878 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-8b7bcddf-18ec-48ca-8b04-f1dc3414cd27 tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:18:25.498773 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-8b7bcddf-18ec-48ca-8b04-f1dc3414cd27 tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd005dcc25944dfc9aeda1eb1468a0ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e1654782ac4100b0353d561496db51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:18:25.506497 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-8b7bcddf-18ec-48ca-8b04-f1dc3414cd27 tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] 10.222.0.23 "GET /compute/v2.1/servers/ebf57cc9-d371-41c8-b3a4-82b67889d57d" status: 200 len: 1455 microversion: 2.1 time: 0.160405 Oct 13 13:18:25.507064 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 472/925] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:18:25 2022] GET /compute/v2.1/servers/ebf57cc9-d371-41c8-b3a4-82b67889d57d => generated 1455 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:18:25.528762 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-7ef7328e-1e11-4ffd-97f4-46bda477b1d4 tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Calling method '>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:18:25.529376 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-7ef7328e-1e11-4ffd-97f4-46bda477b1d4 tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] [instance: ebf57cc9-d371-41c8-b3a4-82b67889d57d] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:18:25.536342 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-7ef7328e-1e11-4ffd-97f4-46bda477b1d4 tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:18:25.536826 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-7ef7328e-1e11-4ffd-97f4-46bda477b1d4 tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:18:25.537270 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-7ef7328e-1e11-4ffd-97f4-46bda477b1d4 tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:18:25.537963 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-7ef7328e-1e11-4ffd-97f4-46bda477b1d4 tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:18:25.538419 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-7ef7328e-1e11-4ffd-97f4-46bda477b1d4 tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:18:25.538847 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-7ef7328e-1e11-4ffd-97f4-46bda477b1d4 tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:18:25.665842 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-7ef7328e-1e11-4ffd-97f4-46bda477b1d4 tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd005dcc25944dfc9aeda1eb1468a0ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e1654782ac4100b0353d561496db51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:18:25.673786 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-7ef7328e-1e11-4ffd-97f4-46bda477b1d4 tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] 10.222.0.23 "GET /compute/v2.1/servers/ebf57cc9-d371-41c8-b3a4-82b67889d57d" status: 200 len: 1455 microversion: 2.1 time: 0.148867 Oct 13 13:18:25.674348 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 454/926] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:18:25 2022] GET /compute/v2.1/servers/ebf57cc9-d371-41c8-b3a4-82b67889d57d => generated 1455 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:18:27.402017 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [req-fafba880-5b27-4b07-b412-5c4a4f5530ce req-f9b46b33-e0f9-401f-b096-09287dea13b0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ebf57cc9-d371-41c8-b3a4-82b67889d57d", "tag": "de381234-2018-4c2f-93d9-84a4a3ab32c8"}]} {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 13:18:27.411813 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [req-fafba880-5b27-4b07-b412-5c4a4f5530ce req-f9b46b33-e0f9-401f-b096-09287dea13b0 service nova] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:18:27.412291 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [req-fafba880-5b27-4b07-b412-5c4a4f5530ce req-f9b46b33-e0f9-401f-b096-09287dea13b0 service nova] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:18:27.412774 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [req-fafba880-5b27-4b07-b412-5c4a4f5530ce req-f9b46b33-e0f9-401f-b096-09287dea13b0 service nova] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:18:27.424112 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.compute.server_external_events [req-fafba880-5b27-4b07-b412-5c4a4f5530ce req-f9b46b33-e0f9-401f-b096-09287dea13b0 service nova] Creating event network-changed:de381234-2018-4c2f-93d9-84a4a3ab32c8 for instance ebf57cc9-d371-41c8-b3a4-82b67889d57d on hv-cinder-82660 Oct 13 13:18:27.429136 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [req-fafba880-5b27-4b07-b412-5c4a4f5530ce req-f9b46b33-e0f9-401f-b096-09287dea13b0 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030827 Oct 13 13:18:27.429779 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 473/927] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 13:18:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 13:18:59.931159 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-e9cc9ba0-e27f-4675-a155-7c9639023aab tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Calling method '>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:18:59.931664 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-e9cc9ba0-e27f-4675-a155-7c9639023aab tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] [instance: b18f33d7-defb-4cea-9e29-20d49213f35c] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:18:59.934050 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG dbcounter [-] [118815] Writing DB stats nova_api:SELECT=54,nova_api:INSERT=3 {{(pid=118815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:18:59.934689 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG dbcounter [-] [118815] Writing DB stats nova_cell1:SELECT=11 {{(pid=118815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:18:59.940823 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-e9cc9ba0-e27f-4675-a155-7c9639023aab tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:18:59.941297 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-e9cc9ba0-e27f-4675-a155-7c9639023aab tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:18:59.941731 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-e9cc9ba0-e27f-4675-a155-7c9639023aab tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:18:59.942413 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-e9cc9ba0-e27f-4675-a155-7c9639023aab tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:18:59.942862 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-e9cc9ba0-e27f-4675-a155-7c9639023aab tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:18:59.943305 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-e9cc9ba0-e27f-4675-a155-7c9639023aab tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:18:59.967528 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-e9cc9ba0-e27f-4675-a155-7c9639023aab tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] 10.222.0.23 "GET /compute/v2.1/servers/b18f33d7-defb-4cea-9e29-20d49213f35c/ips" status: 200 len: 150 microversion: 2.1 time: 0.040258 Oct 13 13:18:59.968079 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 455/928] 10.222.0.23 () {58 vars in 1248 bytes} [Thu Oct 13 13:18:59 2022] GET /compute/v2.1/servers/b18f33d7-defb-4cea-9e29-20d49213f35c/ips => generated 150 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 13:18:59.978391 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG dbcounter [-] [118814] Writing DB stats nova_api:SELECT=67,nova_api:INSERT=4 {{(pid=118814) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:18:59.979229 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG dbcounter [-] [118814] Writing DB stats nova_cell1:SELECT=12 {{(pid=118814) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:18:59.983951 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-95fe19d9-50b1-4176-9cd0-bbe2dd085842 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2dab83bf-a88b-4b2f-babc-91fbb0985a53"}} {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 13:18:59.986368 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-95fe19d9-50b1-4176-9cd0-bbe2dd085842 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] [instance: b18f33d7-defb-4cea-9e29-20d49213f35c] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:18:59.993908 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-95fe19d9-50b1-4176-9cd0-bbe2dd085842 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:18:59.994387 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-95fe19d9-50b1-4176-9cd0-bbe2dd085842 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:18:59.994822 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-95fe19d9-50b1-4176-9cd0-bbe2dd085842 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:18:59.995535 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-95fe19d9-50b1-4176-9cd0-bbe2dd085842 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:18:59.995989 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-95fe19d9-50b1-4176-9cd0-bbe2dd085842 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:18:59.996412 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-95fe19d9-50b1-4176-9cd0-bbe2dd085842 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:19:00.074555 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.wsgi [None req-95fe19d9-50b1-4176-9cd0-bbe2dd085842 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] HTTP exception thrown: Invalid volume: volume 2dab83bf-a88b-4b2f-babc-91fbb0985a53 is already attached to instances: 8a4e6f19-21f2-4ff8-af3d-bf93ec2488aa Oct 13 13:19:00.076451 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-95fe19d9-50b1-4176-9cd0-bbe2dd085842 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Request method failure captured: Oct 13 13:19:00.076451 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: request: POST /compute/v2.1/servers/b18f33d7-defb-4cea-9e29-20d49213f35c/os-volume_attachments HTTP/1.1 Oct 13 13:19:00.076451 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: Accept: application/json Oct 13 13:19:00.076451 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: Accept-Encoding: identity Oct 13 13:19:00.076451 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: Connection: close Oct 13 13:19:00.076451 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: Content-Length: 74 Oct 13 13:19:00.076451 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: Content-Type: application/json Oct 13 13:19:00.076451 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: Host: 10.222.0.23 Oct 13 13:19:00.076451 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: Openstack-System-Scope: None Oct 13 13:19:00.076451 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: User-Agent: python-urllib3/1.26.12 Oct 13 13:19:00.076451 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Auth-Token: gAAAAABjSA_IS5ItJrPpOSqy4xNBxVB2bfXfKkj6-lkJ6r6QG2PtZPEmBejUeMw_nAM6PkRJ3-xldl5YnRyFBnqFy7XGF_zAWWgWViC-gBZjak_p4jHlI99AK4eenYmKLRCqGrNs_2qG-o4USzMyv_nCGKRj4tT-7DEE83-B1Dxr5qLtXkKFmJs Oct 13 13:19:00.076451 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Domain-Id: None Oct 13 13:19:00.076451 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Domain-Name: None Oct 13 13:19:00.076451 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Identity-Status: Confirmed Oct 13 13:19:00.076451 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Is-Admin-Project: True Oct 13 13:19:00.076451 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Project-Domain-Id: default Oct 13 13:19:00.076451 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Project-Domain-Name: Default Oct 13 13:19:00.076451 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Project-Id: da546353194342439f9bc3f98f6737e0 Oct 13 13:19:00.076451 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Project-Name: tempest-AttachVolumeNegativeTest-1392517896 Oct 13 13:19:00.076451 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Role: reader,member Oct 13 13:19:00.076451 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Roles: reader,member Oct 13 13:19:00.078311 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_da546353194342439f9bc3f98f6737e0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/da546353194342439f9bc3f98f6737e0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/da546353194342439f9bc3f98f6737e0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/da546353194342439f9bc3f98f6737e0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}] Oct 13 13:19:00.078311 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Tenant: tempest-AttachVolumeNegativeTest-1392517896 Oct 13 13:19:00.078311 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Tenant-Id: da546353194342439f9bc3f98f6737e0 Oct 13 13:19:00.078311 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1392517896 Oct 13 13:19:00.078311 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-User: tempest-AttachVolumeNegativeTest-1392517896-project Oct 13 13:19:00.078311 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-User-Domain-Id: default Oct 13 13:19:00.078311 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-User-Domain-Name: Default Oct 13 13:19:00.078311 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-User-Id: 2cd12070eb954d6880f925957184a288 Oct 13 13:19:00.078311 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-User-Name: tempest-AttachVolumeNegativeTest-1392517896-project Oct 13 13:19:00.078311 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: Oct 13 13:19:00.078311 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: {"volumeAttachment": {"volumeId": "2dab83bf-a88b-4b2f-babc-91fbb0985a53"}} Oct 13 13:19:00.078311 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: method: > Oct 13 13:19:00.079394 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: exception: Invalid volume: volume 2dab83bf-a88b-4b2f-babc-91fbb0985a53 is already attached to instances: 8a4e6f19-21f2-4ff8-af3d-bf93ec2488aa Oct 13 13:19:00.079394 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: action_args: {'server_id': 'b18f33d7-defb-4cea-9e29-20d49213f35c', 'body': {'volumeAttachment': {'volumeId': '2dab83bf-a88b-4b2f-babc-91fbb0985a53'}}} Oct 13 13:19:00.079394 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 13:19:00.079394 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 13:19:00.079394 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Oct 13 13:19:00.079394 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Oct 13 13:19:00.079394 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 13 13:19:00.079394 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 13 13:19:00.079394 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 13 13:19:00.079394 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 13 13:19:00.079394 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Oct 13 13:19:00.079394 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Oct 13 13:19:00.079394 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Oct 13 13:19:00.079394 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Oct 13 13:19:00.079394 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 2dab83bf-a88b-4b2f-babc-91fbb0985a53 is already attached to instances: 8a4e6f19-21f2-4ff8-af3d-bf93ec2488aa Oct 13 13:19:00.079394 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi Oct 13 13:19:00.079394 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 13:19:00.079394 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi Oct 13 13:19:00.079394 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 13:19:00.081550 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 13:19:00.081550 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 13:19:00.081550 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 13:19:00.081550 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 13:19:00.081550 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 13:19:00.081550 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 13:19:00.081550 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 13 13:19:00.081550 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 13 13:19:00.081550 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 13 13:19:00.081550 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 13 13:19:00.081550 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 13 13:19:00.081550 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 13 13:19:00.081550 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Oct 13 13:19:00.081550 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 13 13:19:00.081550 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 2dab83bf-a88b-4b2f-babc-91fbb0985a53 is already attached to instances: 8a4e6f19-21f2-4ff8-af3d-bf93ec2488aa Oct 13 13:19:00.081550 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi Oct 13 13:19:00.081550 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 13:19:00.081550 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi Oct 13 13:19:00.081550 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 13:19:00.081550 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 13:19:00.083207 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 13:19:00.083207 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 13:19:00.083207 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 13:19:00.083207 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 2dab83bf-a88b-4b2f-babc-91fbb0985a53 is already attached to instances: 8a4e6f19-21f2-4ff8-af3d-bf93ec2488aa Oct 13 13:19:00.083207 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi Oct 13 13:19:00.083207 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-95fe19d9-50b1-4176-9cd0-bbe2dd085842 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Returning 400 to user: Invalid volume: volume 2dab83bf-a88b-4b2f-babc-91fbb0985a53 is already attached to instances: 8a4e6f19-21f2-4ff8-af3d-bf93ec2488aa {{(pid=118814) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 13:19:00.083207 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-95fe19d9-50b1-4176-9cd0-bbe2dd085842 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] 10.222.0.23 "POST /compute/v2.1/servers/b18f33d7-defb-4cea-9e29-20d49213f35c/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.101552 Oct 13 13:19:00.083207 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 474/929] 10.222.0.23 () {60 vars in 1323 bytes} [Thu Oct 13 13:18:59 2022] POST /compute/v2.1/servers/b18f33d7-defb-4cea-9e29-20d49213f35c/os-volume_attachments => generated 174 bytes in 103 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 13 13:19:00.087157 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-ef742751-5b8f-4ff5-bd04-c3fe9b1ac2da tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Calling method '>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:19:00.087650 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-ef742751-5b8f-4ff5-bd04-c3fe9b1ac2da tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] [instance: b18f33d7-defb-4cea-9e29-20d49213f35c] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:19:00.093468 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-ef742751-5b8f-4ff5-bd04-c3fe9b1ac2da tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:19:00.093940 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-ef742751-5b8f-4ff5-bd04-c3fe9b1ac2da tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:19:00.094370 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-ef742751-5b8f-4ff5-bd04-c3fe9b1ac2da tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:19:00.095079 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-ef742751-5b8f-4ff5-bd04-c3fe9b1ac2da tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:19:00.096116 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-ef742751-5b8f-4ff5-bd04-c3fe9b1ac2da tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:19:00.096607 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-ef742751-5b8f-4ff5-bd04-c3fe9b1ac2da tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:19:00.121597 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-ef742751-5b8f-4ff5-bd04-c3fe9b1ac2da tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] [instance: b18f33d7-defb-4cea-9e29-20d49213f35c] Going to try to terminate instance {{(pid=118815) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 13 13:19:00.202972 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-ef742751-5b8f-4ff5-bd04-c3fe9b1ac2da tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] 10.222.0.23 "DELETE /compute/v2.1/servers/b18f33d7-defb-4cea-9e29-20d49213f35c" status: 204 len: 0 microversion: 2.1 time: 0.119340 Oct 13 13:19:00.203498 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 456/930] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Oct 13 13:19:00 2022] DELETE /compute/v2.1/servers/b18f33d7-defb-4cea-9e29-20d49213f35c => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 13 13:19:00.212211 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-183627b5-41ad-4593-9b6f-9212204fdab4 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Calling method '>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:19:00.212857 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-183627b5-41ad-4593-9b6f-9212204fdab4 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] [instance: b18f33d7-defb-4cea-9e29-20d49213f35c] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:19:00.219690 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-183627b5-41ad-4593-9b6f-9212204fdab4 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:19:00.220180 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-183627b5-41ad-4593-9b6f-9212204fdab4 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:19:00.220623 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-183627b5-41ad-4593-9b6f-9212204fdab4 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:19:00.221313 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-183627b5-41ad-4593-9b6f-9212204fdab4 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:19:00.221770 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-183627b5-41ad-4593-9b6f-9212204fdab4 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:19:00.222198 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-183627b5-41ad-4593-9b6f-9212204fdab4 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:19:00.348607 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-183627b5-41ad-4593-9b6f-9212204fdab4 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd12070eb954d6880f925957184a288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da546353194342439f9bc3f98f6737e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:19:00.356330 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-183627b5-41ad-4593-9b6f-9212204fdab4 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] 10.222.0.23 "GET /compute/v2.1/servers/b18f33d7-defb-4cea-9e29-20d49213f35c" status: 200 len: 1682 microversion: 2.1 time: 0.147931 Oct 13 13:19:00.356882 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 475/931] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:19:00 2022] GET /compute/v2.1/servers/b18f33d7-defb-4cea-9e29-20d49213f35c => generated 1682 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:19:01.379976 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-aeab43e9-492d-47dd-a3f6-562474eecf30 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Calling method '>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:19:01.380659 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-aeab43e9-492d-47dd-a3f6-562474eecf30 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] [instance: b18f33d7-defb-4cea-9e29-20d49213f35c] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:19:01.387026 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-aeab43e9-492d-47dd-a3f6-562474eecf30 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:19:01.387519 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-aeab43e9-492d-47dd-a3f6-562474eecf30 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:19:01.387955 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-aeab43e9-492d-47dd-a3f6-562474eecf30 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:19:01.388646 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-aeab43e9-492d-47dd-a3f6-562474eecf30 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:19:01.389097 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-aeab43e9-492d-47dd-a3f6-562474eecf30 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:19:01.389519 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-aeab43e9-492d-47dd-a3f6-562474eecf30 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:19:01.522590 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-aeab43e9-492d-47dd-a3f6-562474eecf30 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd12070eb954d6880f925957184a288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da546353194342439f9bc3f98f6737e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:19:01.530428 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-aeab43e9-492d-47dd-a3f6-562474eecf30 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] 10.222.0.23 "GET /compute/v2.1/servers/b18f33d7-defb-4cea-9e29-20d49213f35c" status: 200 len: 1682 microversion: 2.1 time: 0.154778 Oct 13 13:19:01.530986 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 457/932] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:19:01 2022] GET /compute/v2.1/servers/b18f33d7-defb-4cea-9e29-20d49213f35c => generated 1682 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:19:02.479469 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [req-e1fe6656-1ab6-4cf7-be47-b3c0bf0077d4 req-adefb013-91ff-42a4-8633-2b68a482cae7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b18f33d7-defb-4cea-9e29-20d49213f35c", "name": "network-vif-deleted", "tag": "47f769d3-bbeb-4693-bf62-e39b171194ca"}]} {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 13:19:02.490945 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [req-e1fe6656-1ab6-4cf7-be47-b3c0bf0077d4 req-adefb013-91ff-42a4-8633-2b68a482cae7 service nova] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:19:02.491462 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [req-e1fe6656-1ab6-4cf7-be47-b3c0bf0077d4 req-adefb013-91ff-42a4-8633-2b68a482cae7 service nova] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:19:02.491895 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [req-e1fe6656-1ab6-4cf7-be47-b3c0bf0077d4 req-adefb013-91ff-42a4-8633-2b68a482cae7 service nova] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:19:02.503539 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.compute.server_external_events [req-e1fe6656-1ab6-4cf7-be47-b3c0bf0077d4 req-adefb013-91ff-42a4-8633-2b68a482cae7 service nova] Creating event network-vif-deleted:47f769d3-bbeb-4693-bf62-e39b171194ca for instance b18f33d7-defb-4cea-9e29-20d49213f35c on hv-cinder-82660 Oct 13 13:19:02.508497 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [req-e1fe6656-1ab6-4cf7-be47-b3c0bf0077d4 req-adefb013-91ff-42a4-8633-2b68a482cae7 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032644 Oct 13 13:19:02.509093 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 476/933] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 13:19:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 13:19:02.557725 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-231e912b-757b-4f9a-acd7-116e799b2386 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Calling method '>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:19:02.558567 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-231e912b-757b-4f9a-acd7-116e799b2386 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] [instance: b18f33d7-defb-4cea-9e29-20d49213f35c] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:19:02.565471 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-231e912b-757b-4f9a-acd7-116e799b2386 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:19:02.566051 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-231e912b-757b-4f9a-acd7-116e799b2386 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:19:02.566587 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-231e912b-757b-4f9a-acd7-116e799b2386 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:19:02.567414 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-231e912b-757b-4f9a-acd7-116e799b2386 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:19:02.567945 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-231e912b-757b-4f9a-acd7-116e799b2386 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:19:02.568446 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-231e912b-757b-4f9a-acd7-116e799b2386 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:19:02.604243 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-231e912b-757b-4f9a-acd7-116e799b2386 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:19:02.604637 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-231e912b-757b-4f9a-acd7-116e799b2386 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:19:02.605078 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-231e912b-757b-4f9a-acd7-116e799b2386 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:19:02.605657 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.objects.instance [None req-231e912b-757b-4f9a-acd7-116e799b2386 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Lazy-loading 'fault' on Instance uuid b18f33d7-defb-4cea-9e29-20d49213f35c {{(pid=118815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 13 13:19:02.652922 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-231e912b-757b-4f9a-acd7-116e799b2386 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd12070eb954d6880f925957184a288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da546353194342439f9bc3f98f6737e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:19:02.662272 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-231e912b-757b-4f9a-acd7-116e799b2386 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] 10.222.0.23 "GET /compute/v2.1/servers/b18f33d7-defb-4cea-9e29-20d49213f35c" status: 200 len: 1332 microversion: 2.1 time: 0.109426 Oct 13 13:19:02.662854 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 458/934] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:19:02 2022] GET /compute/v2.1/servers/b18f33d7-defb-4cea-9e29-20d49213f35c => generated 1332 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:19:03.686902 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-79335f63-e910-4cc7-92f1-747a96c90521 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Calling method '>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:19:03.687967 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-79335f63-e910-4cc7-92f1-747a96c90521 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] [instance: b18f33d7-defb-4cea-9e29-20d49213f35c] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:19:03.695841 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-79335f63-e910-4cc7-92f1-747a96c90521 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:19:03.696468 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-79335f63-e910-4cc7-92f1-747a96c90521 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:19:03.697037 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-79335f63-e910-4cc7-92f1-747a96c90521 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:19:03.697984 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-79335f63-e910-4cc7-92f1-747a96c90521 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:19:03.698677 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-79335f63-e910-4cc7-92f1-747a96c90521 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:19:03.699252 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-79335f63-e910-4cc7-92f1-747a96c90521 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:19:03.713228 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.wsgi [None req-79335f63-e910-4cc7-92f1-747a96c90521 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] HTTP exception thrown: Instance b18f33d7-defb-4cea-9e29-20d49213f35c could not be found. Oct 13 13:19:03.714860 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-79335f63-e910-4cc7-92f1-747a96c90521 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Request method failure captured: Oct 13 13:19:03.714860 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: request: GET /compute/v2.1/servers/b18f33d7-defb-4cea-9e29-20d49213f35c HTTP/1.1 Oct 13 13:19:03.714860 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: Accept: application/json Oct 13 13:19:03.714860 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: Accept-Encoding: identity Oct 13 13:19:03.714860 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: Connection: close Oct 13 13:19:03.714860 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: Content-Length: 0 Oct 13 13:19:03.714860 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: Content-Type: application/json Oct 13 13:19:03.714860 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: Host: 10.222.0.23 Oct 13 13:19:03.714860 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: Openstack-System-Scope: None Oct 13 13:19:03.714860 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: User-Agent: python-urllib3/1.26.12 Oct 13 13:19:03.714860 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Auth-Token: gAAAAABjSA_IS5ItJrPpOSqy4xNBxVB2bfXfKkj6-lkJ6r6QG2PtZPEmBejUeMw_nAM6PkRJ3-xldl5YnRyFBnqFy7XGF_zAWWgWViC-gBZjak_p4jHlI99AK4eenYmKLRCqGrNs_2qG-o4USzMyv_nCGKRj4tT-7DEE83-B1Dxr5qLtXkKFmJs Oct 13 13:19:03.714860 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Domain-Id: None Oct 13 13:19:03.714860 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Domain-Name: None Oct 13 13:19:03.714860 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Identity-Status: Confirmed Oct 13 13:19:03.714860 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Is-Admin-Project: True Oct 13 13:19:03.714860 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Project-Domain-Id: default Oct 13 13:19:03.714860 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Project-Domain-Name: Default Oct 13 13:19:03.714860 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Project-Id: da546353194342439f9bc3f98f6737e0 Oct 13 13:19:03.714860 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Project-Name: tempest-AttachVolumeNegativeTest-1392517896 Oct 13 13:19:03.714860 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Role: reader,member Oct 13 13:19:03.714860 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Roles: reader,member Oct 13 13:19:03.716522 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_da546353194342439f9bc3f98f6737e0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/da546353194342439f9bc3f98f6737e0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/da546353194342439f9bc3f98f6737e0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/da546353194342439f9bc3f98f6737e0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}] Oct 13 13:19:03.716522 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Tenant: tempest-AttachVolumeNegativeTest-1392517896 Oct 13 13:19:03.716522 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Tenant-Id: da546353194342439f9bc3f98f6737e0 Oct 13 13:19:03.716522 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1392517896 Oct 13 13:19:03.716522 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-User: tempest-AttachVolumeNegativeTest-1392517896-project Oct 13 13:19:03.716522 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-User-Domain-Id: default Oct 13 13:19:03.716522 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-User-Domain-Name: Default Oct 13 13:19:03.716522 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-User-Id: 2cd12070eb954d6880f925957184a288 Oct 13 13:19:03.716522 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-User-Name: tempest-AttachVolumeNegativeTest-1392517896-project Oct 13 13:19:03.716522 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: method: > Oct 13 13:19:03.716522 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: exception: Instance b18f33d7-defb-4cea-9e29-20d49213f35c could not be found. Oct 13 13:19:03.716522 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: action_args: {'id': 'b18f33d7-defb-4cea-9e29-20d49213f35c'} Oct 13 13:19:03.717635 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 13:19:03.717635 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 13:19:03.717635 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 13 13:19:03.717635 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 13 13:19:03.717635 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 13 13:19:03.717635 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 13 13:19:03.717635 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 13 13:19:03.717635 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 13 13:19:03.717635 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 13 13:19:03.717635 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 13 13:19:03.717635 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b18f33d7-defb-4cea-9e29-20d49213f35c could not be found. Oct 13 13:19:03.717635 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi Oct 13 13:19:03.717635 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 13:19:03.717635 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi Oct 13 13:19:03.717635 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 13:19:03.717635 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 13:19:03.717635 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 13:19:03.717635 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 13:19:03.717635 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 13:19:03.717635 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 13:19:03.719189 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 13:19:03.719189 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 13 13:19:03.719189 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 13 13:19:03.719189 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 13 13:19:03.719189 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 13 13:19:03.719189 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 13 13:19:03.719189 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 13 13:19:03.719189 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b18f33d7-defb-4cea-9e29-20d49213f35c could not be found. Oct 13 13:19:03.719189 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi Oct 13 13:19:03.719189 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 13:19:03.719189 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi Oct 13 13:19:03.719189 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 13:19:03.719189 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 13:19:03.719189 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 13:19:03.719189 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 13:19:03.719189 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 13:19:03.719189 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b18f33d7-defb-4cea-9e29-20d49213f35c could not be found. Oct 13 13:19:03.719189 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi Oct 13 13:19:03.720676 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-79335f63-e910-4cc7-92f1-747a96c90521 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Returning 404 to user: Instance b18f33d7-defb-4cea-9e29-20d49213f35c could not be found. {{(pid=118814) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 13:19:03.720676 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-79335f63-e910-4cc7-92f1-747a96c90521 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] 10.222.0.23 "GET /compute/v2.1/servers/b18f33d7-defb-4cea-9e29-20d49213f35c" status: 404 len: 111 microversion: 2.1 time: 0.034176 Oct 13 13:19:03.720676 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 477/935] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:19:03 2022] GET /compute/v2.1/servers/b18f33d7-defb-4cea-9e29-20d49213f35c => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 13 13:19:03.725087 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-ec2b85c9-aa70-4a9a-abbd-151737aeb599 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Calling method '.version_select at 0x7f5093d28ee0>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:19:03.743319 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-ec2b85c9-aa70-4a9a-abbd-151737aeb599 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2106463252" status: 202 len: 0 microversion: 2.1 time: 0.022033 Oct 13 13:19:03.743860 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 459/936] 10.222.0.23 () {58 vars in 1221 bytes} [Thu Oct 13 13:19:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2106463252 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 13 13:19:04.387354 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-13cc2e51-523e-482c-9a1d-cb1ab48e1ee1 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Calling method '>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:19:04.387845 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-13cc2e51-523e-482c-9a1d-cb1ab48e1ee1 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] [instance: 8a4e6f19-21f2-4ff8-af3d-bf93ec2488aa] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:19:04.394228 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-13cc2e51-523e-482c-9a1d-cb1ab48e1ee1 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:19:04.394716 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-13cc2e51-523e-482c-9a1d-cb1ab48e1ee1 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:19:04.395267 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-13cc2e51-523e-482c-9a1d-cb1ab48e1ee1 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:19:04.395958 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-13cc2e51-523e-482c-9a1d-cb1ab48e1ee1 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:19:04.396410 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-13cc2e51-523e-482c-9a1d-cb1ab48e1ee1 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:19:04.396834 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-13cc2e51-523e-482c-9a1d-cb1ab48e1ee1 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:19:04.475717 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.objects.instance [None req-13cc2e51-523e-482c-9a1d-cb1ab48e1ee1 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Lazy-loading 'services' on Instance uuid 8a4e6f19-21f2-4ff8-af3d-bf93ec2488aa {{(pid=118814) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 13 13:19:04.545797 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-13cc2e51-523e-482c-9a1d-cb1ab48e1ee1 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] 10.222.0.23 "DELETE /compute/v2.1/servers/8a4e6f19-21f2-4ff8-af3d-bf93ec2488aa/os-volume_attachments/2dab83bf-a88b-4b2f-babc-91fbb0985a53" status: 202 len: 0 microversion: 2.1 time: 0.162286 Oct 13 13:19:04.546369 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 478/937] 10.222.0.23 () {58 vars in 1416 bytes} [Thu Oct 13 13:19:04 2022] DELETE /compute/v2.1/servers/8a4e6f19-21f2-4ff8-af3d-bf93ec2488aa/os-volume_attachments/2dab83bf-a88b-4b2f-babc-91fbb0985a53 => generated 0 bytes in 164 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 13 13:19:04.555130 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-67dc612e-512d-4bf8-af8f-e16dbe94309e tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Calling method '>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:19:04.557380 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-67dc612e-512d-4bf8-af8f-e16dbe94309e tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] [instance: 8a4e6f19-21f2-4ff8-af3d-bf93ec2488aa] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:19:04.564565 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-67dc612e-512d-4bf8-af8f-e16dbe94309e tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:19:04.565139 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-67dc612e-512d-4bf8-af8f-e16dbe94309e tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:19:04.565629 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-67dc612e-512d-4bf8-af8f-e16dbe94309e tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:19:04.566326 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-67dc612e-512d-4bf8-af8f-e16dbe94309e tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:19:04.566779 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-67dc612e-512d-4bf8-af8f-e16dbe94309e tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:19:04.567919 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-67dc612e-512d-4bf8-af8f-e16dbe94309e tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:19:04.599206 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-67dc612e-512d-4bf8-af8f-e16dbe94309e tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] 10.222.0.23 "GET /compute/v2.1/servers/8a4e6f19-21f2-4ff8-af3d-bf93ec2488aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048070 Oct 13 13:19:04.599751 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 460/938] 10.222.0.23 () {58 vars in 1302 bytes} [Thu Oct 13 13:19:04 2022] GET /compute/v2.1/servers/8a4e6f19-21f2-4ff8-af3d-bf93ec2488aa/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 13:19:05.612709 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-f3290b1b-f03b-44be-95fb-9103c30e5caa tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Calling method '>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:19:05.615685 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-f3290b1b-f03b-44be-95fb-9103c30e5caa tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] [instance: 8a4e6f19-21f2-4ff8-af3d-bf93ec2488aa] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:19:05.621832 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-f3290b1b-f03b-44be-95fb-9103c30e5caa tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:19:05.622308 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-f3290b1b-f03b-44be-95fb-9103c30e5caa tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:19:05.622741 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-f3290b1b-f03b-44be-95fb-9103c30e5caa tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:19:05.623444 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-f3290b1b-f03b-44be-95fb-9103c30e5caa tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:19:05.623893 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-f3290b1b-f03b-44be-95fb-9103c30e5caa tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:19:05.624339 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-f3290b1b-f03b-44be-95fb-9103c30e5caa tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:19:05.651898 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-f3290b1b-f03b-44be-95fb-9103c30e5caa tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] 10.222.0.23 "GET /compute/v2.1/servers/8a4e6f19-21f2-4ff8-af3d-bf93ec2488aa/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044022 Oct 13 13:19:05.652426 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 479/939] 10.222.0.23 () {58 vars in 1302 bytes} [Thu Oct 13 13:19:05 2022] GET /compute/v2.1/servers/8a4e6f19-21f2-4ff8-af3d-bf93ec2488aa/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 13 13:19:05.716065 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-e45d0319-a45e-49e5-8cf1-97671d0f12ea tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Calling method '>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:19:05.716561 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-e45d0319-a45e-49e5-8cf1-97671d0f12ea tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] [instance: 8a4e6f19-21f2-4ff8-af3d-bf93ec2488aa] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:19:05.722834 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-e45d0319-a45e-49e5-8cf1-97671d0f12ea tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:19:05.723910 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-e45d0319-a45e-49e5-8cf1-97671d0f12ea tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:19:05.724351 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-e45d0319-a45e-49e5-8cf1-97671d0f12ea tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:19:05.725040 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-e45d0319-a45e-49e5-8cf1-97671d0f12ea tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:19:05.725494 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-e45d0319-a45e-49e5-8cf1-97671d0f12ea tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:19:05.725921 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-e45d0319-a45e-49e5-8cf1-97671d0f12ea tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:19:05.750370 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-e45d0319-a45e-49e5-8cf1-97671d0f12ea tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] [instance: 8a4e6f19-21f2-4ff8-af3d-bf93ec2488aa] Going to try to terminate instance {{(pid=118815) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 13 13:19:05.825537 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-e45d0319-a45e-49e5-8cf1-97671d0f12ea tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] 10.222.0.23 "DELETE /compute/v2.1/servers/8a4e6f19-21f2-4ff8-af3d-bf93ec2488aa" status: 204 len: 0 microversion: 2.1 time: 0.112725 Oct 13 13:19:05.826363 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 461/940] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Oct 13 13:19:05 2022] DELETE /compute/v2.1/servers/8a4e6f19-21f2-4ff8-af3d-bf93ec2488aa => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 13 13:19:05.835502 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-e653f2df-5daf-48a5-a163-ddb8ca57f283 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Calling method '>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:19:05.836151 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-e653f2df-5daf-48a5-a163-ddb8ca57f283 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] [instance: 8a4e6f19-21f2-4ff8-af3d-bf93ec2488aa] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:19:05.841962 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-e653f2df-5daf-48a5-a163-ddb8ca57f283 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:19:05.842448 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-e653f2df-5daf-48a5-a163-ddb8ca57f283 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:19:05.842888 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-e653f2df-5daf-48a5-a163-ddb8ca57f283 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:19:05.843599 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-e653f2df-5daf-48a5-a163-ddb8ca57f283 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:19:05.844054 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-e653f2df-5daf-48a5-a163-ddb8ca57f283 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:19:05.844478 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-e653f2df-5daf-48a5-a163-ddb8ca57f283 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:19:05.976409 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-e653f2df-5daf-48a5-a163-ddb8ca57f283 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd12070eb954d6880f925957184a288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da546353194342439f9bc3f98f6737e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:19:05.984132 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-e653f2df-5daf-48a5-a163-ddb8ca57f283 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] 10.222.0.23 "GET /compute/v2.1/servers/8a4e6f19-21f2-4ff8-af3d-bf93ec2488aa" status: 200 len: 1682 microversion: 2.1 time: 0.153057 Oct 13 13:19:05.984695 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 480/941] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:19:05 2022] GET /compute/v2.1/servers/8a4e6f19-21f2-4ff8-af3d-bf93ec2488aa => generated 1682 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:19:07.007409 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-865d8c23-4f14-426e-b4b3-919e3c0f40f0 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Calling method '>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:19:07.008112 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-865d8c23-4f14-426e-b4b3-919e3c0f40f0 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] [instance: 8a4e6f19-21f2-4ff8-af3d-bf93ec2488aa] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:19:07.014405 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-865d8c23-4f14-426e-b4b3-919e3c0f40f0 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:19:07.014922 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-865d8c23-4f14-426e-b4b3-919e3c0f40f0 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:19:07.015370 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-865d8c23-4f14-426e-b4b3-919e3c0f40f0 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:19:07.016150 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-865d8c23-4f14-426e-b4b3-919e3c0f40f0 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:19:07.016604 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-865d8c23-4f14-426e-b4b3-919e3c0f40f0 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:19:07.017033 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-865d8c23-4f14-426e-b4b3-919e3c0f40f0 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:19:07.149633 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-865d8c23-4f14-426e-b4b3-919e3c0f40f0 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd12070eb954d6880f925957184a288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da546353194342439f9bc3f98f6737e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:19:07.157474 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-865d8c23-4f14-426e-b4b3-919e3c0f40f0 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] 10.222.0.23 "GET /compute/v2.1/servers/8a4e6f19-21f2-4ff8-af3d-bf93ec2488aa" status: 200 len: 1682 microversion: 2.1 time: 0.154412 Oct 13 13:19:07.158035 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 462/942] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:19:07 2022] GET /compute/v2.1/servers/8a4e6f19-21f2-4ff8-af3d-bf93ec2488aa => generated 1682 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:19:08.181710 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-0652ad58-9564-47cf-b56b-36bb5f3b4028 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Calling method '>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:19:08.182324 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-0652ad58-9564-47cf-b56b-36bb5f3b4028 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] [instance: 8a4e6f19-21f2-4ff8-af3d-bf93ec2488aa] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:19:08.189920 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-0652ad58-9564-47cf-b56b-36bb5f3b4028 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:19:08.190417 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-0652ad58-9564-47cf-b56b-36bb5f3b4028 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:19:08.190860 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-0652ad58-9564-47cf-b56b-36bb5f3b4028 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:19:08.191593 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-0652ad58-9564-47cf-b56b-36bb5f3b4028 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:19:08.200266 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [req-f42a7243-eb94-42dc-9aae-8482ec5800a0 req-1507e3d0-18c5-4c6b-a8c1-1cd538de1222 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8a4e6f19-21f2-4ff8-af3d-bf93ec2488aa", "name": "network-vif-deleted", "tag": "f712db69-8915-4f5c-b72c-2bbcb66d33ab"}]} {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 13:19:08.200891 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-0652ad58-9564-47cf-b56b-36bb5f3b4028 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:19:08.200891 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-0652ad58-9564-47cf-b56b-36bb5f3b4028 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:19:08.211769 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [req-f42a7243-eb94-42dc-9aae-8482ec5800a0 req-1507e3d0-18c5-4c6b-a8c1-1cd538de1222 service nova] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:19:08.212268 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [req-f42a7243-eb94-42dc-9aae-8482ec5800a0 req-1507e3d0-18c5-4c6b-a8c1-1cd538de1222 service nova] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:19:08.212748 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [req-f42a7243-eb94-42dc-9aae-8482ec5800a0 req-1507e3d0-18c5-4c6b-a8c1-1cd538de1222 service nova] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:19:08.232486 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.compute.server_external_events [req-f42a7243-eb94-42dc-9aae-8482ec5800a0 req-1507e3d0-18c5-4c6b-a8c1-1cd538de1222 service nova] Creating event network-vif-deleted:f712db69-8915-4f5c-b72c-2bbcb66d33ab for instance 8a4e6f19-21f2-4ff8-af3d-bf93ec2488aa on hv-cinder-82660 Oct 13 13:19:08.237371 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [req-f42a7243-eb94-42dc-9aae-8482ec5800a0 req-1507e3d0-18c5-4c6b-a8c1-1cd538de1222 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041031 Oct 13 13:19:08.237965 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 463/943] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 13:19:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 13 13:19:08.279208 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-0652ad58-9564-47cf-b56b-36bb5f3b4028 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd12070eb954d6880f925957184a288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da546353194342439f9bc3f98f6737e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:19:08.291005 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-0652ad58-9564-47cf-b56b-36bb5f3b4028 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] 10.222.0.23 "GET /compute/v2.1/servers/8a4e6f19-21f2-4ff8-af3d-bf93ec2488aa" status: 200 len: 1614 microversion: 2.1 time: 0.113011 Oct 13 13:19:08.308060 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 481/944] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:19:08 2022] GET /compute/v2.1/servers/8a4e6f19-21f2-4ff8-af3d-bf93ec2488aa => generated 1614 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:19:09.317151 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-0b2e01fd-0bb3-41d3-964f-c9ea27eaa6d6 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Calling method '>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:19:09.317886 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-0b2e01fd-0bb3-41d3-964f-c9ea27eaa6d6 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] [instance: 8a4e6f19-21f2-4ff8-af3d-bf93ec2488aa] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:19:09.324075 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-0b2e01fd-0bb3-41d3-964f-c9ea27eaa6d6 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:19:09.324561 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-0b2e01fd-0bb3-41d3-964f-c9ea27eaa6d6 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:19:09.324987 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-0b2e01fd-0bb3-41d3-964f-c9ea27eaa6d6 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:19:09.325667 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-0b2e01fd-0bb3-41d3-964f-c9ea27eaa6d6 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:19:09.326113 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-0b2e01fd-0bb3-41d3-964f-c9ea27eaa6d6 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:19:09.326535 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-0b2e01fd-0bb3-41d3-964f-c9ea27eaa6d6 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:19:09.342704 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.wsgi [None req-0b2e01fd-0bb3-41d3-964f-c9ea27eaa6d6 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] HTTP exception thrown: Instance 8a4e6f19-21f2-4ff8-af3d-bf93ec2488aa could not be found. Oct 13 13:19:09.344324 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-0b2e01fd-0bb3-41d3-964f-c9ea27eaa6d6 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Request method failure captured: Oct 13 13:19:09.344324 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: request: GET /compute/v2.1/servers/8a4e6f19-21f2-4ff8-af3d-bf93ec2488aa HTTP/1.1 Oct 13 13:19:09.344324 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: Accept: application/json Oct 13 13:19:09.344324 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: Accept-Encoding: identity Oct 13 13:19:09.344324 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: Connection: close Oct 13 13:19:09.344324 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: Content-Length: 0 Oct 13 13:19:09.344324 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: Content-Type: application/json Oct 13 13:19:09.344324 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: Host: 10.222.0.23 Oct 13 13:19:09.344324 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: Openstack-System-Scope: None Oct 13 13:19:09.344324 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: User-Agent: python-urllib3/1.26.12 Oct 13 13:19:09.344324 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Auth-Token: gAAAAABjSA_IS5ItJrPpOSqy4xNBxVB2bfXfKkj6-lkJ6r6QG2PtZPEmBejUeMw_nAM6PkRJ3-xldl5YnRyFBnqFy7XGF_zAWWgWViC-gBZjak_p4jHlI99AK4eenYmKLRCqGrNs_2qG-o4USzMyv_nCGKRj4tT-7DEE83-B1Dxr5qLtXkKFmJs Oct 13 13:19:09.344324 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Domain-Id: None Oct 13 13:19:09.344324 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Domain-Name: None Oct 13 13:19:09.344324 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Identity-Status: Confirmed Oct 13 13:19:09.344324 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Is-Admin-Project: True Oct 13 13:19:09.344324 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Project-Domain-Id: default Oct 13 13:19:09.344324 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Project-Domain-Name: Default Oct 13 13:19:09.344324 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Project-Id: da546353194342439f9bc3f98f6737e0 Oct 13 13:19:09.344324 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Project-Name: tempest-AttachVolumeNegativeTest-1392517896 Oct 13 13:19:09.344324 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Role: reader,member Oct 13 13:19:09.344324 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Roles: reader,member Oct 13 13:19:09.346032 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_da546353194342439f9bc3f98f6737e0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/da546353194342439f9bc3f98f6737e0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/da546353194342439f9bc3f98f6737e0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/da546353194342439f9bc3f98f6737e0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}] Oct 13 13:19:09.346032 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Tenant: tempest-AttachVolumeNegativeTest-1392517896 Oct 13 13:19:09.346032 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Tenant-Id: da546353194342439f9bc3f98f6737e0 Oct 13 13:19:09.346032 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1392517896 Oct 13 13:19:09.346032 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-User: tempest-AttachVolumeNegativeTest-1392517896-project Oct 13 13:19:09.346032 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-User-Domain-Id: default Oct 13 13:19:09.346032 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-User-Domain-Name: Default Oct 13 13:19:09.346032 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-User-Id: 2cd12070eb954d6880f925957184a288 Oct 13 13:19:09.346032 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-User-Name: tempest-AttachVolumeNegativeTest-1392517896-project Oct 13 13:19:09.346032 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: method: > Oct 13 13:19:09.346032 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: exception: Instance 8a4e6f19-21f2-4ff8-af3d-bf93ec2488aa could not be found. Oct 13 13:19:09.346032 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: action_args: {'id': '8a4e6f19-21f2-4ff8-af3d-bf93ec2488aa'} Oct 13 13:19:09.346994 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 13:19:09.346994 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 13:19:09.346994 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 13 13:19:09.346994 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 13 13:19:09.346994 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 13 13:19:09.346994 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 13 13:19:09.346994 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 13 13:19:09.346994 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 13 13:19:09.346994 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 13 13:19:09.346994 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 13 13:19:09.346994 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8a4e6f19-21f2-4ff8-af3d-bf93ec2488aa could not be found. Oct 13 13:19:09.346994 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi Oct 13 13:19:09.346994 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 13:19:09.346994 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi Oct 13 13:19:09.346994 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 13:19:09.346994 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 13:19:09.346994 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 13:19:09.346994 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 13:19:09.346994 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 13:19:09.346994 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 13:19:09.348706 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 13:19:09.348706 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 13 13:19:09.348706 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 13 13:19:09.348706 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 13 13:19:09.348706 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 13 13:19:09.348706 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 13 13:19:09.348706 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 13 13:19:09.348706 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8a4e6f19-21f2-4ff8-af3d-bf93ec2488aa could not be found. Oct 13 13:19:09.348706 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi Oct 13 13:19:09.348706 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 13:19:09.348706 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi Oct 13 13:19:09.348706 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 13:19:09.348706 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 13:19:09.348706 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 13:19:09.348706 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 13:19:09.348706 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 13:19:09.348706 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8a4e6f19-21f2-4ff8-af3d-bf93ec2488aa could not be found. Oct 13 13:19:09.348706 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi Oct 13 13:19:09.350132 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-0b2e01fd-0bb3-41d3-964f-c9ea27eaa6d6 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Returning 404 to user: Instance 8a4e6f19-21f2-4ff8-af3d-bf93ec2488aa could not be found. {{(pid=118815) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 13:19:09.350132 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-0b2e01fd-0bb3-41d3-964f-c9ea27eaa6d6 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] 10.222.0.23 "GET /compute/v2.1/servers/8a4e6f19-21f2-4ff8-af3d-bf93ec2488aa" status: 404 len: 111 microversion: 2.1 time: 0.033777 Oct 13 13:19:09.350132 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 464/945] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:19:09 2022] GET /compute/v2.1/servers/8a4e6f19-21f2-4ff8-af3d-bf93ec2488aa => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 13 13:19:09.354591 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-da554179-fe2c-450d-9fcc-4181cd720b31 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Calling method '.version_select at 0x7f5093d69310>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:19:09.372368 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-da554179-fe2c-450d-9fcc-4181cd720b31 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1136022806" status: 202 len: 0 microversion: 2.1 time: 0.021479 Oct 13 13:19:09.372905 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 482/946] 10.222.0.23 () {58 vars in 1221 bytes} [Thu Oct 13 13:19:09 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1136022806 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 13 13:19:09.973868 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-7a1d51ff-4faf-4694-9ea7-6cc9da8a2a36 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Action: 'create', calling method: .version_select at 0x7f5093b888b0>, body: {"keypair": {"name": "tempest-keypair-1516594483", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIxfcU7ynLwjiwhCh9TJYNTqkrbSHSK916ABCkp/lgdZiixzADklb3RxT3SQNrjkiSA3snjtufRa+FV23fqqYbGNT4Ir9VgJ6/dvRGZ5iZK/AWZApYNb7XsK4Xh96LqwFQ=="}} {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 13:19:09.989709 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.quota [None req-7a1d51ff-4faf-4694-9ea7-6cc9da8a2a36 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Getting quotas for project da546353194342439f9bc3f98f6737e0. Resources: {'key_pairs'} {{(pid=118815) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 13 13:19:09.993506 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.quota [None req-7a1d51ff-4faf-4694-9ea7-6cc9da8a2a36 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Getting quotas for user 2cd12070eb954d6880f925957184a288 and project da546353194342439f9bc3f98f6737e0. Resources: {'key_pairs'} {{(pid=118815) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 13 13:19:10.014466 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-7a1d51ff-4faf-4694-9ea7-6cc9da8a2a36 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.045141 Oct 13 13:19:10.015088 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 465/947] 10.222.0.23 () {60 vars in 1159 bytes} [Thu Oct 13 13:19:09 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 13:19:11.439499 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-9a128f2c-a8ee-4090-ac73-e3349b746b0a tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-411834566", "imageRef": "e2cdd20b-2540-48bc-a05c-d6a2e7e9a66e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "60c7ab31-db51-4574-8d4e-94d8596d64ad"}], "security_groups": [{"name": "tempest-securitygroup--779539753"}], "key_name": "tempest-keypair-1516594483", "user_data": "}} {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 13:19:11.540095 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.network.neutron [None req-9a128f2c-a8ee-4090-ac73-e3349b746b0a tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] validate_networks() for [('60c7ab31-db51-4574-8d4e-94d8596d64ad', None, None, None, None, None)] {{(pid=118814) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 13 13:19:11.904282 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.virt.hardware [None req-9a128f2c-a8ee-4090-ac73-e3349b746b0a tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Flavor limits 0:0:0 {{(pid=118814) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 13 13:19:11.904793 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.virt.hardware [None req-9a128f2c-a8ee-4090-ac73-e3349b746b0a tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Image limits 0:0:0 {{(pid=118814) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 13 13:19:11.905186 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.virt.hardware [None req-9a128f2c-a8ee-4090-ac73-e3349b746b0a tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Flavor pref 0:0:0 {{(pid=118814) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 13 13:19:11.905593 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.virt.hardware [None req-9a128f2c-a8ee-4090-ac73-e3349b746b0a tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Image pref 0:0:0 {{(pid=118814) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 13 13:19:11.906006 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.virt.hardware [None req-9a128f2c-a8ee-4090-ac73-e3349b746b0a tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118814) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 13 13:19:11.914796 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-9a128f2c-a8ee-4090-ac73-e3349b746b0a tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:19:11.915326 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-9a128f2c-a8ee-4090-ac73-e3349b746b0a tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:19:11.915766 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-9a128f2c-a8ee-4090-ac73-e3349b746b0a tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:19:11.916487 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-9a128f2c-a8ee-4090-ac73-e3349b746b0a tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:19:11.916939 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-9a128f2c-a8ee-4090-ac73-e3349b746b0a tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:19:11.917365 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-9a128f2c-a8ee-4090-ac73-e3349b746b0a tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:19:11.934526 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.quota [None req-9a128f2c-a8ee-4090-ac73-e3349b746b0a tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Getting quotas for project da546353194342439f9bc3f98f6737e0. Resources: {'instances', 'cores', 'ram'} {{(pid=118814) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 13 13:19:11.938509 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.quota [None req-9a128f2c-a8ee-4090-ac73-e3349b746b0a tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Getting quotas for user 2cd12070eb954d6880f925957184a288 and project da546353194342439f9bc3f98f6737e0. Resources: {'instances', 'cores', 'ram'} {{(pid=118814) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 13 13:19:11.950033 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-9a128f2c-a8ee-4090-ac73-e3349b746b0a tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Going to run 1 instances... {{(pid=118814) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 13 13:19:11.952364 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-9a128f2c-a8ee-4090-ac73-e3349b746b0a tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] [instance: 4f38ccc6-b8fc-416e-ab19-a6c260441f76] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e2cdd20b-2540-48bc-a05c-d6a2e7e9a66e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118814) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 13 13:19:11.999847 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-9a128f2c-a8ee-4090-ac73-e3349b746b0a tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.565342 Oct 13 13:19:12.000726 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 483/948] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Oct 13 13:19:11 2022] POST /compute/v2.1/servers => generated 401 bytes in 567 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 13 13:19:12.012796 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-c59d292d-9123-4650-944f-9e752cc5e1f3 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Calling method '>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:19:12.013406 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-c59d292d-9123-4650-944f-9e752cc5e1f3 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] [instance: 4f38ccc6-b8fc-416e-ab19-a6c260441f76] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:19:12.068358 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-c59d292d-9123-4650-944f-9e752cc5e1f3 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd12070eb954d6880f925957184a288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da546353194342439f9bc3f98f6737e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:19:12.076066 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-c59d292d-9123-4650-944f-9e752cc5e1f3 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] 10.222.0.23 "GET /compute/v2.1/servers/4f38ccc6-b8fc-416e-ab19-a6c260441f76" status: 200 len: 1241 microversion: 2.1 time: 0.067779 Oct 13 13:19:12.076607 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 466/949] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:19:12 2022] GET /compute/v2.1/servers/4f38ccc6-b8fc-416e-ab19-a6c260441f76 => generated 1241 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:19:13.097832 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-b65c40dd-04d3-4b06-8d15-83fb6a2d70a9 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Calling method '>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:19:13.098835 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-b65c40dd-04d3-4b06-8d15-83fb6a2d70a9 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] [instance: 4f38ccc6-b8fc-416e-ab19-a6c260441f76] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:19:13.106302 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-b65c40dd-04d3-4b06-8d15-83fb6a2d70a9 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:19:13.106907 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-b65c40dd-04d3-4b06-8d15-83fb6a2d70a9 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:19:13.107470 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-b65c40dd-04d3-4b06-8d15-83fb6a2d70a9 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:19:13.108422 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-b65c40dd-04d3-4b06-8d15-83fb6a2d70a9 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:19:13.109004 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-b65c40dd-04d3-4b06-8d15-83fb6a2d70a9 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:19:13.109524 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-b65c40dd-04d3-4b06-8d15-83fb6a2d70a9 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:19:13.173689 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-b65c40dd-04d3-4b06-8d15-83fb6a2d70a9 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd12070eb954d6880f925957184a288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da546353194342439f9bc3f98f6737e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:19:13.182063 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-b65c40dd-04d3-4b06-8d15-83fb6a2d70a9 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] 10.222.0.23 "GET /compute/v2.1/servers/4f38ccc6-b8fc-416e-ab19-a6c260441f76" status: 200 len: 1299 microversion: 2.1 time: 0.088136 Oct 13 13:19:13.182979 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 484/950] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:19:13 2022] GET /compute/v2.1/servers/4f38ccc6-b8fc-416e-ab19-a6c260441f76 => generated 1299 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:19:14.205661 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-1bc4851c-f755-425b-b3f0-6d1cd163faad tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Calling method '>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:19:14.206419 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-1bc4851c-f755-425b-b3f0-6d1cd163faad tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] [instance: 4f38ccc6-b8fc-416e-ab19-a6c260441f76] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:19:14.213376 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-1bc4851c-f755-425b-b3f0-6d1cd163faad tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:19:14.213863 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-1bc4851c-f755-425b-b3f0-6d1cd163faad tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:19:14.214298 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-1bc4851c-f755-425b-b3f0-6d1cd163faad tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:19:14.214998 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-1bc4851c-f755-425b-b3f0-6d1cd163faad tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:19:14.215656 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-1bc4851c-f755-425b-b3f0-6d1cd163faad tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:19:14.216083 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-1bc4851c-f755-425b-b3f0-6d1cd163faad tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:19:14.349969 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-1bc4851c-f755-425b-b3f0-6d1cd163faad tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd12070eb954d6880f925957184a288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da546353194342439f9bc3f98f6737e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:19:14.357820 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-1bc4851c-f755-425b-b3f0-6d1cd163faad tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] 10.222.0.23 "GET /compute/v2.1/servers/4f38ccc6-b8fc-416e-ab19-a6c260441f76" status: 200 len: 1366 microversion: 2.1 time: 0.156009 Oct 13 13:19:14.358384 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 467/951] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:19:14 2022] GET /compute/v2.1/servers/4f38ccc6-b8fc-416e-ab19-a6c260441f76 => generated 1366 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:19:14.375889 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [req-b3f15415-cbad-4b68-94c6-487c85f4518a req-85f437e5-b2a2-4aa2-9ef9-fc976ec745b4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4f38ccc6-b8fc-416e-ab19-a6c260441f76", "tag": "8b09485c-dde0-4558-9dcd-066fee3602c0"}]} {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 13:19:14.388316 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [req-b3f15415-cbad-4b68-94c6-487c85f4518a req-85f437e5-b2a2-4aa2-9ef9-fc976ec745b4 service nova] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:19:14.388795 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [req-b3f15415-cbad-4b68-94c6-487c85f4518a req-85f437e5-b2a2-4aa2-9ef9-fc976ec745b4 service nova] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:19:14.389439 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [req-b3f15415-cbad-4b68-94c6-487c85f4518a req-85f437e5-b2a2-4aa2-9ef9-fc976ec745b4 service nova] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:19:14.401742 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.compute.server_external_events [req-b3f15415-cbad-4b68-94c6-487c85f4518a req-85f437e5-b2a2-4aa2-9ef9-fc976ec745b4 service nova] Creating event network-changed:8b09485c-dde0-4558-9dcd-066fee3602c0 for instance 4f38ccc6-b8fc-416e-ab19-a6c260441f76 on hv-cinder-82660 Oct 13 13:19:14.406684 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [req-b3f15415-cbad-4b68-94c6-487c85f4518a req-85f437e5-b2a2-4aa2-9ef9-fc976ec745b4 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036814 Oct 13 13:19:14.407314 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 485/952] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 13:19:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 13:19:15.381320 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-72e6b804-9333-4062-86ba-257931751e02 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Calling method '>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:19:15.381935 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-72e6b804-9333-4062-86ba-257931751e02 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] [instance: 4f38ccc6-b8fc-416e-ab19-a6c260441f76] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:19:15.388285 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-72e6b804-9333-4062-86ba-257931751e02 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:19:15.388767 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-72e6b804-9333-4062-86ba-257931751e02 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:19:15.389209 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-72e6b804-9333-4062-86ba-257931751e02 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:19:15.389894 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-72e6b804-9333-4062-86ba-257931751e02 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:19:15.390348 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-72e6b804-9333-4062-86ba-257931751e02 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:19:15.390776 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-72e6b804-9333-4062-86ba-257931751e02 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:19:15.517705 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-72e6b804-9333-4062-86ba-257931751e02 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd12070eb954d6880f925957184a288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da546353194342439f9bc3f98f6737e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:19:15.525886 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-72e6b804-9333-4062-86ba-257931751e02 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] 10.222.0.23 "GET /compute/v2.1/servers/4f38ccc6-b8fc-416e-ab19-a6c260441f76" status: 200 len: 1366 microversion: 2.1 time: 0.148540 Oct 13 13:19:15.526450 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 468/953] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:19:15 2022] GET /compute/v2.1/servers/4f38ccc6-b8fc-416e-ab19-a6c260441f76 => generated 1366 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:19:16.549134 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-f2b2f64f-5302-4a7f-8d86-a7bb8e28dabc tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Calling method '>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:19:16.549854 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-f2b2f64f-5302-4a7f-8d86-a7bb8e28dabc tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] [instance: 4f38ccc6-b8fc-416e-ab19-a6c260441f76] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:19:16.557241 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-f2b2f64f-5302-4a7f-8d86-a7bb8e28dabc tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:19:16.557719 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-f2b2f64f-5302-4a7f-8d86-a7bb8e28dabc tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:19:16.558150 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-f2b2f64f-5302-4a7f-8d86-a7bb8e28dabc tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:19:16.558821 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-f2b2f64f-5302-4a7f-8d86-a7bb8e28dabc tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:19:16.559295 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-f2b2f64f-5302-4a7f-8d86-a7bb8e28dabc tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:19:16.559718 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-f2b2f64f-5302-4a7f-8d86-a7bb8e28dabc tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:19:16.688458 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-f2b2f64f-5302-4a7f-8d86-a7bb8e28dabc tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd12070eb954d6880f925957184a288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da546353194342439f9bc3f98f6737e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:19:16.697101 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-f2b2f64f-5302-4a7f-8d86-a7bb8e28dabc tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] 10.222.0.23 "GET /compute/v2.1/servers/4f38ccc6-b8fc-416e-ab19-a6c260441f76" status: 200 len: 1366 microversion: 2.1 time: 0.152226 Oct 13 13:19:16.697801 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 486/954] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:19:16 2022] GET /compute/v2.1/servers/4f38ccc6-b8fc-416e-ab19-a6c260441f76 => generated 1366 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:19:17.719786 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-446045bd-32f5-4b4a-a0cb-5bad427941a4 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Calling method '>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:19:17.720399 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-446045bd-32f5-4b4a-a0cb-5bad427941a4 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] [instance: 4f38ccc6-b8fc-416e-ab19-a6c260441f76] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:19:17.726295 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-446045bd-32f5-4b4a-a0cb-5bad427941a4 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:19:17.726771 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-446045bd-32f5-4b4a-a0cb-5bad427941a4 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:19:17.727255 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-446045bd-32f5-4b4a-a0cb-5bad427941a4 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:19:17.727937 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-446045bd-32f5-4b4a-a0cb-5bad427941a4 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:19:17.728431 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-446045bd-32f5-4b4a-a0cb-5bad427941a4 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:19:17.728855 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-446045bd-32f5-4b4a-a0cb-5bad427941a4 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:19:17.859218 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-446045bd-32f5-4b4a-a0cb-5bad427941a4 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd12070eb954d6880f925957184a288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da546353194342439f9bc3f98f6737e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:19:17.867426 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-446045bd-32f5-4b4a-a0cb-5bad427941a4 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] 10.222.0.23 "GET /compute/v2.1/servers/4f38ccc6-b8fc-416e-ab19-a6c260441f76" status: 200 len: 1366 microversion: 2.1 time: 0.151588 Oct 13 13:19:17.867971 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 469/955] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:19:17 2022] GET /compute/v2.1/servers/4f38ccc6-b8fc-416e-ab19-a6c260441f76 => generated 1366 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:19:18.891084 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-309cdf62-2eda-47c7-b981-7f24a041502d tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Calling method '>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:19:18.891707 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-309cdf62-2eda-47c7-b981-7f24a041502d tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] [instance: 4f38ccc6-b8fc-416e-ab19-a6c260441f76] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:19:18.898863 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-309cdf62-2eda-47c7-b981-7f24a041502d tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:19:18.899380 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-309cdf62-2eda-47c7-b981-7f24a041502d tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:19:18.899823 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-309cdf62-2eda-47c7-b981-7f24a041502d tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:19:18.900521 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-309cdf62-2eda-47c7-b981-7f24a041502d tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:19:18.900975 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-309cdf62-2eda-47c7-b981-7f24a041502d tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:19:18.901403 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-309cdf62-2eda-47c7-b981-7f24a041502d tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:19:18.930593 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [req-4b895379-a928-4ef1-b5a2-1aedd4e6b13c req-19675a1d-6cc9-41eb-85a2-c7844c8dd982 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f38ccc6-b8fc-416e-ab19-a6c260441f76", "name": "network-vif-plugged", "status": "completed", "tag": "8b09485c-dde0-4558-9dcd-066fee3602c0"}]} {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 13:19:18.956799 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [req-4b895379-a928-4ef1-b5a2-1aedd4e6b13c req-19675a1d-6cc9-41eb-85a2-c7844c8dd982 service nova] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:19:18.960312 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [req-4b895379-a928-4ef1-b5a2-1aedd4e6b13c req-19675a1d-6cc9-41eb-85a2-c7844c8dd982 service nova] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:19:18.960920 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [req-4b895379-a928-4ef1-b5a2-1aedd4e6b13c req-19675a1d-6cc9-41eb-85a2-c7844c8dd982 service nova] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:19:18.975459 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.compute.server_external_events [req-4b895379-a928-4ef1-b5a2-1aedd4e6b13c req-19675a1d-6cc9-41eb-85a2-c7844c8dd982 service nova] Creating event network-vif-plugged:8b09485c-dde0-4558-9dcd-066fee3602c0 for instance 4f38ccc6-b8fc-416e-ab19-a6c260441f76 on hv-cinder-82660 Oct 13 13:19:18.980820 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [req-4b895379-a928-4ef1-b5a2-1aedd4e6b13c req-19675a1d-6cc9-41eb-85a2-c7844c8dd982 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058799 Oct 13 13:19:18.981860 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 470/956] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 13:19:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 13 13:19:19.056925 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-309cdf62-2eda-47c7-b981-7f24a041502d tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd12070eb954d6880f925957184a288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da546353194342439f9bc3f98f6737e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:19:19.064611 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-309cdf62-2eda-47c7-b981-7f24a041502d tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] 10.222.0.23 "GET /compute/v2.1/servers/4f38ccc6-b8fc-416e-ab19-a6c260441f76" status: 200 len: 1366 microversion: 2.1 time: 0.177470 Oct 13 13:19:19.065790 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 487/957] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:19:18 2022] GET /compute/v2.1/servers/4f38ccc6-b8fc-416e-ab19-a6c260441f76 => generated 1366 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:19:20.090112 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-71d3a479-454c-49cf-a9de-bc100e9e0cf3 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Calling method '>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:19:20.090852 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-71d3a479-454c-49cf-a9de-bc100e9e0cf3 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] [instance: 4f38ccc6-b8fc-416e-ab19-a6c260441f76] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:19:20.097064 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-71d3a479-454c-49cf-a9de-bc100e9e0cf3 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:19:20.098166 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-71d3a479-454c-49cf-a9de-bc100e9e0cf3 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:19:20.098614 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-71d3a479-454c-49cf-a9de-bc100e9e0cf3 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:19:20.099345 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-71d3a479-454c-49cf-a9de-bc100e9e0cf3 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:19:20.099807 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-71d3a479-454c-49cf-a9de-bc100e9e0cf3 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:19:20.100237 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-71d3a479-454c-49cf-a9de-bc100e9e0cf3 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:19:20.230690 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-71d3a479-454c-49cf-a9de-bc100e9e0cf3 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd12070eb954d6880f925957184a288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da546353194342439f9bc3f98f6737e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:19:20.238411 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-71d3a479-454c-49cf-a9de-bc100e9e0cf3 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] 10.222.0.23 "GET /compute/v2.1/servers/4f38ccc6-b8fc-416e-ab19-a6c260441f76" status: 200 len: 1366 microversion: 2.1 time: 0.153103 Oct 13 13:19:20.238966 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 471/958] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:19:20 2022] GET /compute/v2.1/servers/4f38ccc6-b8fc-416e-ab19-a6c260441f76 => generated 1366 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:19:21.261179 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-55026169-2db8-4798-8f00-03ebd11eeb00 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Calling method '>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:19:21.261789 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-55026169-2db8-4798-8f00-03ebd11eeb00 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] [instance: 4f38ccc6-b8fc-416e-ab19-a6c260441f76] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:19:21.268149 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-55026169-2db8-4798-8f00-03ebd11eeb00 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:19:21.268623 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-55026169-2db8-4798-8f00-03ebd11eeb00 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:19:21.269053 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-55026169-2db8-4798-8f00-03ebd11eeb00 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:19:21.269729 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-55026169-2db8-4798-8f00-03ebd11eeb00 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:19:21.270180 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-55026169-2db8-4798-8f00-03ebd11eeb00 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:19:21.270602 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-55026169-2db8-4798-8f00-03ebd11eeb00 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:19:21.396739 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-55026169-2db8-4798-8f00-03ebd11eeb00 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd12070eb954d6880f925957184a288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da546353194342439f9bc3f98f6737e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:19:21.404435 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-55026169-2db8-4798-8f00-03ebd11eeb00 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] 10.222.0.23 "GET /compute/v2.1/servers/4f38ccc6-b8fc-416e-ab19-a6c260441f76" status: 200 len: 1556 microversion: 2.1 time: 0.147125 Oct 13 13:19:21.404989 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 488/959] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:19:21 2022] GET /compute/v2.1/servers/4f38ccc6-b8fc-416e-ab19-a6c260441f76 => generated 1556 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:19:21.428028 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-7e7c35e4-2fcb-40b2-b9a7-8cb07782c335 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Calling method '>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:19:21.428524 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-7e7c35e4-2fcb-40b2-b9a7-8cb07782c335 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] [instance: 4f38ccc6-b8fc-416e-ab19-a6c260441f76] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:19:21.435144 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-7e7c35e4-2fcb-40b2-b9a7-8cb07782c335 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:19:21.435548 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-7e7c35e4-2fcb-40b2-b9a7-8cb07782c335 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:19:21.435981 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-7e7c35e4-2fcb-40b2-b9a7-8cb07782c335 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:19:21.436672 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-7e7c35e4-2fcb-40b2-b9a7-8cb07782c335 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:19:21.437122 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-7e7c35e4-2fcb-40b2-b9a7-8cb07782c335 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:19:21.437658 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-7e7c35e4-2fcb-40b2-b9a7-8cb07782c335 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:19:21.515951 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-7e7c35e4-2fcb-40b2-b9a7-8cb07782c335 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] 10.222.0.23 "GET /compute/v2.1/servers/4f38ccc6-b8fc-416e-ab19-a6c260441f76/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.091785 Oct 13 13:19:21.516537 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 472/960] 10.222.0.23 () {58 vars in 1275 bytes} [Thu Oct 13 13:19:21 2022] GET /compute/v2.1/servers/4f38ccc6-b8fc-416e-ab19-a6c260441f76/os-interface => generated 284 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 13:19:22.659492 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [req-16ee604d-58e9-4472-b1ff-6460b045dca0 req-1f60a5d2-e7a2-4f78-b3f9-be04d682800b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4f38ccc6-b8fc-416e-ab19-a6c260441f76", "tag": "8b09485c-dde0-4558-9dcd-066fee3602c0"}]} {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 13:19:22.665135 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG dbcounter [-] [118814] Writing DB stats nova_cell0:SELECT=2 {{(pid=118814) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:19:22.665860 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG dbcounter [-] [118814] Writing DB stats nova_cell0:SELECT=6 {{(pid=118814) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:19:22.673495 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [req-16ee604d-58e9-4472-b1ff-6460b045dca0 req-1f60a5d2-e7a2-4f78-b3f9-be04d682800b service nova] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:19:22.674038 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [req-16ee604d-58e9-4472-b1ff-6460b045dca0 req-1f60a5d2-e7a2-4f78-b3f9-be04d682800b service nova] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:19:22.674680 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [req-16ee604d-58e9-4472-b1ff-6460b045dca0 req-1f60a5d2-e7a2-4f78-b3f9-be04d682800b service nova] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:19:22.691184 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.compute.server_external_events [req-16ee604d-58e9-4472-b1ff-6460b045dca0 req-1f60a5d2-e7a2-4f78-b3f9-be04d682800b service nova] Creating event network-changed:8b09485c-dde0-4558-9dcd-066fee3602c0 for instance 4f38ccc6-b8fc-416e-ab19-a6c260441f76 on hv-cinder-82660 Oct 13 13:19:22.697636 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [req-16ee604d-58e9-4472-b1ff-6460b045dca0 req-1f60a5d2-e7a2-4f78-b3f9-be04d682800b service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041874 Oct 13 13:19:22.698348 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 489/961] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 13:19:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 13:19:25.328770 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG dbcounter [-] [118815] Writing DB stats nova_cell0:SELECT=6 {{(pid=118815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:19:25.334659 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-d120cd2e-8fe4-406d-b259-1c28cf97e48b tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Calling method '>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:19:25.335190 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-d120cd2e-8fe4-406d-b259-1c28cf97e48b tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] [instance: 5c481e0e-37eb-4457-813e-eb8a84932582] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:19:25.336826 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [req-4ab1c2d7-13e3-4090-828b-86a3c06d4204 req-8f1f9fb6-a87f-43fa-b2a2-9ba1a5af9143 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5c481e0e-37eb-4457-813e-eb8a84932582", "tag": "386e505c-fee6-4a1d-9fa8-236b241cf782"}]} {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 13:19:25.341908 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-d120cd2e-8fe4-406d-b259-1c28cf97e48b tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:19:25.342395 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-d120cd2e-8fe4-406d-b259-1c28cf97e48b tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:19:25.342832 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-d120cd2e-8fe4-406d-b259-1c28cf97e48b tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:19:25.343591 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-d120cd2e-8fe4-406d-b259-1c28cf97e48b tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:19:25.344035 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-d120cd2e-8fe4-406d-b259-1c28cf97e48b tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:19:25.344463 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-d120cd2e-8fe4-406d-b259-1c28cf97e48b tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:19:25.349437 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [req-4ab1c2d7-13e3-4090-828b-86a3c06d4204 req-8f1f9fb6-a87f-43fa-b2a2-9ba1a5af9143 service nova] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:19:25.349992 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [req-4ab1c2d7-13e3-4090-828b-86a3c06d4204 req-8f1f9fb6-a87f-43fa-b2a2-9ba1a5af9143 service nova] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:19:25.350498 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [req-4ab1c2d7-13e3-4090-828b-86a3c06d4204 req-8f1f9fb6-a87f-43fa-b2a2-9ba1a5af9143 service nova] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:19:25.361907 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.compute.server_external_events [req-4ab1c2d7-13e3-4090-828b-86a3c06d4204 req-8f1f9fb6-a87f-43fa-b2a2-9ba1a5af9143 service nova] Creating event network-changed:386e505c-fee6-4a1d-9fa8-236b241cf782 for instance 5c481e0e-37eb-4457-813e-eb8a84932582 on hv-cinder-82660 Oct 13 13:19:25.363459 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG dbcounter [-] [118815] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=118815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:19:25.367434 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [req-4ab1c2d7-13e3-4090-828b-86a3c06d4204 req-8f1f9fb6-a87f-43fa-b2a2-9ba1a5af9143 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035934 Oct 13 13:19:25.368245 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 490/962] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 13:19:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 13 13:19:25.374314 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-d120cd2e-8fe4-406d-b259-1c28cf97e48b tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] [instance: 5c481e0e-37eb-4457-813e-eb8a84932582] Going to try to terminate instance {{(pid=118815) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 13 13:19:25.471165 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-d120cd2e-8fe4-406d-b259-1c28cf97e48b tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] 10.222.0.23 "DELETE /compute/v2.1/servers/5c481e0e-37eb-4457-813e-eb8a84932582" status: 204 len: 0 microversion: 2.1 time: 0.142890 Oct 13 13:19:25.472177 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 473/963] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Oct 13 13:19:25 2022] DELETE /compute/v2.1/servers/5c481e0e-37eb-4457-813e-eb8a84932582 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 13 13:19:25.482277 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-17d2762f-e18b-41a1-bce7-18432a67a6ab tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Calling method '>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:19:25.484010 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-17d2762f-e18b-41a1-bce7-18432a67a6ab tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] [instance: 5c481e0e-37eb-4457-813e-eb8a84932582] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:19:25.491874 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-17d2762f-e18b-41a1-bce7-18432a67a6ab tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:19:25.492782 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-17d2762f-e18b-41a1-bce7-18432a67a6ab tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:19:25.493404 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-17d2762f-e18b-41a1-bce7-18432a67a6ab tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:19:25.494224 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-17d2762f-e18b-41a1-bce7-18432a67a6ab tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:19:25.494839 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-17d2762f-e18b-41a1-bce7-18432a67a6ab tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:19:25.495299 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-17d2762f-e18b-41a1-bce7-18432a67a6ab tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:19:25.632366 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-17d2762f-e18b-41a1-bce7-18432a67a6ab tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6723d3c8aa144452b46564649cf38ee3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aff81c38c17b4e82864854ceac6587df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:19:25.640258 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-17d2762f-e18b-41a1-bce7-18432a67a6ab tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] 10.222.0.23 "GET /compute/v2.1/servers/5c481e0e-37eb-4457-813e-eb8a84932582" status: 200 len: 1568 microversion: 2.1 time: 0.162527 Oct 13 13:19:25.640823 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 491/964] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:19:25 2022] GET /compute/v2.1/servers/5c481e0e-37eb-4457-813e-eb8a84932582 => generated 1568 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:19:26.665562 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-2311950f-4834-4538-8711-bd8f62bce625 tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Calling method '>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:19:26.666408 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-2311950f-4834-4538-8711-bd8f62bce625 tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] [instance: 5c481e0e-37eb-4457-813e-eb8a84932582] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:19:26.673058 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-2311950f-4834-4538-8711-bd8f62bce625 tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:19:26.673546 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-2311950f-4834-4538-8711-bd8f62bce625 tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:19:26.673984 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-2311950f-4834-4538-8711-bd8f62bce625 tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:19:26.674675 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-2311950f-4834-4538-8711-bd8f62bce625 tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:19:26.675154 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-2311950f-4834-4538-8711-bd8f62bce625 tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:19:26.675585 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-2311950f-4834-4538-8711-bd8f62bce625 tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:19:26.806816 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-2311950f-4834-4538-8711-bd8f62bce625 tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6723d3c8aa144452b46564649cf38ee3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aff81c38c17b4e82864854ceac6587df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:19:26.814720 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-2311950f-4834-4538-8711-bd8f62bce625 tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] 10.222.0.23 "GET /compute/v2.1/servers/5c481e0e-37eb-4457-813e-eb8a84932582" status: 200 len: 1568 microversion: 2.1 time: 0.154039 Oct 13 13:19:26.815320 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 474/965] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:19:26 2022] GET /compute/v2.1/servers/5c481e0e-37eb-4457-813e-eb8a84932582 => generated 1568 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:19:27.374494 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [req-d51b660b-a9b1-4a32-ab07-56da59e7ab06 req-e51c9439-91da-4a65-818f-be0669e5b761 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5c481e0e-37eb-4457-813e-eb8a84932582", "name": "network-vif-deleted", "tag": "386e505c-fee6-4a1d-9fa8-236b241cf782"}]} {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 13:19:27.384902 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [req-d51b660b-a9b1-4a32-ab07-56da59e7ab06 req-e51c9439-91da-4a65-818f-be0669e5b761 service nova] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:19:27.385389 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [req-d51b660b-a9b1-4a32-ab07-56da59e7ab06 req-e51c9439-91da-4a65-818f-be0669e5b761 service nova] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:19:27.385817 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [req-d51b660b-a9b1-4a32-ab07-56da59e7ab06 req-e51c9439-91da-4a65-818f-be0669e5b761 service nova] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:19:27.397945 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.compute.server_external_events [req-d51b660b-a9b1-4a32-ab07-56da59e7ab06 req-e51c9439-91da-4a65-818f-be0669e5b761 service nova] Creating event network-vif-deleted:386e505c-fee6-4a1d-9fa8-236b241cf782 for instance 5c481e0e-37eb-4457-813e-eb8a84932582 on hv-cinder-82660 Oct 13 13:19:27.402568 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [req-d51b660b-a9b1-4a32-ab07-56da59e7ab06 req-e51c9439-91da-4a65-818f-be0669e5b761 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031780 Oct 13 13:19:27.403178 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 492/966] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 13:19:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 13:19:27.837661 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-755e65c1-c3f2-4f88-a018-79652bc5158e tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Calling method '>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:19:27.838270 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-755e65c1-c3f2-4f88-a018-79652bc5158e tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] [instance: 5c481e0e-37eb-4457-813e-eb8a84932582] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:19:27.844801 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-755e65c1-c3f2-4f88-a018-79652bc5158e tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:19:27.845287 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-755e65c1-c3f2-4f88-a018-79652bc5158e tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:19:27.845721 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-755e65c1-c3f2-4f88-a018-79652bc5158e tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:19:27.846547 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-755e65c1-c3f2-4f88-a018-79652bc5158e tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:19:27.846850 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-755e65c1-c3f2-4f88-a018-79652bc5158e tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:19:27.847361 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-755e65c1-c3f2-4f88-a018-79652bc5158e tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:19:27.879234 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-755e65c1-c3f2-4f88-a018-79652bc5158e tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:19:27.879732 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-755e65c1-c3f2-4f88-a018-79652bc5158e tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:19:27.880173 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-755e65c1-c3f2-4f88-a018-79652bc5158e tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:19:27.880614 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.objects.instance [None req-755e65c1-c3f2-4f88-a018-79652bc5158e tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Lazy-loading 'fault' on Instance uuid 5c481e0e-37eb-4457-813e-eb8a84932582 {{(pid=118815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 13 13:19:27.924098 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-755e65c1-c3f2-4f88-a018-79652bc5158e tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6723d3c8aa144452b46564649cf38ee3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aff81c38c17b4e82864854ceac6587df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:19:27.933098 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-755e65c1-c3f2-4f88-a018-79652bc5158e tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] 10.222.0.23 "GET /compute/v2.1/servers/5c481e0e-37eb-4457-813e-eb8a84932582" status: 200 len: 1224 microversion: 2.1 time: 0.099258 Oct 13 13:19:27.933665 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 475/967] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:19:27 2022] GET /compute/v2.1/servers/5c481e0e-37eb-4457-813e-eb8a84932582 => generated 1224 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:19:28.956798 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-34a2d19a-4d3f-4766-8bd7-7f92e8829529 tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Calling method '>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:19:28.957501 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-34a2d19a-4d3f-4766-8bd7-7f92e8829529 tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] [instance: 5c481e0e-37eb-4457-813e-eb8a84932582] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:19:28.963739 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-34a2d19a-4d3f-4766-8bd7-7f92e8829529 tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:19:28.964228 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-34a2d19a-4d3f-4766-8bd7-7f92e8829529 tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:19:28.964670 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-34a2d19a-4d3f-4766-8bd7-7f92e8829529 tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:19:28.965365 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-34a2d19a-4d3f-4766-8bd7-7f92e8829529 tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:19:28.965821 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-34a2d19a-4d3f-4766-8bd7-7f92e8829529 tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:19:28.966248 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-34a2d19a-4d3f-4766-8bd7-7f92e8829529 tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:19:28.979337 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.wsgi [None req-34a2d19a-4d3f-4766-8bd7-7f92e8829529 tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] HTTP exception thrown: Instance 5c481e0e-37eb-4457-813e-eb8a84932582 could not be found. Oct 13 13:19:28.980963 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-34a2d19a-4d3f-4766-8bd7-7f92e8829529 tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Request method failure captured: Oct 13 13:19:28.980963 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: request: GET /compute/v2.1/servers/5c481e0e-37eb-4457-813e-eb8a84932582 HTTP/1.1 Oct 13 13:19:28.980963 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: Accept: application/json Oct 13 13:19:28.980963 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: Accept-Encoding: identity Oct 13 13:19:28.980963 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: Connection: close Oct 13 13:19:28.980963 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: Content-Length: 0 Oct 13 13:19:28.980963 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: Content-Type: application/json Oct 13 13:19:28.980963 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: Host: 10.222.0.23 Oct 13 13:19:28.980963 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: Openstack-System-Scope: None Oct 13 13:19:28.980963 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: User-Agent: python-urllib3/1.26.12 Oct 13 13:19:28.980963 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Auth-Token: gAAAAABjSA9KV2zzeqeBdx5W1zqya313cpQKHA4QO-fEQvT76WdoGu6zjDo-jfulNujd8EePMaicoiA1x5WT-agaMZberhlm0cafSHRGXKk7zhvuAKwyZgJsWjyT0T8Ed7qcNHvJrI5JIVUZ7REDYOxGrSGaeFaRsh7GmUh9iGui3eHASOLrCAI Oct 13 13:19:28.980963 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Domain-Id: None Oct 13 13:19:28.980963 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Domain-Name: None Oct 13 13:19:28.980963 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Identity-Status: Confirmed Oct 13 13:19:28.980963 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Is-Admin-Project: True Oct 13 13:19:28.980963 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Project-Domain-Id: default Oct 13 13:19:28.980963 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Project-Domain-Name: Default Oct 13 13:19:28.980963 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Project-Id: aff81c38c17b4e82864854ceac6587df Oct 13 13:19:28.980963 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Project-Name: tempest-TestShelveInstance-1469688644 Oct 13 13:19:28.980963 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Role: reader,member Oct 13 13:19:28.980963 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Roles: reader,member Oct 13 13:19:28.982637 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_aff81c38c17b4e82864854ceac6587df"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/aff81c38c17b4e82864854ceac6587df"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/aff81c38c17b4e82864854ceac6587df"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/aff81c38c17b4e82864854ceac6587df"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}] Oct 13 13:19:28.982637 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Tenant: tempest-TestShelveInstance-1469688644 Oct 13 13:19:28.982637 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Tenant-Id: aff81c38c17b4e82864854ceac6587df Oct 13 13:19:28.982637 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Tenant-Name: tempest-TestShelveInstance-1469688644 Oct 13 13:19:28.982637 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-User: tempest-TestShelveInstance-1469688644-project Oct 13 13:19:28.982637 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-User-Domain-Id: default Oct 13 13:19:28.982637 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-User-Domain-Name: Default Oct 13 13:19:28.982637 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-User-Id: 6723d3c8aa144452b46564649cf38ee3 Oct 13 13:19:28.982637 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-User-Name: tempest-TestShelveInstance-1469688644-project Oct 13 13:19:28.982637 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: method: > Oct 13 13:19:28.982637 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: exception: Instance 5c481e0e-37eb-4457-813e-eb8a84932582 could not be found. Oct 13 13:19:28.982637 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: action_args: {'id': '5c481e0e-37eb-4457-813e-eb8a84932582'} Oct 13 13:19:28.983549 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 13:19:28.983549 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 13:19:28.983549 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 13 13:19:28.983549 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 13 13:19:28.983549 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 13 13:19:28.983549 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 13 13:19:28.983549 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 13 13:19:28.983549 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 13 13:19:28.983549 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 13 13:19:28.983549 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 13 13:19:28.983549 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5c481e0e-37eb-4457-813e-eb8a84932582 could not be found. Oct 13 13:19:28.983549 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi Oct 13 13:19:28.983549 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 13:19:28.983549 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi Oct 13 13:19:28.983549 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 13:19:28.983549 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 13:19:28.983549 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 13:19:28.983549 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 13:19:28.983549 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 13:19:28.983549 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 13:19:28.984854 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 13:19:28.984854 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 13 13:19:28.984854 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 13 13:19:28.984854 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 13 13:19:28.984854 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 13 13:19:28.984854 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 13 13:19:28.984854 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 13 13:19:28.984854 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5c481e0e-37eb-4457-813e-eb8a84932582 could not be found. Oct 13 13:19:28.984854 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi Oct 13 13:19:28.984854 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 13:19:28.984854 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi Oct 13 13:19:28.984854 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 13:19:28.984854 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 13:19:28.984854 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 13:19:28.984854 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 13:19:28.984854 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 13:19:28.984854 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5c481e0e-37eb-4457-813e-eb8a84932582 could not be found. Oct 13 13:19:28.984854 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi Oct 13 13:19:28.986066 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-34a2d19a-4d3f-4766-8bd7-7f92e8829529 tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Returning 404 to user: Instance 5c481e0e-37eb-4457-813e-eb8a84932582 could not be found. {{(pid=118814) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 13:19:28.986066 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-34a2d19a-4d3f-4766-8bd7-7f92e8829529 tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] 10.222.0.23 "GET /compute/v2.1/servers/5c481e0e-37eb-4457-813e-eb8a84932582" status: 404 len: 111 microversion: 2.1 time: 0.030265 Oct 13 13:19:28.986066 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 493/968] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:19:28 2022] GET /compute/v2.1/servers/5c481e0e-37eb-4457-813e-eb8a84932582 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 13 13:19:29.139696 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-4320f4fe-b70c-4961-af74-0bb3b92e46ea tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] Calling method '.version_select at 0x7f50981a0160>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:19:29.158820 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-4320f4fe-b70c-4961-af74-0bb3b92e46ea tempest-TestShelveInstance-1469688644 tempest-TestShelveInstance-1469688644-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-369055949" status: 202 len: 0 microversion: 2.1 time: 0.022799 Oct 13 13:19:29.159783 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 476/969] 10.222.0.23 () {58 vars in 1251 bytes} [Thu Oct 13 13:19:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-369055949 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 13 13:19:56.566676 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-88faa83a-78cf-4dc2-a834-d7ce0f9ed74e tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Calling method '>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:19:56.567300 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-88faa83a-78cf-4dc2-a834-d7ce0f9ed74e tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] [instance: 4f38ccc6-b8fc-416e-ab19-a6c260441f76] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:19:56.569304 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG dbcounter [-] [118814] Writing DB stats nova_api:SELECT=54,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=118814) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:19:56.569939 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG dbcounter [-] [118814] Writing DB stats nova_cell1:SELECT=85,nova_cell1:INSERT=1 {{(pid=118814) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:19:56.576735 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-88faa83a-78cf-4dc2-a834-d7ce0f9ed74e tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:19:56.577221 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-88faa83a-78cf-4dc2-a834-d7ce0f9ed74e tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:19:56.577660 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-88faa83a-78cf-4dc2-a834-d7ce0f9ed74e tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:19:56.578384 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-88faa83a-78cf-4dc2-a834-d7ce0f9ed74e tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:19:56.578835 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-88faa83a-78cf-4dc2-a834-d7ce0f9ed74e tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:19:56.579291 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-88faa83a-78cf-4dc2-a834-d7ce0f9ed74e tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:19:56.604680 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-88faa83a-78cf-4dc2-a834-d7ce0f9ed74e tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] 10.222.0.23 "GET /compute/v2.1/servers/4f38ccc6-b8fc-416e-ab19-a6c260441f76/ips" status: 200 len: 149 microversion: 2.1 time: 0.042402 Oct 13 13:19:56.605236 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 494/970] 10.222.0.23 () {58 vars in 1248 bytes} [Thu Oct 13 13:19:56 2022] GET /compute/v2.1/servers/4f38ccc6-b8fc-416e-ab19-a6c260441f76/ips => generated 149 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 13:19:57.926157 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG dbcounter [-] [118815] Writing DB stats nova_cell1:SELECT=24,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:19:57.927579 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG dbcounter [-] [118815] Writing DB stats nova_api:SELECT=76,nova_api:UPDATE=3,nova_api:DELETE=2,nova_api:INSERT=1 {{(pid=118815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:19:57.931654 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-1a6bb179-cf13-4458-8913-7066ee2885b4 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "aeb775a5-07e6-4c0d-a161-e12ce5a28adf"}} {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 13:19:57.933959 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-1a6bb179-cf13-4458-8913-7066ee2885b4 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] [instance: 4f38ccc6-b8fc-416e-ab19-a6c260441f76] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:19:57.941758 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-1a6bb179-cf13-4458-8913-7066ee2885b4 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:19:57.942260 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-1a6bb179-cf13-4458-8913-7066ee2885b4 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:19:57.942700 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-1a6bb179-cf13-4458-8913-7066ee2885b4 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:19:57.943414 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-1a6bb179-cf13-4458-8913-7066ee2885b4 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:19:57.943869 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-1a6bb179-cf13-4458-8913-7066ee2885b4 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:19:57.944302 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-1a6bb179-cf13-4458-8913-7066ee2885b4 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:19:58.393355 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-1a6bb179-cf13-4458-8913-7066ee2885b4 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] 10.222.0.23 "POST /compute/v2.1/servers/4f38ccc6-b8fc-416e-ab19-a6c260441f76/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.468457 Oct 13 13:19:58.393953 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 477/971] 10.222.0.23 () {60 vars in 1323 bytes} [Thu Oct 13 13:19:57 2022] POST /compute/v2.1/servers/4f38ccc6-b8fc-416e-ab19-a6c260441f76/os-volume_attachments => generated 194 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 13:20:04.862774 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-7a6f95aa-be02-4be3-adb2-b0e8a0105d7a tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "aeb775a5-07e6-4c0d-a161-e12ce5a28adf"}} {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 13:20:04.865183 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-7a6f95aa-be02-4be3-adb2-b0e8a0105d7a tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] [instance: 4f38ccc6-b8fc-416e-ab19-a6c260441f76] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:20:04.871634 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-7a6f95aa-be02-4be3-adb2-b0e8a0105d7a tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:20:04.872109 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-7a6f95aa-be02-4be3-adb2-b0e8a0105d7a tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:20:04.872538 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-7a6f95aa-be02-4be3-adb2-b0e8a0105d7a tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:20:04.873212 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-7a6f95aa-be02-4be3-adb2-b0e8a0105d7a tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:20:04.873654 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-7a6f95aa-be02-4be3-adb2-b0e8a0105d7a tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:20:04.874075 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-7a6f95aa-be02-4be3-adb2-b0e8a0105d7a tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:20:05.010828 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.wsgi [None req-7a6f95aa-be02-4be3-adb2-b0e8a0105d7a tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] HTTP exception thrown: Invalid volume: volume aeb775a5-07e6-4c0d-a161-e12ce5a28adf is already attached to instances: 4f38ccc6-b8fc-416e-ab19-a6c260441f76 Oct 13 13:20:05.012520 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-7a6f95aa-be02-4be3-adb2-b0e8a0105d7a tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Request method failure captured: Oct 13 13:20:05.012520 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: request: POST /compute/v2.1/servers/4f38ccc6-b8fc-416e-ab19-a6c260441f76/os-volume_attachments HTTP/1.1 Oct 13 13:20:05.012520 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: Accept: application/json Oct 13 13:20:05.012520 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: Accept-Encoding: identity Oct 13 13:20:05.012520 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: Connection: close Oct 13 13:20:05.012520 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: Content-Length: 74 Oct 13 13:20:05.012520 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: Content-Type: application/json Oct 13 13:20:05.012520 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: Host: 10.222.0.23 Oct 13 13:20:05.012520 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: Openstack-System-Scope: None Oct 13 13:20:05.012520 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: User-Agent: python-urllib3/1.26.12 Oct 13 13:20:05.012520 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Auth-Token: gAAAAABjSA_IS5ItJrPpOSqy4xNBxVB2bfXfKkj6-lkJ6r6QG2PtZPEmBejUeMw_nAM6PkRJ3-xldl5YnRyFBnqFy7XGF_zAWWgWViC-gBZjak_p4jHlI99AK4eenYmKLRCqGrNs_2qG-o4USzMyv_nCGKRj4tT-7DEE83-B1Dxr5qLtXkKFmJs Oct 13 13:20:05.012520 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Domain-Id: None Oct 13 13:20:05.012520 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Domain-Name: None Oct 13 13:20:05.012520 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Identity-Status: Confirmed Oct 13 13:20:05.012520 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Is-Admin-Project: True Oct 13 13:20:05.012520 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Project-Domain-Id: default Oct 13 13:20:05.012520 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Project-Domain-Name: Default Oct 13 13:20:05.012520 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Project-Id: da546353194342439f9bc3f98f6737e0 Oct 13 13:20:05.012520 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Project-Name: tempest-AttachVolumeNegativeTest-1392517896 Oct 13 13:20:05.012520 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Role: reader,member Oct 13 13:20:05.012520 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Roles: reader,member Oct 13 13:20:05.014006 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_da546353194342439f9bc3f98f6737e0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/da546353194342439f9bc3f98f6737e0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/da546353194342439f9bc3f98f6737e0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/da546353194342439f9bc3f98f6737e0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}] Oct 13 13:20:05.014006 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Tenant: tempest-AttachVolumeNegativeTest-1392517896 Oct 13 13:20:05.014006 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Tenant-Id: da546353194342439f9bc3f98f6737e0 Oct 13 13:20:05.014006 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1392517896 Oct 13 13:20:05.014006 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-User: tempest-AttachVolumeNegativeTest-1392517896-project Oct 13 13:20:05.014006 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-User-Domain-Id: default Oct 13 13:20:05.014006 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-User-Domain-Name: Default Oct 13 13:20:05.014006 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-User-Id: 2cd12070eb954d6880f925957184a288 Oct 13 13:20:05.014006 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-User-Name: tempest-AttachVolumeNegativeTest-1392517896-project Oct 13 13:20:05.014006 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: Oct 13 13:20:05.014006 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: {"volumeAttachment": {"volumeId": "aeb775a5-07e6-4c0d-a161-e12ce5a28adf"}} Oct 13 13:20:05.014006 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: method: > Oct 13 13:20:05.014814 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: exception: Invalid volume: volume aeb775a5-07e6-4c0d-a161-e12ce5a28adf is already attached to instances: 4f38ccc6-b8fc-416e-ab19-a6c260441f76 Oct 13 13:20:05.014814 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: action_args: {'server_id': '4f38ccc6-b8fc-416e-ab19-a6c260441f76', 'body': {'volumeAttachment': {'volumeId': 'aeb775a5-07e6-4c0d-a161-e12ce5a28adf'}}} Oct 13 13:20:05.014814 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 13:20:05.014814 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 13:20:05.014814 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Oct 13 13:20:05.014814 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Oct 13 13:20:05.014814 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 13 13:20:05.014814 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 13 13:20:05.014814 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 13 13:20:05.014814 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 13 13:20:05.014814 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Oct 13 13:20:05.014814 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Oct 13 13:20:05.014814 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Oct 13 13:20:05.014814 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Oct 13 13:20:05.014814 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume aeb775a5-07e6-4c0d-a161-e12ce5a28adf is already attached to instances: 4f38ccc6-b8fc-416e-ab19-a6c260441f76 Oct 13 13:20:05.014814 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi Oct 13 13:20:05.014814 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 13:20:05.014814 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi Oct 13 13:20:05.014814 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 13:20:05.016250 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 13:20:05.016250 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 13:20:05.016250 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 13:20:05.016250 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 13:20:05.016250 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 13:20:05.016250 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 13:20:05.016250 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 13 13:20:05.016250 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 13 13:20:05.016250 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 13 13:20:05.016250 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 13 13:20:05.016250 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 13 13:20:05.016250 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 13 13:20:05.016250 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Oct 13 13:20:05.016250 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 13 13:20:05.016250 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume aeb775a5-07e6-4c0d-a161-e12ce5a28adf is already attached to instances: 4f38ccc6-b8fc-416e-ab19-a6c260441f76 Oct 13 13:20:05.016250 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi Oct 13 13:20:05.016250 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 13:20:05.016250 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi Oct 13 13:20:05.016250 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 13:20:05.016250 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 13:20:05.017582 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 13:20:05.017582 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 13:20:05.017582 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 13:20:05.017582 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume aeb775a5-07e6-4c0d-a161-e12ce5a28adf is already attached to instances: 4f38ccc6-b8fc-416e-ab19-a6c260441f76 Oct 13 13:20:05.017582 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi Oct 13 13:20:05.017582 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-7a6f95aa-be02-4be3-adb2-b0e8a0105d7a tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Returning 400 to user: Invalid volume: volume aeb775a5-07e6-4c0d-a161-e12ce5a28adf is already attached to instances: 4f38ccc6-b8fc-416e-ab19-a6c260441f76 {{(pid=118814) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 13:20:05.017582 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-7a6f95aa-be02-4be3-adb2-b0e8a0105d7a tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] 10.222.0.23 "POST /compute/v2.1/servers/4f38ccc6-b8fc-416e-ab19-a6c260441f76/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.155193 Oct 13 13:20:05.017582 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 495/972] 10.222.0.23 () {60 vars in 1323 bytes} [Thu Oct 13 13:20:04 2022] POST /compute/v2.1/servers/4f38ccc6-b8fc-416e-ab19-a6c260441f76/os-volume_attachments => generated 174 bytes in 156 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 13 13:20:05.079733 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-86aaab96-9025-4d81-a74a-2a9b1662225c tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Calling method '>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:20:05.080313 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-86aaab96-9025-4d81-a74a-2a9b1662225c tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] [instance: 4f38ccc6-b8fc-416e-ab19-a6c260441f76] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:20:05.087146 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-86aaab96-9025-4d81-a74a-2a9b1662225c tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:20:05.087631 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-86aaab96-9025-4d81-a74a-2a9b1662225c tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:20:05.088068 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-86aaab96-9025-4d81-a74a-2a9b1662225c tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:20:05.088760 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-86aaab96-9025-4d81-a74a-2a9b1662225c tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:20:05.089224 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-86aaab96-9025-4d81-a74a-2a9b1662225c tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:20:05.089651 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-86aaab96-9025-4d81-a74a-2a9b1662225c tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:20:05.167884 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.objects.instance [None req-86aaab96-9025-4d81-a74a-2a9b1662225c tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Lazy-loading 'services' on Instance uuid 4f38ccc6-b8fc-416e-ab19-a6c260441f76 {{(pid=118815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 13 13:20:05.237970 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-86aaab96-9025-4d81-a74a-2a9b1662225c tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] 10.222.0.23 "DELETE /compute/v2.1/servers/4f38ccc6-b8fc-416e-ab19-a6c260441f76/os-volume_attachments/aeb775a5-07e6-4c0d-a161-e12ce5a28adf" status: 202 len: 0 microversion: 2.1 time: 0.163059 Oct 13 13:20:05.238595 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 478/973] 10.222.0.23 () {58 vars in 1416 bytes} [Thu Oct 13 13:20:05 2022] DELETE /compute/v2.1/servers/4f38ccc6-b8fc-416e-ab19-a6c260441f76/os-volume_attachments/aeb775a5-07e6-4c0d-a161-e12ce5a28adf => generated 0 bytes in 165 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 13 13:20:05.246810 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-d0d1ef86-7fdb-4c5b-9fef-d2544e1f50d9 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Calling method '>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:20:05.249151 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-d0d1ef86-7fdb-4c5b-9fef-d2544e1f50d9 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] [instance: 4f38ccc6-b8fc-416e-ab19-a6c260441f76] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:20:05.255502 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-d0d1ef86-7fdb-4c5b-9fef-d2544e1f50d9 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:20:05.256009 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-d0d1ef86-7fdb-4c5b-9fef-d2544e1f50d9 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:20:05.256453 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-d0d1ef86-7fdb-4c5b-9fef-d2544e1f50d9 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:20:05.257134 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-d0d1ef86-7fdb-4c5b-9fef-d2544e1f50d9 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:20:05.257615 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-d0d1ef86-7fdb-4c5b-9fef-d2544e1f50d9 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:20:05.258000 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-d0d1ef86-7fdb-4c5b-9fef-d2544e1f50d9 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:20:05.289760 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-d0d1ef86-7fdb-4c5b-9fef-d2544e1f50d9 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] 10.222.0.23 "GET /compute/v2.1/servers/4f38ccc6-b8fc-416e-ab19-a6c260441f76/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046860 Oct 13 13:20:05.290295 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 496/974] 10.222.0.23 () {58 vars in 1302 bytes} [Thu Oct 13 13:20:05 2022] GET /compute/v2.1/servers/4f38ccc6-b8fc-416e-ab19-a6c260441f76/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 13:20:06.304067 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-56895d7b-408b-4959-9a2f-01db8077a308 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Calling method '>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:20:06.306408 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-56895d7b-408b-4959-9a2f-01db8077a308 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] [instance: 4f38ccc6-b8fc-416e-ab19-a6c260441f76] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:20:06.312526 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-56895d7b-408b-4959-9a2f-01db8077a308 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:20:06.313010 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-56895d7b-408b-4959-9a2f-01db8077a308 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:20:06.313446 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-56895d7b-408b-4959-9a2f-01db8077a308 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:20:06.314132 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-56895d7b-408b-4959-9a2f-01db8077a308 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:20:06.314589 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-56895d7b-408b-4959-9a2f-01db8077a308 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:20:06.315018 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-56895d7b-408b-4959-9a2f-01db8077a308 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:20:06.346392 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-56895d7b-408b-4959-9a2f-01db8077a308 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] 10.222.0.23 "GET /compute/v2.1/servers/4f38ccc6-b8fc-416e-ab19-a6c260441f76/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047738 Oct 13 13:20:06.346937 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 479/975] 10.222.0.23 () {58 vars in 1302 bytes} [Thu Oct 13 13:20:06 2022] GET /compute/v2.1/servers/4f38ccc6-b8fc-416e-ab19-a6c260441f76/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 13 13:20:06.410490 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-42363963-20a4-4a0a-bb77-0f75774f484a tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Calling method '>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:20:06.411611 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-42363963-20a4-4a0a-bb77-0f75774f484a tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] [instance: 4f38ccc6-b8fc-416e-ab19-a6c260441f76] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:20:06.417962 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-42363963-20a4-4a0a-bb77-0f75774f484a tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:20:06.418478 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-42363963-20a4-4a0a-bb77-0f75774f484a tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:20:06.418913 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-42363963-20a4-4a0a-bb77-0f75774f484a tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:20:06.419623 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-42363963-20a4-4a0a-bb77-0f75774f484a tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:20:06.420076 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-42363963-20a4-4a0a-bb77-0f75774f484a tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:20:06.420503 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-42363963-20a4-4a0a-bb77-0f75774f484a tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:20:06.445062 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-42363963-20a4-4a0a-bb77-0f75774f484a tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] [instance: 4f38ccc6-b8fc-416e-ab19-a6c260441f76] Going to try to terminate instance {{(pid=118814) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 13 13:20:06.518409 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-42363963-20a4-4a0a-bb77-0f75774f484a tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] 10.222.0.23 "DELETE /compute/v2.1/servers/4f38ccc6-b8fc-416e-ab19-a6c260441f76" status: 204 len: 0 microversion: 2.1 time: 0.111441 Oct 13 13:20:06.519050 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 497/976] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Oct 13 13:20:06 2022] DELETE /compute/v2.1/servers/4f38ccc6-b8fc-416e-ab19-a6c260441f76 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 13 13:20:06.528479 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-b6200cc9-3018-4147-8cda-ee3ca8e7cfc5 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Calling method '>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:20:06.529090 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-b6200cc9-3018-4147-8cda-ee3ca8e7cfc5 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] [instance: 4f38ccc6-b8fc-416e-ab19-a6c260441f76] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:20:06.535315 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-b6200cc9-3018-4147-8cda-ee3ca8e7cfc5 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:20:06.536435 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-b6200cc9-3018-4147-8cda-ee3ca8e7cfc5 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:20:06.536869 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-b6200cc9-3018-4147-8cda-ee3ca8e7cfc5 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:20:06.537559 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-b6200cc9-3018-4147-8cda-ee3ca8e7cfc5 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:20:06.538015 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-b6200cc9-3018-4147-8cda-ee3ca8e7cfc5 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:20:06.538444 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-b6200cc9-3018-4147-8cda-ee3ca8e7cfc5 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:20:06.665288 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-b6200cc9-3018-4147-8cda-ee3ca8e7cfc5 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd12070eb954d6880f925957184a288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da546353194342439f9bc3f98f6737e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:20:06.673167 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-b6200cc9-3018-4147-8cda-ee3ca8e7cfc5 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] 10.222.0.23 "GET /compute/v2.1/servers/4f38ccc6-b8fc-416e-ab19-a6c260441f76" status: 200 len: 1680 microversion: 2.1 time: 0.148753 Oct 13 13:20:06.673718 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 480/977] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:20:06 2022] GET /compute/v2.1/servers/4f38ccc6-b8fc-416e-ab19-a6c260441f76 => generated 1680 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:20:07.696706 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-d94c5742-cb33-480f-8b1e-222488cd5659 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Calling method '>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:20:07.697833 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-d94c5742-cb33-480f-8b1e-222488cd5659 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] [instance: 4f38ccc6-b8fc-416e-ab19-a6c260441f76] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:20:07.704637 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-d94c5742-cb33-480f-8b1e-222488cd5659 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:20:07.705106 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-d94c5742-cb33-480f-8b1e-222488cd5659 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:20:07.705589 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-d94c5742-cb33-480f-8b1e-222488cd5659 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:20:07.706229 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-d94c5742-cb33-480f-8b1e-222488cd5659 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:20:07.706806 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-d94c5742-cb33-480f-8b1e-222488cd5659 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:20:07.707264 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-d94c5742-cb33-480f-8b1e-222488cd5659 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:20:07.836818 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-d94c5742-cb33-480f-8b1e-222488cd5659 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd12070eb954d6880f925957184a288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da546353194342439f9bc3f98f6737e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:20:07.844607 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-d94c5742-cb33-480f-8b1e-222488cd5659 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] 10.222.0.23 "GET /compute/v2.1/servers/4f38ccc6-b8fc-416e-ab19-a6c260441f76" status: 200 len: 1680 microversion: 2.1 time: 0.152262 Oct 13 13:20:07.845164 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 498/978] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:20:07 2022] GET /compute/v2.1/servers/4f38ccc6-b8fc-416e-ab19-a6c260441f76 => generated 1680 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 13:20:08.869186 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-4794a89a-0f2e-4b0f-94d8-a4d4a4579f2e tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Calling method '>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:20:08.869847 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-4794a89a-0f2e-4b0f-94d8-a4d4a4579f2e tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] [instance: 4f38ccc6-b8fc-416e-ab19-a6c260441f76] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:20:08.876352 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-4794a89a-0f2e-4b0f-94d8-a4d4a4579f2e tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:20:08.876831 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-4794a89a-0f2e-4b0f-94d8-a4d4a4579f2e tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:20:08.877263 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-4794a89a-0f2e-4b0f-94d8-a4d4a4579f2e tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:20:08.877974 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-4794a89a-0f2e-4b0f-94d8-a4d4a4579f2e tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:20:08.878421 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-4794a89a-0f2e-4b0f-94d8-a4d4a4579f2e tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:20:08.878841 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-4794a89a-0f2e-4b0f-94d8-a4d4a4579f2e tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:20:08.944810 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-4794a89a-0f2e-4b0f-94d8-a4d4a4579f2e tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd12070eb954d6880f925957184a288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da546353194342439f9bc3f98f6737e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:20:08.952653 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-4794a89a-0f2e-4b0f-94d8-a4d4a4579f2e tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] 10.222.0.23 "GET /compute/v2.1/servers/4f38ccc6-b8fc-416e-ab19-a6c260441f76" status: 200 len: 1613 microversion: 2.1 time: 0.087350 Oct 13 13:20:08.953459 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 481/979] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:20:08 2022] GET /compute/v2.1/servers/4f38ccc6-b8fc-416e-ab19-a6c260441f76 => generated 1613 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 13:20:09.115236 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [req-e0cfac26-6620-46ea-81c3-91e3a67059d9 req-9ddad105-ce0d-46f5-9b96-a33fcd041148 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f38ccc6-b8fc-416e-ab19-a6c260441f76", "name": "network-vif-deleted", "tag": "8b09485c-dde0-4558-9dcd-066fee3602c0"}]} {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 13:20:09.125272 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [req-e0cfac26-6620-46ea-81c3-91e3a67059d9 req-9ddad105-ce0d-46f5-9b96-a33fcd041148 service nova] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:20:09.127374 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [req-e0cfac26-6620-46ea-81c3-91e3a67059d9 req-9ddad105-ce0d-46f5-9b96-a33fcd041148 service nova] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:20:09.127949 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [req-e0cfac26-6620-46ea-81c3-91e3a67059d9 req-9ddad105-ce0d-46f5-9b96-a33fcd041148 service nova] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:20:09.140683 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.compute.server_external_events [req-e0cfac26-6620-46ea-81c3-91e3a67059d9 req-9ddad105-ce0d-46f5-9b96-a33fcd041148 service nova] Creating event network-vif-deleted:8b09485c-dde0-4558-9dcd-066fee3602c0 for instance 4f38ccc6-b8fc-416e-ab19-a6c260441f76 on hv-cinder-82660 Oct 13 13:20:09.145487 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [req-e0cfac26-6620-46ea-81c3-91e3a67059d9 req-9ddad105-ce0d-46f5-9b96-a33fcd041148 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034638 Oct 13 13:20:09.146082 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 499/980] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 13:20:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 13:20:09.974820 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-d7ded762-681f-46f3-aaeb-bb55f710637b tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Calling method '>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:20:09.975581 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-d7ded762-681f-46f3-aaeb-bb55f710637b tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] [instance: 4f38ccc6-b8fc-416e-ab19-a6c260441f76] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:20:09.982063 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-d7ded762-681f-46f3-aaeb-bb55f710637b tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:20:09.982550 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-d7ded762-681f-46f3-aaeb-bb55f710637b tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:20:09.982990 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-d7ded762-681f-46f3-aaeb-bb55f710637b tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:20:09.983798 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-d7ded762-681f-46f3-aaeb-bb55f710637b tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:20:09.984256 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-d7ded762-681f-46f3-aaeb-bb55f710637b tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:20:09.984688 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-d7ded762-681f-46f3-aaeb-bb55f710637b tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:20:09.997981 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.wsgi [None req-d7ded762-681f-46f3-aaeb-bb55f710637b tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] HTTP exception thrown: Instance 4f38ccc6-b8fc-416e-ab19-a6c260441f76 could not be found. Oct 13 13:20:09.999630 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-d7ded762-681f-46f3-aaeb-bb55f710637b tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Request method failure captured: Oct 13 13:20:09.999630 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: request: GET /compute/v2.1/servers/4f38ccc6-b8fc-416e-ab19-a6c260441f76 HTTP/1.1 Oct 13 13:20:09.999630 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: Accept: application/json Oct 13 13:20:09.999630 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: Accept-Encoding: identity Oct 13 13:20:09.999630 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: Connection: close Oct 13 13:20:09.999630 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: Content-Length: 0 Oct 13 13:20:09.999630 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: Content-Type: application/json Oct 13 13:20:09.999630 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: Host: 10.222.0.23 Oct 13 13:20:09.999630 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: Openstack-System-Scope: None Oct 13 13:20:09.999630 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: User-Agent: python-urllib3/1.26.12 Oct 13 13:20:09.999630 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Auth-Token: gAAAAABjSA_IS5ItJrPpOSqy4xNBxVB2bfXfKkj6-lkJ6r6QG2PtZPEmBejUeMw_nAM6PkRJ3-xldl5YnRyFBnqFy7XGF_zAWWgWViC-gBZjak_p4jHlI99AK4eenYmKLRCqGrNs_2qG-o4USzMyv_nCGKRj4tT-7DEE83-B1Dxr5qLtXkKFmJs Oct 13 13:20:09.999630 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Domain-Id: None Oct 13 13:20:09.999630 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Domain-Name: None Oct 13 13:20:09.999630 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Identity-Status: Confirmed Oct 13 13:20:09.999630 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Is-Admin-Project: True Oct 13 13:20:09.999630 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Project-Domain-Id: default Oct 13 13:20:09.999630 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Project-Domain-Name: Default Oct 13 13:20:09.999630 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Project-Id: da546353194342439f9bc3f98f6737e0 Oct 13 13:20:09.999630 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Project-Name: tempest-AttachVolumeNegativeTest-1392517896 Oct 13 13:20:09.999630 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Role: reader,member Oct 13 13:20:09.999630 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Roles: reader,member Oct 13 13:20:10.001224 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_da546353194342439f9bc3f98f6737e0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/da546353194342439f9bc3f98f6737e0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/da546353194342439f9bc3f98f6737e0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/da546353194342439f9bc3f98f6737e0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}] Oct 13 13:20:10.001224 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Tenant: tempest-AttachVolumeNegativeTest-1392517896 Oct 13 13:20:10.001224 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Tenant-Id: da546353194342439f9bc3f98f6737e0 Oct 13 13:20:10.001224 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1392517896 Oct 13 13:20:10.001224 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-User: tempest-AttachVolumeNegativeTest-1392517896-project Oct 13 13:20:10.001224 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-User-Domain-Id: default Oct 13 13:20:10.001224 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-User-Domain-Name: Default Oct 13 13:20:10.001224 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-User-Id: 2cd12070eb954d6880f925957184a288 Oct 13 13:20:10.001224 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-User-Name: tempest-AttachVolumeNegativeTest-1392517896-project Oct 13 13:20:10.001224 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: method: > Oct 13 13:20:10.001224 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: exception: Instance 4f38ccc6-b8fc-416e-ab19-a6c260441f76 could not be found. Oct 13 13:20:10.001224 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: action_args: {'id': '4f38ccc6-b8fc-416e-ab19-a6c260441f76'} Oct 13 13:20:10.002146 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 13:20:10.002146 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 13:20:10.002146 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 13 13:20:10.002146 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 13 13:20:10.002146 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 13 13:20:10.002146 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 13 13:20:10.002146 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 13 13:20:10.002146 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 13 13:20:10.002146 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 13 13:20:10.002146 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 13 13:20:10.002146 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4f38ccc6-b8fc-416e-ab19-a6c260441f76 could not be found. Oct 13 13:20:10.002146 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi Oct 13 13:20:10.002146 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 13:20:10.002146 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi Oct 13 13:20:10.002146 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 13:20:10.002146 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 13:20:10.002146 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 13:20:10.002146 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 13:20:10.002146 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 13:20:10.002146 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 13:20:10.003701 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 13:20:10.003701 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 13 13:20:10.003701 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 13 13:20:10.003701 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 13 13:20:10.003701 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 13 13:20:10.003701 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 13 13:20:10.003701 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 13 13:20:10.003701 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4f38ccc6-b8fc-416e-ab19-a6c260441f76 could not be found. Oct 13 13:20:10.003701 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi Oct 13 13:20:10.003701 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 13:20:10.003701 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi Oct 13 13:20:10.003701 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 13:20:10.003701 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 13:20:10.003701 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 13:20:10.003701 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 13:20:10.003701 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 13:20:10.003701 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4f38ccc6-b8fc-416e-ab19-a6c260441f76 could not be found. Oct 13 13:20:10.003701 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi Oct 13 13:20:10.005664 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-d7ded762-681f-46f3-aaeb-bb55f710637b tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Returning 404 to user: Instance 4f38ccc6-b8fc-416e-ab19-a6c260441f76 could not be found. {{(pid=118815) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 13:20:10.005664 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-d7ded762-681f-46f3-aaeb-bb55f710637b tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] 10.222.0.23 "GET /compute/v2.1/servers/4f38ccc6-b8fc-416e-ab19-a6c260441f76" status: 404 len: 111 microversion: 2.1 time: 0.030054 Oct 13 13:20:10.005664 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 482/981] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:20:09 2022] GET /compute/v2.1/servers/4f38ccc6-b8fc-416e-ab19-a6c260441f76 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 13 13:20:10.011499 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-c69c3a8d-5f6a-4f6d-b39b-838563ef0a29 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Calling method '.version_select at 0x7f5093d0c8b0>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:20:10.032037 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-c69c3a8d-5f6a-4f6d-b39b-838563ef0a29 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1516594483" status: 202 len: 0 microversion: 2.1 time: 0.024656 Oct 13 13:20:10.032618 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 500/982] 10.222.0.23 () {58 vars in 1221 bytes} [Thu Oct 13 13:20:10 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1516594483 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 13 13:20:10.638441 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-e2b88abb-c1e1-40d8-8320-947d36f99cc2 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Action: 'create', calling method: .version_select at 0x7f50981a0160>, body: {"keypair": {"name": "tempest-keypair-1695751037", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOK1qTl8l/qLb1ahmj971QQERzlxyl7m1Y+8/Eeh3WZoIJIGNW7kvYCmofjyucwxOhYdTLo73XSV9Bi4MmiX2PWvWdjiuspG/o9TNwOizN8p7Sg1bGpEqmmY3aw/yQQKMw=="}} {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 13:20:10.653974 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.quota [None req-e2b88abb-c1e1-40d8-8320-947d36f99cc2 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Getting quotas for project da546353194342439f9bc3f98f6737e0. Resources: {'key_pairs'} {{(pid=118815) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 13 13:20:10.657756 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.quota [None req-e2b88abb-c1e1-40d8-8320-947d36f99cc2 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Getting quotas for user 2cd12070eb954d6880f925957184a288 and project da546353194342439f9bc3f98f6737e0. Resources: {'key_pairs'} {{(pid=118815) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 13 13:20:10.678336 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-e2b88abb-c1e1-40d8-8320-947d36f99cc2 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.043797 Oct 13 13:20:10.678896 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 483/983] 10.222.0.23 () {60 vars in 1159 bytes} [Thu Oct 13 13:20:10 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 13:20:11.919608 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-1d47713d-6b6e-4b50-9583-fd84d391149e tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1289127399", "imageRef": "e2cdd20b-2540-48bc-a05c-d6a2e7e9a66e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "60c7ab31-db51-4574-8d4e-94d8596d64ad"}], "security_groups": [{"name": "tempest-securitygroup--1210182423"}], "key_name": "tempest-keypair-1695751037", "user_data": "}} {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 13:20:12.024226 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.network.neutron [None req-1d47713d-6b6e-4b50-9583-fd84d391149e tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] validate_networks() for [('60c7ab31-db51-4574-8d4e-94d8596d64ad', None, None, None, None, None)] {{(pid=118814) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 13 13:20:12.396596 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.virt.hardware [None req-1d47713d-6b6e-4b50-9583-fd84d391149e tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Flavor limits 0:0:0 {{(pid=118814) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 13 13:20:12.397016 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.virt.hardware [None req-1d47713d-6b6e-4b50-9583-fd84d391149e tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Image limits 0:0:0 {{(pid=118814) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 13 13:20:12.397487 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.virt.hardware [None req-1d47713d-6b6e-4b50-9583-fd84d391149e tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Flavor pref 0:0:0 {{(pid=118814) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 13 13:20:12.397897 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.virt.hardware [None req-1d47713d-6b6e-4b50-9583-fd84d391149e tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Image pref 0:0:0 {{(pid=118814) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 13 13:20:12.398372 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.virt.hardware [None req-1d47713d-6b6e-4b50-9583-fd84d391149e tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118814) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 13 13:20:12.407585 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-1d47713d-6b6e-4b50-9583-fd84d391149e tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:20:12.408057 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-1d47713d-6b6e-4b50-9583-fd84d391149e tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:20:12.408481 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-1d47713d-6b6e-4b50-9583-fd84d391149e tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:20:12.409199 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-1d47713d-6b6e-4b50-9583-fd84d391149e tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:20:12.409645 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-1d47713d-6b6e-4b50-9583-fd84d391149e tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:20:12.410063 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-1d47713d-6b6e-4b50-9583-fd84d391149e tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:20:12.428306 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.quota [None req-1d47713d-6b6e-4b50-9583-fd84d391149e tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Getting quotas for project da546353194342439f9bc3f98f6737e0. Resources: {'instances', 'cores', 'ram'} {{(pid=118814) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 13 13:20:12.432169 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.quota [None req-1d47713d-6b6e-4b50-9583-fd84d391149e tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Getting quotas for user 2cd12070eb954d6880f925957184a288 and project da546353194342439f9bc3f98f6737e0. Resources: {'instances', 'cores', 'ram'} {{(pid=118814) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 13 13:20:12.442786 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-1d47713d-6b6e-4b50-9583-fd84d391149e tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Going to run 1 instances... {{(pid=118814) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 13 13:20:12.445161 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-1d47713d-6b6e-4b50-9583-fd84d391149e tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] [instance: dedc0f1d-af1d-4381-b1b2-6ee8cc8a5703] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e2cdd20b-2540-48bc-a05c-d6a2e7e9a66e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118814) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 13 13:20:12.494052 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-1d47713d-6b6e-4b50-9583-fd84d391149e tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.579174 Oct 13 13:20:12.494791 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 501/984] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Oct 13 13:20:11 2022] POST /compute/v2.1/servers => generated 402 bytes in 581 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 13 13:20:12.506334 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-94968fe1-95ad-49e4-86cc-f2d6b912803d tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Calling method '>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:20:12.507643 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-94968fe1-95ad-49e4-86cc-f2d6b912803d tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] [instance: dedc0f1d-af1d-4381-b1b2-6ee8cc8a5703] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:20:12.561733 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-94968fe1-95ad-49e4-86cc-f2d6b912803d tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd12070eb954d6880f925957184a288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da546353194342439f9bc3f98f6737e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:20:12.568581 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-94968fe1-95ad-49e4-86cc-f2d6b912803d tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] 10.222.0.23 "GET /compute/v2.1/servers/dedc0f1d-af1d-4381-b1b2-6ee8cc8a5703" status: 200 len: 1242 microversion: 2.1 time: 0.066613 Oct 13 13:20:12.569139 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 484/985] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:20:12 2022] GET /compute/v2.1/servers/dedc0f1d-af1d-4381-b1b2-6ee8cc8a5703 => generated 1242 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:20:13.591809 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-59fea772-aa93-48dc-b534-ba314f5d49ff tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Calling method '>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:20:13.592460 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-59fea772-aa93-48dc-b534-ba314f5d49ff tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] [instance: dedc0f1d-af1d-4381-b1b2-6ee8cc8a5703] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:20:13.599164 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-59fea772-aa93-48dc-b534-ba314f5d49ff tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:20:13.599658 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-59fea772-aa93-48dc-b534-ba314f5d49ff tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:20:13.600094 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-59fea772-aa93-48dc-b534-ba314f5d49ff tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:20:13.600778 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-59fea772-aa93-48dc-b534-ba314f5d49ff tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:20:13.601226 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-59fea772-aa93-48dc-b534-ba314f5d49ff tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:20:13.601644 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-59fea772-aa93-48dc-b534-ba314f5d49ff tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:20:13.662933 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-59fea772-aa93-48dc-b534-ba314f5d49ff tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd12070eb954d6880f925957184a288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da546353194342439f9bc3f98f6737e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:20:13.670512 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-59fea772-aa93-48dc-b534-ba314f5d49ff tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] 10.222.0.23 "GET /compute/v2.1/servers/dedc0f1d-af1d-4381-b1b2-6ee8cc8a5703" status: 200 len: 1300 microversion: 2.1 time: 0.083324 Oct 13 13:20:13.671299 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 502/986] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:20:13 2022] GET /compute/v2.1/servers/dedc0f1d-af1d-4381-b1b2-6ee8cc8a5703 => generated 1300 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:20:14.694359 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-2cfbd180-2c42-4265-9243-3ea130c0e7fc tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Calling method '>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:20:14.694968 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-2cfbd180-2c42-4265-9243-3ea130c0e7fc tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] [instance: dedc0f1d-af1d-4381-b1b2-6ee8cc8a5703] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:20:14.702252 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-2cfbd180-2c42-4265-9243-3ea130c0e7fc tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:20:14.702735 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-2cfbd180-2c42-4265-9243-3ea130c0e7fc tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:20:14.703211 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-2cfbd180-2c42-4265-9243-3ea130c0e7fc tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:20:14.703906 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-2cfbd180-2c42-4265-9243-3ea130c0e7fc tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:20:14.704356 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-2cfbd180-2c42-4265-9243-3ea130c0e7fc tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:20:14.704782 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-2cfbd180-2c42-4265-9243-3ea130c0e7fc tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:20:14.835842 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-2cfbd180-2c42-4265-9243-3ea130c0e7fc tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd12070eb954d6880f925957184a288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da546353194342439f9bc3f98f6737e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:20:14.843845 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-2cfbd180-2c42-4265-9243-3ea130c0e7fc tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] 10.222.0.23 "GET /compute/v2.1/servers/dedc0f1d-af1d-4381-b1b2-6ee8cc8a5703" status: 200 len: 1368 microversion: 2.1 time: 0.153611 Oct 13 13:20:14.844409 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 485/987] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:20:14 2022] GET /compute/v2.1/servers/dedc0f1d-af1d-4381-b1b2-6ee8cc8a5703 => generated 1368 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:20:14.860452 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [req-e12f7fa9-1c93-40de-94c2-a7bf9d711efd req-bf152b70-5da2-4c0a-a1e2-cdeb76264d89 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dedc0f1d-af1d-4381-b1b2-6ee8cc8a5703", "tag": "0088f1ee-a58e-464b-b537-2a9b7046ee61"}]} {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 13:20:14.870689 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [req-e12f7fa9-1c93-40de-94c2-a7bf9d711efd req-bf152b70-5da2-4c0a-a1e2-cdeb76264d89 service nova] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:20:14.871299 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [req-e12f7fa9-1c93-40de-94c2-a7bf9d711efd req-bf152b70-5da2-4c0a-a1e2-cdeb76264d89 service nova] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:20:14.872033 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [req-e12f7fa9-1c93-40de-94c2-a7bf9d711efd req-bf152b70-5da2-4c0a-a1e2-cdeb76264d89 service nova] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:20:14.883876 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.compute.server_external_events [req-e12f7fa9-1c93-40de-94c2-a7bf9d711efd req-bf152b70-5da2-4c0a-a1e2-cdeb76264d89 service nova] Creating event network-changed:0088f1ee-a58e-464b-b537-2a9b7046ee61 for instance dedc0f1d-af1d-4381-b1b2-6ee8cc8a5703 on hv-cinder-82660 Oct 13 13:20:14.888828 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [req-e12f7fa9-1c93-40de-94c2-a7bf9d711efd req-bf152b70-5da2-4c0a-a1e2-cdeb76264d89 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032799 Oct 13 13:20:14.889531 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 503/988] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 13:20:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 13:20:15.867460 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-2b37181c-361f-4691-bc0a-77c4d3237180 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Calling method '>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:20:15.868074 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-2b37181c-361f-4691-bc0a-77c4d3237180 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] [instance: dedc0f1d-af1d-4381-b1b2-6ee8cc8a5703] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:20:15.874400 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-2b37181c-361f-4691-bc0a-77c4d3237180 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:20:15.874880 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-2b37181c-361f-4691-bc0a-77c4d3237180 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:20:15.875355 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-2b37181c-361f-4691-bc0a-77c4d3237180 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:20:15.876040 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-2b37181c-361f-4691-bc0a-77c4d3237180 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:20:15.876496 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-2b37181c-361f-4691-bc0a-77c4d3237180 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:20:15.876920 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-2b37181c-361f-4691-bc0a-77c4d3237180 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:20:16.008753 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-2b37181c-361f-4691-bc0a-77c4d3237180 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd12070eb954d6880f925957184a288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da546353194342439f9bc3f98f6737e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:20:16.016816 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-2b37181c-361f-4691-bc0a-77c4d3237180 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] 10.222.0.23 "GET /compute/v2.1/servers/dedc0f1d-af1d-4381-b1b2-6ee8cc8a5703" status: 200 len: 1368 microversion: 2.1 time: 0.153787 Oct 13 13:20:16.017312 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 486/989] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:20:15 2022] GET /compute/v2.1/servers/dedc0f1d-af1d-4381-b1b2-6ee8cc8a5703 => generated 1368 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:20:17.040026 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-603111aa-fbbb-4ff3-ae13-23c8036f7ff6 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Calling method '>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:20:17.040727 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-603111aa-fbbb-4ff3-ae13-23c8036f7ff6 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] [instance: dedc0f1d-af1d-4381-b1b2-6ee8cc8a5703] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:20:17.047256 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-603111aa-fbbb-4ff3-ae13-23c8036f7ff6 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:20:17.047738 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-603111aa-fbbb-4ff3-ae13-23c8036f7ff6 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:20:17.048177 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-603111aa-fbbb-4ff3-ae13-23c8036f7ff6 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:20:17.048864 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-603111aa-fbbb-4ff3-ae13-23c8036f7ff6 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:20:17.049316 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-603111aa-fbbb-4ff3-ae13-23c8036f7ff6 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:20:17.049740 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-603111aa-fbbb-4ff3-ae13-23c8036f7ff6 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:20:17.179826 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-603111aa-fbbb-4ff3-ae13-23c8036f7ff6 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd12070eb954d6880f925957184a288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da546353194342439f9bc3f98f6737e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:20:17.188132 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-603111aa-fbbb-4ff3-ae13-23c8036f7ff6 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] 10.222.0.23 "GET /compute/v2.1/servers/dedc0f1d-af1d-4381-b1b2-6ee8cc8a5703" status: 200 len: 1368 microversion: 2.1 time: 0.152856 Oct 13 13:20:17.188939 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 504/990] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:20:17 2022] GET /compute/v2.1/servers/dedc0f1d-af1d-4381-b1b2-6ee8cc8a5703 => generated 1368 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:20:18.212442 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-52539f88-309d-4c47-8f48-b8606a8e2c4d tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Calling method '>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:20:18.212995 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-52539f88-309d-4c47-8f48-b8606a8e2c4d tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] [instance: dedc0f1d-af1d-4381-b1b2-6ee8cc8a5703] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:20:18.219522 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-52539f88-309d-4c47-8f48-b8606a8e2c4d tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:20:18.220000 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-52539f88-309d-4c47-8f48-b8606a8e2c4d tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:20:18.220434 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-52539f88-309d-4c47-8f48-b8606a8e2c4d tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:20:18.221112 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-52539f88-309d-4c47-8f48-b8606a8e2c4d tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:20:18.221564 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-52539f88-309d-4c47-8f48-b8606a8e2c4d tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:20:18.221985 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-52539f88-309d-4c47-8f48-b8606a8e2c4d tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:20:18.350043 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-52539f88-309d-4c47-8f48-b8606a8e2c4d tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd12070eb954d6880f925957184a288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da546353194342439f9bc3f98f6737e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:20:18.357689 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-52539f88-309d-4c47-8f48-b8606a8e2c4d tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] 10.222.0.23 "GET /compute/v2.1/servers/dedc0f1d-af1d-4381-b1b2-6ee8cc8a5703" status: 200 len: 1368 microversion: 2.1 time: 0.149190 Oct 13 13:20:18.358248 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 487/991] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:20:18 2022] GET /compute/v2.1/servers/dedc0f1d-af1d-4381-b1b2-6ee8cc8a5703 => generated 1368 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:20:19.163913 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [req-661bd312-4cf4-4fce-a353-d030e6042994 req-0a573c13-cf24-4413-8fa5-e37cf53021a2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dedc0f1d-af1d-4381-b1b2-6ee8cc8a5703", "name": "network-vif-plugged", "status": "completed", "tag": "0088f1ee-a58e-464b-b537-2a9b7046ee61"}]} {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 13:20:19.174862 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [req-661bd312-4cf4-4fce-a353-d030e6042994 req-0a573c13-cf24-4413-8fa5-e37cf53021a2 service nova] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:20:19.175110 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [req-661bd312-4cf4-4fce-a353-d030e6042994 req-0a573c13-cf24-4413-8fa5-e37cf53021a2 service nova] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:20:19.175550 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [req-661bd312-4cf4-4fce-a353-d030e6042994 req-0a573c13-cf24-4413-8fa5-e37cf53021a2 service nova] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:20:19.187149 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.compute.server_external_events [req-661bd312-4cf4-4fce-a353-d030e6042994 req-0a573c13-cf24-4413-8fa5-e37cf53021a2 service nova] Creating event network-vif-plugged:0088f1ee-a58e-464b-b537-2a9b7046ee61 for instance dedc0f1d-af1d-4381-b1b2-6ee8cc8a5703 on hv-cinder-82660 Oct 13 13:20:19.192455 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [req-661bd312-4cf4-4fce-a353-d030e6042994 req-0a573c13-cf24-4413-8fa5-e37cf53021a2 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031805 Oct 13 13:20:19.193046 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 505/992] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 13:20:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 13:20:19.380677 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-4646e590-8990-4b4b-b37c-8c9ef4e43974 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Calling method '>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:20:19.381294 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-4646e590-8990-4b4b-b37c-8c9ef4e43974 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] [instance: dedc0f1d-af1d-4381-b1b2-6ee8cc8a5703] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:20:19.387953 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-4646e590-8990-4b4b-b37c-8c9ef4e43974 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:20:19.388440 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-4646e590-8990-4b4b-b37c-8c9ef4e43974 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:20:19.388878 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-4646e590-8990-4b4b-b37c-8c9ef4e43974 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:20:19.389582 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-4646e590-8990-4b4b-b37c-8c9ef4e43974 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:20:19.390026 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-4646e590-8990-4b4b-b37c-8c9ef4e43974 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:20:19.390455 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-4646e590-8990-4b4b-b37c-8c9ef4e43974 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:20:19.516444 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-4646e590-8990-4b4b-b37c-8c9ef4e43974 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd12070eb954d6880f925957184a288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da546353194342439f9bc3f98f6737e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:20:19.524017 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-4646e590-8990-4b4b-b37c-8c9ef4e43974 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] 10.222.0.23 "GET /compute/v2.1/servers/dedc0f1d-af1d-4381-b1b2-6ee8cc8a5703" status: 200 len: 1368 microversion: 2.1 time: 0.147759 Oct 13 13:20:19.524572 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 488/993] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:20:19 2022] GET /compute/v2.1/servers/dedc0f1d-af1d-4381-b1b2-6ee8cc8a5703 => generated 1368 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:20:20.547850 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-3bbf2f5c-4fbd-4775-a8ac-d868b8754b85 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Calling method '>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:20:20.548487 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-3bbf2f5c-4fbd-4775-a8ac-d868b8754b85 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] [instance: dedc0f1d-af1d-4381-b1b2-6ee8cc8a5703] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:20:20.554507 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-3bbf2f5c-4fbd-4775-a8ac-d868b8754b85 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:20:20.554984 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-3bbf2f5c-4fbd-4775-a8ac-d868b8754b85 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:20:20.555441 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-3bbf2f5c-4fbd-4775-a8ac-d868b8754b85 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:20:20.556112 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-3bbf2f5c-4fbd-4775-a8ac-d868b8754b85 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:20:20.556555 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-3bbf2f5c-4fbd-4775-a8ac-d868b8754b85 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:20:20.556972 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-3bbf2f5c-4fbd-4775-a8ac-d868b8754b85 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:20:20.688815 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-3bbf2f5c-4fbd-4775-a8ac-d868b8754b85 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd12070eb954d6880f925957184a288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da546353194342439f9bc3f98f6737e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:20:20.698574 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-3bbf2f5c-4fbd-4775-a8ac-d868b8754b85 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] 10.222.0.23 "GET /compute/v2.1/servers/dedc0f1d-af1d-4381-b1b2-6ee8cc8a5703" status: 200 len: 1559 microversion: 2.1 time: 0.155344 Oct 13 13:20:20.699406 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 506/994] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:20:20 2022] GET /compute/v2.1/servers/dedc0f1d-af1d-4381-b1b2-6ee8cc8a5703 => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:20:20.724103 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-bfb86feb-b840-4b74-8782-61bed6f9ad8e tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Calling method '>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:20:20.724660 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-bfb86feb-b840-4b74-8782-61bed6f9ad8e tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] [instance: dedc0f1d-af1d-4381-b1b2-6ee8cc8a5703] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:20:20.731104 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-bfb86feb-b840-4b74-8782-61bed6f9ad8e tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:20:20.731617 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-bfb86feb-b840-4b74-8782-61bed6f9ad8e tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:20:20.732057 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-bfb86feb-b840-4b74-8782-61bed6f9ad8e tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:20:20.732743 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-bfb86feb-b840-4b74-8782-61bed6f9ad8e tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:20:20.733385 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-bfb86feb-b840-4b74-8782-61bed6f9ad8e tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:20:20.733653 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-bfb86feb-b840-4b74-8782-61bed6f9ad8e tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:20:20.808991 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-bfb86feb-b840-4b74-8782-61bed6f9ad8e tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] 10.222.0.23 "GET /compute/v2.1/servers/dedc0f1d-af1d-4381-b1b2-6ee8cc8a5703/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.088759 Oct 13 13:20:20.809605 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 489/995] 10.222.0.23 () {58 vars in 1275 bytes} [Thu Oct 13 13:20:20 2022] GET /compute/v2.1/servers/dedc0f1d-af1d-4381-b1b2-6ee8cc8a5703/os-interface => generated 285 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 13:20:21.948137 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [req-fa9670d1-4eda-483d-83fa-7fd924d0eea4 req-4b083830-ce68-4d7a-93b5-ddef5ac4de74 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dedc0f1d-af1d-4381-b1b2-6ee8cc8a5703", "tag": "0088f1ee-a58e-464b-b537-2a9b7046ee61"}]} {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 13:20:21.957552 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [req-fa9670d1-4eda-483d-83fa-7fd924d0eea4 req-4b083830-ce68-4d7a-93b5-ddef5ac4de74 service nova] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:20:21.958688 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [req-fa9670d1-4eda-483d-83fa-7fd924d0eea4 req-4b083830-ce68-4d7a-93b5-ddef5ac4de74 service nova] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:20:21.959213 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [req-fa9670d1-4eda-483d-83fa-7fd924d0eea4 req-4b083830-ce68-4d7a-93b5-ddef5ac4de74 service nova] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:20:21.970435 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.compute.server_external_events [req-fa9670d1-4eda-483d-83fa-7fd924d0eea4 req-4b083830-ce68-4d7a-93b5-ddef5ac4de74 service nova] Creating event network-changed:0088f1ee-a58e-464b-b537-2a9b7046ee61 for instance dedc0f1d-af1d-4381-b1b2-6ee8cc8a5703 on hv-cinder-82660 Oct 13 13:20:21.975510 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [req-fa9670d1-4eda-483d-83fa-7fd924d0eea4 req-4b083830-ce68-4d7a-93b5-ddef5ac4de74 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030878 Oct 13 13:20:21.976179 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 507/996] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 13:20:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 13:20:24.811799 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG dbcounter [-] [118815] Writing DB stats nova_cell0:SELECT=6 {{(pid=118815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:20:24.816064 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-ad51d915-08eb-4563-bfa8-a7c49d94fd06 tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Calling method '>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:20:24.816567 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-ad51d915-08eb-4563-bfa8-a7c49d94fd06 tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] [instance: ebf57cc9-d371-41c8-b3a4-82b67889d57d] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:20:24.823394 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-ad51d915-08eb-4563-bfa8-a7c49d94fd06 tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:20:24.823877 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-ad51d915-08eb-4563-bfa8-a7c49d94fd06 tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:20:24.824317 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-ad51d915-08eb-4563-bfa8-a7c49d94fd06 tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:20:24.825003 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-ad51d915-08eb-4563-bfa8-a7c49d94fd06 tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:20:24.825463 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-ad51d915-08eb-4563-bfa8-a7c49d94fd06 tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:20:24.825889 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-ad51d915-08eb-4563-bfa8-a7c49d94fd06 tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:20:24.851931 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-ad51d915-08eb-4563-bfa8-a7c49d94fd06 tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] [instance: ebf57cc9-d371-41c8-b3a4-82b67889d57d] Going to try to terminate instance {{(pid=118815) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 13 13:20:24.932324 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-ad51d915-08eb-4563-bfa8-a7c49d94fd06 tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] 10.222.0.23 "DELETE /compute/v2.1/servers/ebf57cc9-d371-41c8-b3a4-82b67889d57d" status: 204 len: 0 microversion: 2.1 time: 0.121580 Oct 13 13:20:24.932911 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 490/997] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Oct 13 13:20:24 2022] DELETE /compute/v2.1/servers/ebf57cc9-d371-41c8-b3a4-82b67889d57d => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 13 13:20:24.939402 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG dbcounter [-] [118814] Writing DB stats nova_cell0:SELECT=2 {{(pid=118814) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:20:24.940470 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG dbcounter [-] [118814] Writing DB stats nova_cell0:SELECT=6 {{(pid=118814) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:20:24.946149 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-a0c67525-53f2-42f5-94df-4cf748d62d14 tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Calling method '>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:20:24.946873 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-a0c67525-53f2-42f5-94df-4cf748d62d14 tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] [instance: ebf57cc9-d371-41c8-b3a4-82b67889d57d] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:20:24.954021 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-a0c67525-53f2-42f5-94df-4cf748d62d14 tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:20:24.954505 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-a0c67525-53f2-42f5-94df-4cf748d62d14 tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:20:24.954943 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-a0c67525-53f2-42f5-94df-4cf748d62d14 tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:20:24.955653 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-a0c67525-53f2-42f5-94df-4cf748d62d14 tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:20:24.956105 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-a0c67525-53f2-42f5-94df-4cf748d62d14 tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:20:24.956532 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-a0c67525-53f2-42f5-94df-4cf748d62d14 tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:20:25.085744 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-a0c67525-53f2-42f5-94df-4cf748d62d14 tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd005dcc25944dfc9aeda1eb1468a0ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e1654782ac4100b0353d561496db51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:20:25.093462 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-a0c67525-53f2-42f5-94df-4cf748d62d14 tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] 10.222.0.23 "GET /compute/v2.1/servers/ebf57cc9-d371-41c8-b3a4-82b67889d57d" status: 200 len: 1579 microversion: 2.1 time: 0.155363 Oct 13 13:20:25.094020 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 508/998] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:20:24 2022] GET /compute/v2.1/servers/ebf57cc9-d371-41c8-b3a4-82b67889d57d => generated 1579 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:20:26.117012 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-8e61ee9e-1845-4f81-9002-fcb93160dba8 tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Calling method '>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:20:26.117706 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-8e61ee9e-1845-4f81-9002-fcb93160dba8 tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] [instance: ebf57cc9-d371-41c8-b3a4-82b67889d57d] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:20:26.124008 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-8e61ee9e-1845-4f81-9002-fcb93160dba8 tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:20:26.124491 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-8e61ee9e-1845-4f81-9002-fcb93160dba8 tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:20:26.124925 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-8e61ee9e-1845-4f81-9002-fcb93160dba8 tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:20:26.125613 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-8e61ee9e-1845-4f81-9002-fcb93160dba8 tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:20:26.126065 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-8e61ee9e-1845-4f81-9002-fcb93160dba8 tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:20:26.126487 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-8e61ee9e-1845-4f81-9002-fcb93160dba8 tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:20:26.257729 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-8e61ee9e-1845-4f81-9002-fcb93160dba8 tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd005dcc25944dfc9aeda1eb1468a0ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e1654782ac4100b0353d561496db51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:20:26.265355 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-8e61ee9e-1845-4f81-9002-fcb93160dba8 tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] 10.222.0.23 "GET /compute/v2.1/servers/ebf57cc9-d371-41c8-b3a4-82b67889d57d" status: 200 len: 1579 microversion: 2.1 time: 0.152626 Oct 13 13:20:26.265957 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 491/999] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:20:26 2022] GET /compute/v2.1/servers/ebf57cc9-d371-41c8-b3a4-82b67889d57d => generated 1579 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:20:27.255233 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [req-019f70c3-e054-4e6a-b0f2-10666b50e0e0 req-66b42390-49a8-4f04-88e9-c77b665c8c9e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ebf57cc9-d371-41c8-b3a4-82b67889d57d", "name": "network-vif-deleted", "tag": "de381234-2018-4c2f-93d9-84a4a3ab32c8"}]} {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 13:20:27.261865 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG dbcounter [-] [118814] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=118814) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:20:27.266759 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [req-019f70c3-e054-4e6a-b0f2-10666b50e0e0 req-66b42390-49a8-4f04-88e9-c77b665c8c9e service nova] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:20:27.267285 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [req-019f70c3-e054-4e6a-b0f2-10666b50e0e0 req-66b42390-49a8-4f04-88e9-c77b665c8c9e service nova] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:20:27.267713 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [req-019f70c3-e054-4e6a-b0f2-10666b50e0e0 req-66b42390-49a8-4f04-88e9-c77b665c8c9e service nova] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:20:27.272109 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG dbcounter [-] [118814] Writing DB stats nova_cell1:SELECT=71,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118814) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:20:27.281559 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.compute.server_external_events [req-019f70c3-e054-4e6a-b0f2-10666b50e0e0 req-66b42390-49a8-4f04-88e9-c77b665c8c9e service nova] Creating event network-vif-deleted:de381234-2018-4c2f-93d9-84a4a3ab32c8 for instance ebf57cc9-d371-41c8-b3a4-82b67889d57d on hv-cinder-82660 Oct 13 13:20:27.288251 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [req-019f70c3-e054-4e6a-b0f2-10666b50e0e0 req-66b42390-49a8-4f04-88e9-c77b665c8c9e service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036599 Oct 13 13:20:27.289135 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 509/1000] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 13:20:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 13:20:27.290496 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-e3ed50cb-5bf4-415f-b22b-156b7f75c064 tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Calling method '>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:20:27.291387 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-e3ed50cb-5bf4-415f-b22b-156b7f75c064 tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] [instance: ebf57cc9-d371-41c8-b3a4-82b67889d57d] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:20:27.299358 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-e3ed50cb-5bf4-415f-b22b-156b7f75c064 tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:20:27.299856 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-e3ed50cb-5bf4-415f-b22b-156b7f75c064 tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:20:27.300297 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-e3ed50cb-5bf4-415f-b22b-156b7f75c064 tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:20:27.301005 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-e3ed50cb-5bf4-415f-b22b-156b7f75c064 tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:20:27.302116 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-e3ed50cb-5bf4-415f-b22b-156b7f75c064 tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:20:27.302550 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-e3ed50cb-5bf4-415f-b22b-156b7f75c064 tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:20:27.370105 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-e3ed50cb-5bf4-415f-b22b-156b7f75c064 tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd005dcc25944dfc9aeda1eb1468a0ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e1654782ac4100b0353d561496db51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:20:27.374005 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG dbcounter [-] [118815] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=118815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:20:27.379096 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-e3ed50cb-5bf4-415f-b22b-156b7f75c064 tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] 10.222.0.23 "GET /compute/v2.1/servers/ebf57cc9-d371-41c8-b3a4-82b67889d57d" status: 200 len: 1226 microversion: 2.1 time: 0.094145 Oct 13 13:20:27.379890 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 492/1001] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:20:27 2022] GET /compute/v2.1/servers/ebf57cc9-d371-41c8-b3a4-82b67889d57d => generated 1226 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:20:28.401776 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-fb1e30d8-9d6e-4e98-baee-b2fc85448a49 tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Calling method '>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:20:28.402447 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-fb1e30d8-9d6e-4e98-baee-b2fc85448a49 tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] [instance: ebf57cc9-d371-41c8-b3a4-82b67889d57d] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:20:28.410929 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-fb1e30d8-9d6e-4e98-baee-b2fc85448a49 tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:20:28.411439 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-fb1e30d8-9d6e-4e98-baee-b2fc85448a49 tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:20:28.411876 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-fb1e30d8-9d6e-4e98-baee-b2fc85448a49 tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:20:28.412557 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-fb1e30d8-9d6e-4e98-baee-b2fc85448a49 tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:20:28.413010 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-fb1e30d8-9d6e-4e98-baee-b2fc85448a49 tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:20:28.413431 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-fb1e30d8-9d6e-4e98-baee-b2fc85448a49 tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:20:28.427773 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.wsgi [None req-fb1e30d8-9d6e-4e98-baee-b2fc85448a49 tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] HTTP exception thrown: Instance ebf57cc9-d371-41c8-b3a4-82b67889d57d could not be found. Oct 13 13:20:28.429415 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-fb1e30d8-9d6e-4e98-baee-b2fc85448a49 tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Request method failure captured: Oct 13 13:20:28.429415 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: request: GET /compute/v2.1/servers/ebf57cc9-d371-41c8-b3a4-82b67889d57d HTTP/1.1 Oct 13 13:20:28.429415 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: Accept: application/json Oct 13 13:20:28.429415 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: Accept-Encoding: identity Oct 13 13:20:28.429415 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: Connection: close Oct 13 13:20:28.429415 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: Content-Length: 0 Oct 13 13:20:28.429415 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: Content-Type: application/json Oct 13 13:20:28.429415 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: Host: 10.222.0.23 Oct 13 13:20:28.429415 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: Openstack-System-Scope: None Oct 13 13:20:28.429415 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: User-Agent: python-urllib3/1.26.12 Oct 13 13:20:28.429415 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Auth-Token: gAAAAABjSA_1FCQ67PHpjpU4Wwc6CXFHNinbU83FmzKFriOepDUfokfzZ8id4uD7J0tYysw9XZE5sD7lOQs-pUs-McO_QDy1XHV3SLgefdIJs_OYz-KVMIn65gwYa7fW86ZY2c6BS06BR5XLWvyN9CN4lK-VptUWMmUug9azR6ncWFuFfapFN_M Oct 13 13:20:28.429415 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Domain-Id: None Oct 13 13:20:28.429415 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Domain-Name: None Oct 13 13:20:28.429415 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Identity-Status: Confirmed Oct 13 13:20:28.429415 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Is-Admin-Project: True Oct 13 13:20:28.429415 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Project-Domain-Id: default Oct 13 13:20:28.429415 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Project-Domain-Name: Default Oct 13 13:20:28.429415 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Project-Id: 17e1654782ac4100b0353d561496db51 Oct 13 13:20:28.429415 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Project-Name: tempest-TestVolumeBootPattern-1022162848 Oct 13 13:20:28.429415 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Role: reader,member Oct 13 13:20:28.429415 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Roles: reader,member Oct 13 13:20:28.431191 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_17e1654782ac4100b0353d561496db51"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/17e1654782ac4100b0353d561496db51"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/17e1654782ac4100b0353d561496db51"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/17e1654782ac4100b0353d561496db51"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}] Oct 13 13:20:28.431191 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Tenant: tempest-TestVolumeBootPattern-1022162848 Oct 13 13:20:28.431191 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Tenant-Id: 17e1654782ac4100b0353d561496db51 Oct 13 13:20:28.431191 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Tenant-Name: tempest-TestVolumeBootPattern-1022162848 Oct 13 13:20:28.431191 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-User: tempest-TestVolumeBootPattern-1022162848-project Oct 13 13:20:28.431191 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-User-Domain-Id: default Oct 13 13:20:28.431191 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-User-Domain-Name: Default Oct 13 13:20:28.431191 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-User-Id: cd005dcc25944dfc9aeda1eb1468a0ea Oct 13 13:20:28.431191 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-User-Name: tempest-TestVolumeBootPattern-1022162848-project Oct 13 13:20:28.431191 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: method: > Oct 13 13:20:28.431191 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: exception: Instance ebf57cc9-d371-41c8-b3a4-82b67889d57d could not be found. Oct 13 13:20:28.431191 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: action_args: {'id': 'ebf57cc9-d371-41c8-b3a4-82b67889d57d'} Oct 13 13:20:28.432243 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 13:20:28.432243 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 13:20:28.432243 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 13 13:20:28.432243 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 13 13:20:28.432243 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 13 13:20:28.432243 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 13 13:20:28.432243 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 13 13:20:28.432243 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 13 13:20:28.432243 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 13 13:20:28.432243 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 13 13:20:28.432243 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ebf57cc9-d371-41c8-b3a4-82b67889d57d could not be found. Oct 13 13:20:28.432243 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi Oct 13 13:20:28.432243 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 13:20:28.432243 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi Oct 13 13:20:28.432243 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 13:20:28.432243 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 13:20:28.432243 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 13:20:28.432243 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 13:20:28.432243 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 13:20:28.432243 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 13:20:28.433885 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 13:20:28.433885 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 13 13:20:28.433885 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 13 13:20:28.433885 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 13 13:20:28.433885 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 13 13:20:28.433885 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 13 13:20:28.433885 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 13 13:20:28.433885 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ebf57cc9-d371-41c8-b3a4-82b67889d57d could not be found. Oct 13 13:20:28.433885 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi Oct 13 13:20:28.433885 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 13:20:28.433885 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi Oct 13 13:20:28.433885 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 13:20:28.433885 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 13:20:28.433885 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 13:20:28.433885 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 13:20:28.433885 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 13:20:28.433885 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ebf57cc9-d371-41c8-b3a4-82b67889d57d could not be found. Oct 13 13:20:28.433885 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi Oct 13 13:20:28.435399 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-fb1e30d8-9d6e-4e98-baee-b2fc85448a49 tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Returning 404 to user: Instance ebf57cc9-d371-41c8-b3a4-82b67889d57d could not be found. {{(pid=118814) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 13:20:28.435399 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-fb1e30d8-9d6e-4e98-baee-b2fc85448a49 tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] 10.222.0.23 "GET /compute/v2.1/servers/ebf57cc9-d371-41c8-b3a4-82b67889d57d" status: 404 len: 111 microversion: 2.1 time: 0.033791 Oct 13 13:20:28.435399 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 510/1002] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:20:28 2022] GET /compute/v2.1/servers/ebf57cc9-d371-41c8-b3a4-82b67889d57d => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 13 13:20:28.532836 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-6df7c06f-eeeb-4769-b798-4d75325223da tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1033394299", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1602157845", "security_groups": [{"name": "tempest-secgroup-smoke-1972725413"}], "block_device_mapping_v2": [{"uuid": "904d1ffc-67e2-4c0b-a0fe-8a1984528560", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "2fc51ab6-7e9b-491d-a490-ff80ae554bf0"}]}} {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 13:20:28.544153 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG dbcounter [-] [118815] Writing DB stats nova_api:SELECT=49,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=118815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:20:28.646995 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.network.neutron [None req-6df7c06f-eeeb-4769-b798-4d75325223da tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] validate_networks() for [('2fc51ab6-7e9b-491d-a490-ff80ae554bf0', None, None, None, None, None)] {{(pid=118815) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 13 13:20:29.015739 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.virt.hardware [None req-6df7c06f-eeeb-4769-b798-4d75325223da tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Flavor limits 0:0:0 {{(pid=118815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 13 13:20:29.016160 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.virt.hardware [None req-6df7c06f-eeeb-4769-b798-4d75325223da tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Image limits 0:0:0 {{(pid=118815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 13 13:20:29.016627 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.virt.hardware [None req-6df7c06f-eeeb-4769-b798-4d75325223da tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Flavor pref 0:0:0 {{(pid=118815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 13 13:20:29.017031 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.virt.hardware [None req-6df7c06f-eeeb-4769-b798-4d75325223da tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Image pref 0:0:0 {{(pid=118815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 13 13:20:29.017438 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.virt.hardware [None req-6df7c06f-eeeb-4769-b798-4d75325223da tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 13 13:20:29.026567 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-6df7c06f-eeeb-4769-b798-4d75325223da tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:20:29.027039 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-6df7c06f-eeeb-4769-b798-4d75325223da tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:20:29.027497 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-6df7c06f-eeeb-4769-b798-4d75325223da tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:20:29.028209 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-6df7c06f-eeeb-4769-b798-4d75325223da tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:20:29.028657 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-6df7c06f-eeeb-4769-b798-4d75325223da tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:20:29.029072 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-6df7c06f-eeeb-4769-b798-4d75325223da tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:20:29.045649 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.quota [None req-6df7c06f-eeeb-4769-b798-4d75325223da tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Getting quotas for project 17e1654782ac4100b0353d561496db51. Resources: {'instances', 'cores', 'ram'} {{(pid=118815) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 13 13:20:29.049800 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.quota [None req-6df7c06f-eeeb-4769-b798-4d75325223da tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Getting quotas for user cd005dcc25944dfc9aeda1eb1468a0ea and project 17e1654782ac4100b0353d561496db51. Resources: {'instances', 'cores', 'ram'} {{(pid=118815) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 13 13:20:29.104988 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-6df7c06f-eeeb-4769-b798-4d75325223da tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Going to run 1 instances... {{(pid=118815) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 13 13:20:29.107199 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-6df7c06f-eeeb-4769-b798-4d75325223da tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] [instance: 5f41cc60-bad3-4447-8c5e-9cc7f7e3c389] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='904d1ffc-67e2-4c0b-a0fe-8a1984528560',volume_size=None,volume_type=None)] {{(pid=118815) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 13 13:20:29.229842 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-6df7c06f-eeeb-4769-b798-4d75325223da tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.701155 Oct 13 13:20:29.230484 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 493/1003] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Oct 13 13:20:28 2022] POST /compute/v2.1/servers => generated 406 bytes in 702 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 13 13:20:29.241324 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-adfd0065-f509-420c-8b4a-2aa34d3c0b17 tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Calling method '>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:20:29.241966 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-adfd0065-f509-420c-8b4a-2aa34d3c0b17 tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] [instance: 5f41cc60-bad3-4447-8c5e-9cc7f7e3c389] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:20:29.301001 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-adfd0065-f509-420c-8b4a-2aa34d3c0b17 tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd005dcc25944dfc9aeda1eb1468a0ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e1654782ac4100b0353d561496db51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:20:29.307905 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-adfd0065-f509-420c-8b4a-2aa34d3c0b17 tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] 10.222.0.23 "GET /compute/v2.1/servers/5f41cc60-bad3-4447-8c5e-9cc7f7e3c389" status: 200 len: 1095 microversion: 2.1 time: 0.070387 Oct 13 13:20:29.308466 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 511/1004] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:20:29 2022] GET /compute/v2.1/servers/5f41cc60-bad3-4447-8c5e-9cc7f7e3c389 => generated 1095 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:20:30.332017 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-d4fb4236-9211-4e26-95e6-898bee8e2ad9 tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Calling method '>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:20:30.333292 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-d4fb4236-9211-4e26-95e6-898bee8e2ad9 tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] [instance: 5f41cc60-bad3-4447-8c5e-9cc7f7e3c389] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:20:30.339921 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-d4fb4236-9211-4e26-95e6-898bee8e2ad9 tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:20:30.340473 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-d4fb4236-9211-4e26-95e6-898bee8e2ad9 tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:20:30.340976 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-d4fb4236-9211-4e26-95e6-898bee8e2ad9 tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:20:30.341750 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-d4fb4236-9211-4e26-95e6-898bee8e2ad9 tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:20:30.342305 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-d4fb4236-9211-4e26-95e6-898bee8e2ad9 tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:20:30.342868 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-d4fb4236-9211-4e26-95e6-898bee8e2ad9 tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:20:30.411383 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-d4fb4236-9211-4e26-95e6-898bee8e2ad9 tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd005dcc25944dfc9aeda1eb1468a0ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e1654782ac4100b0353d561496db51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:20:30.419694 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-d4fb4236-9211-4e26-95e6-898bee8e2ad9 tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] 10.222.0.23 "GET /compute/v2.1/servers/5f41cc60-bad3-4447-8c5e-9cc7f7e3c389" status: 200 len: 1211 microversion: 2.1 time: 0.092815 Oct 13 13:20:30.420252 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 494/1005] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:20:30 2022] GET /compute/v2.1/servers/5f41cc60-bad3-4447-8c5e-9cc7f7e3c389 => generated 1211 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 13:20:31.444154 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-d93bac35-ba1f-4523-a793-2fe31a488af4 tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Calling method '>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:20:31.444772 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-d93bac35-ba1f-4523-a793-2fe31a488af4 tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] [instance: 5f41cc60-bad3-4447-8c5e-9cc7f7e3c389] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:20:31.452254 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-d93bac35-ba1f-4523-a793-2fe31a488af4 tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:20:31.452734 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-d93bac35-ba1f-4523-a793-2fe31a488af4 tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:20:31.453176 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-d93bac35-ba1f-4523-a793-2fe31a488af4 tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:20:31.453871 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-d93bac35-ba1f-4523-a793-2fe31a488af4 tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:20:31.454328 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-d93bac35-ba1f-4523-a793-2fe31a488af4 tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:20:31.454759 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-d93bac35-ba1f-4523-a793-2fe31a488af4 tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:20:31.584400 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-d93bac35-ba1f-4523-a793-2fe31a488af4 tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd005dcc25944dfc9aeda1eb1468a0ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e1654782ac4100b0353d561496db51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:20:31.592388 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-d93bac35-ba1f-4523-a793-2fe31a488af4 tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] 10.222.0.23 "GET /compute/v2.1/servers/5f41cc60-bad3-4447-8c5e-9cc7f7e3c389" status: 200 len: 1267 microversion: 2.1 time: 0.152691 Oct 13 13:20:31.592957 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 512/1006] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:20:31 2022] GET /compute/v2.1/servers/5f41cc60-bad3-4447-8c5e-9cc7f7e3c389 => generated 1267 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:20:31.728187 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [req-432e38cd-dd63-4943-aa09-b0a998f3f8b9 req-8b70207f-c195-44b0-8534-e2c6533a97c2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5f41cc60-bad3-4447-8c5e-9cc7f7e3c389", "tag": "56d3063f-8418-4251-989d-cd1d0b565ff1"}]} {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 13:20:31.737772 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [req-432e38cd-dd63-4943-aa09-b0a998f3f8b9 req-8b70207f-c195-44b0-8534-e2c6533a97c2 service nova] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:20:31.738966 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [req-432e38cd-dd63-4943-aa09-b0a998f3f8b9 req-8b70207f-c195-44b0-8534-e2c6533a97c2 service nova] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:20:31.739377 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [req-432e38cd-dd63-4943-aa09-b0a998f3f8b9 req-8b70207f-c195-44b0-8534-e2c6533a97c2 service nova] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:20:31.751605 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.compute.server_external_events [req-432e38cd-dd63-4943-aa09-b0a998f3f8b9 req-8b70207f-c195-44b0-8534-e2c6533a97c2 service nova] Creating event network-changed:56d3063f-8418-4251-989d-cd1d0b565ff1 for instance 5f41cc60-bad3-4447-8c5e-9cc7f7e3c389 on hv-cinder-82660 Oct 13 13:20:31.757159 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [req-432e38cd-dd63-4943-aa09-b0a998f3f8b9 req-8b70207f-c195-44b0-8534-e2c6533a97c2 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098806 Oct 13 13:20:31.757867 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 495/1007] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 13:20:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 13:20:32.615388 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-bfdf63eb-cf02-4e50-9880-47de487b65ed tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Calling method '>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:20:32.615929 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-bfdf63eb-cf02-4e50-9880-47de487b65ed tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] [instance: 5f41cc60-bad3-4447-8c5e-9cc7f7e3c389] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:20:32.622266 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-bfdf63eb-cf02-4e50-9880-47de487b65ed tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:20:32.622752 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-bfdf63eb-cf02-4e50-9880-47de487b65ed tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:20:32.623220 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-bfdf63eb-cf02-4e50-9880-47de487b65ed tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:20:32.623908 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-bfdf63eb-cf02-4e50-9880-47de487b65ed tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:20:32.624361 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-bfdf63eb-cf02-4e50-9880-47de487b65ed tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:20:32.624785 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-bfdf63eb-cf02-4e50-9880-47de487b65ed tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:20:32.758528 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-bfdf63eb-cf02-4e50-9880-47de487b65ed tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd005dcc25944dfc9aeda1eb1468a0ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e1654782ac4100b0353d561496db51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:20:32.766382 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-bfdf63eb-cf02-4e50-9880-47de487b65ed tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] 10.222.0.23 "GET /compute/v2.1/servers/5f41cc60-bad3-4447-8c5e-9cc7f7e3c389" status: 200 len: 1267 microversion: 2.1 time: 0.155066 Oct 13 13:20:32.766947 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 513/1008] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:20:32 2022] GET /compute/v2.1/servers/5f41cc60-bad3-4447-8c5e-9cc7f7e3c389 => generated 1267 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:20:33.791276 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-9e0209de-3af7-4a97-bb89-19a021ed2f33 tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Calling method '>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:20:33.791975 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-9e0209de-3af7-4a97-bb89-19a021ed2f33 tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] [instance: 5f41cc60-bad3-4447-8c5e-9cc7f7e3c389] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:20:33.798764 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-9e0209de-3af7-4a97-bb89-19a021ed2f33 tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:20:33.799292 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-9e0209de-3af7-4a97-bb89-19a021ed2f33 tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:20:33.799734 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-9e0209de-3af7-4a97-bb89-19a021ed2f33 tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:20:33.800422 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-9e0209de-3af7-4a97-bb89-19a021ed2f33 tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:20:33.801495 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-9e0209de-3af7-4a97-bb89-19a021ed2f33 tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:20:33.801928 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-9e0209de-3af7-4a97-bb89-19a021ed2f33 tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:20:33.929415 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-9e0209de-3af7-4a97-bb89-19a021ed2f33 tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd005dcc25944dfc9aeda1eb1468a0ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e1654782ac4100b0353d561496db51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:20:33.937108 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-9e0209de-3af7-4a97-bb89-19a021ed2f33 tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] 10.222.0.23 "GET /compute/v2.1/servers/5f41cc60-bad3-4447-8c5e-9cc7f7e3c389" status: 200 len: 1267 microversion: 2.1 time: 0.150112 Oct 13 13:20:33.937665 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 496/1009] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:20:33 2022] GET /compute/v2.1/servers/5f41cc60-bad3-4447-8c5e-9cc7f7e3c389 => generated 1267 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:20:34.959161 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-96cf2d93-23fe-473d-a33b-fd2805192622 tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Calling method '>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:20:34.959776 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-96cf2d93-23fe-473d-a33b-fd2805192622 tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] [instance: 5f41cc60-bad3-4447-8c5e-9cc7f7e3c389] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:20:34.966216 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-96cf2d93-23fe-473d-a33b-fd2805192622 tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:20:34.966698 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-96cf2d93-23fe-473d-a33b-fd2805192622 tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:20:34.967196 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-96cf2d93-23fe-473d-a33b-fd2805192622 tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:20:34.967909 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-96cf2d93-23fe-473d-a33b-fd2805192622 tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:20:34.968363 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-96cf2d93-23fe-473d-a33b-fd2805192622 tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:20:34.968794 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-96cf2d93-23fe-473d-a33b-fd2805192622 tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:20:35.097539 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-96cf2d93-23fe-473d-a33b-fd2805192622 tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd005dcc25944dfc9aeda1eb1468a0ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e1654782ac4100b0353d561496db51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:20:35.105151 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-96cf2d93-23fe-473d-a33b-fd2805192622 tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] 10.222.0.23 "GET /compute/v2.1/servers/5f41cc60-bad3-4447-8c5e-9cc7f7e3c389" status: 200 len: 1267 microversion: 2.1 time: 0.149985 Oct 13 13:20:35.105753 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 514/1010] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:20:34 2022] GET /compute/v2.1/servers/5f41cc60-bad3-4447-8c5e-9cc7f7e3c389 => generated 1267 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:20:36.128184 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-6b495aa2-b126-499c-9a7f-8c4c65a6c254 tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Calling method '>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:20:36.128823 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-6b495aa2-b126-499c-9a7f-8c4c65a6c254 tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] [instance: 5f41cc60-bad3-4447-8c5e-9cc7f7e3c389] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:20:36.135851 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-6b495aa2-b126-499c-9a7f-8c4c65a6c254 tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:20:36.136337 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-6b495aa2-b126-499c-9a7f-8c4c65a6c254 tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:20:36.136771 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-6b495aa2-b126-499c-9a7f-8c4c65a6c254 tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:20:36.137457 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-6b495aa2-b126-499c-9a7f-8c4c65a6c254 tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:20:36.137911 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-6b495aa2-b126-499c-9a7f-8c4c65a6c254 tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:20:36.138333 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-6b495aa2-b126-499c-9a7f-8c4c65a6c254 tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:20:36.268051 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-6b495aa2-b126-499c-9a7f-8c4c65a6c254 tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd005dcc25944dfc9aeda1eb1468a0ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e1654782ac4100b0353d561496db51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:20:36.276213 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-6b495aa2-b126-499c-9a7f-8c4c65a6c254 tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] 10.222.0.23 "GET /compute/v2.1/servers/5f41cc60-bad3-4447-8c5e-9cc7f7e3c389" status: 200 len: 1267 microversion: 2.1 time: 0.151967 Oct 13 13:20:36.276767 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 497/1011] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:20:36 2022] GET /compute/v2.1/servers/5f41cc60-bad3-4447-8c5e-9cc7f7e3c389 => generated 1267 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:20:37.297978 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-db0c5018-d882-42b2-a680-d913d1dd43ad tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Calling method '>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:20:37.298592 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-db0c5018-d882-42b2-a680-d913d1dd43ad tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] [instance: 5f41cc60-bad3-4447-8c5e-9cc7f7e3c389] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:20:37.304862 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-db0c5018-d882-42b2-a680-d913d1dd43ad tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:20:37.305349 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-db0c5018-d882-42b2-a680-d913d1dd43ad tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:20:37.305787 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-db0c5018-d882-42b2-a680-d913d1dd43ad tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:20:37.306473 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-db0c5018-d882-42b2-a680-d913d1dd43ad tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:20:37.306925 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-db0c5018-d882-42b2-a680-d913d1dd43ad tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:20:37.307379 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-db0c5018-d882-42b2-a680-d913d1dd43ad tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:20:37.433608 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-db0c5018-d882-42b2-a680-d913d1dd43ad tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd005dcc25944dfc9aeda1eb1468a0ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e1654782ac4100b0353d561496db51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:20:37.441258 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-db0c5018-d882-42b2-a680-d913d1dd43ad tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] 10.222.0.23 "GET /compute/v2.1/servers/5f41cc60-bad3-4447-8c5e-9cc7f7e3c389" status: 200 len: 1267 microversion: 2.1 time: 0.147423 Oct 13 13:20:37.442322 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 515/1012] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:20:37 2022] GET /compute/v2.1/servers/5f41cc60-bad3-4447-8c5e-9cc7f7e3c389 => generated 1267 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:20:38.463795 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-9a3f90f3-404c-4f2e-a51c-005b1bf81fd5 tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Calling method '>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:20:38.464399 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-9a3f90f3-404c-4f2e-a51c-005b1bf81fd5 tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] [instance: 5f41cc60-bad3-4447-8c5e-9cc7f7e3c389] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:20:38.470770 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-9a3f90f3-404c-4f2e-a51c-005b1bf81fd5 tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:20:38.471278 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-9a3f90f3-404c-4f2e-a51c-005b1bf81fd5 tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:20:38.471710 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-9a3f90f3-404c-4f2e-a51c-005b1bf81fd5 tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:20:38.472389 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-9a3f90f3-404c-4f2e-a51c-005b1bf81fd5 tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:20:38.473340 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-9a3f90f3-404c-4f2e-a51c-005b1bf81fd5 tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:20:38.473759 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-9a3f90f3-404c-4f2e-a51c-005b1bf81fd5 tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:20:38.605513 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-9a3f90f3-404c-4f2e-a51c-005b1bf81fd5 tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd005dcc25944dfc9aeda1eb1468a0ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e1654782ac4100b0353d561496db51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:20:38.613201 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-9a3f90f3-404c-4f2e-a51c-005b1bf81fd5 tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] 10.222.0.23 "GET /compute/v2.1/servers/5f41cc60-bad3-4447-8c5e-9cc7f7e3c389" status: 200 len: 1267 microversion: 2.1 time: 0.153219 Oct 13 13:20:38.613764 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 498/1013] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:20:38 2022] GET /compute/v2.1/servers/5f41cc60-bad3-4447-8c5e-9cc7f7e3c389 => generated 1267 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:20:39.636266 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-c11c9595-d693-4a6f-877a-f8cf3e942a49 tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Calling method '>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:20:39.637008 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-c11c9595-d693-4a6f-877a-f8cf3e942a49 tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] [instance: 5f41cc60-bad3-4447-8c5e-9cc7f7e3c389] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:20:39.639074 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG dbcounter [-] [118814] Writing DB stats nova_cell0:SELECT=2 {{(pid=118814) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:20:39.645158 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-c11c9595-d693-4a6f-877a-f8cf3e942a49 tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:20:39.645681 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-c11c9595-d693-4a6f-877a-f8cf3e942a49 tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:20:39.646125 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-c11c9595-d693-4a6f-877a-f8cf3e942a49 tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:20:39.646827 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-c11c9595-d693-4a6f-877a-f8cf3e942a49 tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:20:39.647314 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-c11c9595-d693-4a6f-877a-f8cf3e942a49 tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:20:39.647768 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-c11c9595-d693-4a6f-877a-f8cf3e942a49 tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:20:39.778905 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-c11c9595-d693-4a6f-877a-f8cf3e942a49 tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd005dcc25944dfc9aeda1eb1468a0ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e1654782ac4100b0353d561496db51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:20:39.787152 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-c11c9595-d693-4a6f-877a-f8cf3e942a49 tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] 10.222.0.23 "GET /compute/v2.1/servers/5f41cc60-bad3-4447-8c5e-9cc7f7e3c389" status: 200 len: 1267 microversion: 2.1 time: 0.154973 Oct 13 13:20:39.787712 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 516/1014] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:20:39 2022] GET /compute/v2.1/servers/5f41cc60-bad3-4447-8c5e-9cc7f7e3c389 => generated 1267 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:20:40.809670 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-5532d7ad-3b94-464a-a7df-56d2b8a3a5b3 tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Calling method '>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:20:40.810286 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-5532d7ad-3b94-464a-a7df-56d2b8a3a5b3 tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] [instance: 5f41cc60-bad3-4447-8c5e-9cc7f7e3c389] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:20:40.812334 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG dbcounter [-] [118815] Writing DB stats nova_cell0:SELECT=2 {{(pid=118815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:20:40.813185 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG dbcounter [-] [118815] Writing DB stats nova_cell0:SELECT=6 {{(pid=118815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:20:40.820454 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-5532d7ad-3b94-464a-a7df-56d2b8a3a5b3 tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:20:40.820936 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-5532d7ad-3b94-464a-a7df-56d2b8a3a5b3 tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:20:40.821376 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-5532d7ad-3b94-464a-a7df-56d2b8a3a5b3 tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:20:40.822067 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-5532d7ad-3b94-464a-a7df-56d2b8a3a5b3 tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:20:40.822523 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-5532d7ad-3b94-464a-a7df-56d2b8a3a5b3 tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:20:40.822948 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-5532d7ad-3b94-464a-a7df-56d2b8a3a5b3 tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:20:40.954722 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-5532d7ad-3b94-464a-a7df-56d2b8a3a5b3 tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd005dcc25944dfc9aeda1eb1468a0ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e1654782ac4100b0353d561496db51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:20:40.962814 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-5532d7ad-3b94-464a-a7df-56d2b8a3a5b3 tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] 10.222.0.23 "GET /compute/v2.1/servers/5f41cc60-bad3-4447-8c5e-9cc7f7e3c389" status: 200 len: 1267 microversion: 2.1 time: 0.157038 Oct 13 13:20:40.963412 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 499/1015] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:20:40 2022] GET /compute/v2.1/servers/5f41cc60-bad3-4447-8c5e-9cc7f7e3c389 => generated 1267 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:20:41.347674 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [req-383fd444-e33a-4597-aab0-8b15d312014f req-86e986b5-72a5-4f84-b8d0-ff936535b93b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5f41cc60-bad3-4447-8c5e-9cc7f7e3c389", "name": "network-vif-plugged", "status": "completed", "tag": "56d3063f-8418-4251-989d-cd1d0b565ff1"}]} {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 13:20:41.357238 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [req-383fd444-e33a-4597-aab0-8b15d312014f req-86e986b5-72a5-4f84-b8d0-ff936535b93b service nova] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:20:41.357720 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [req-383fd444-e33a-4597-aab0-8b15d312014f req-86e986b5-72a5-4f84-b8d0-ff936535b93b service nova] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:20:41.358155 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [req-383fd444-e33a-4597-aab0-8b15d312014f req-86e986b5-72a5-4f84-b8d0-ff936535b93b service nova] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:20:41.369134 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.compute.server_external_events [req-383fd444-e33a-4597-aab0-8b15d312014f req-86e986b5-72a5-4f84-b8d0-ff936535b93b service nova] Creating event network-vif-plugged:56d3063f-8418-4251-989d-cd1d0b565ff1 for instance 5f41cc60-bad3-4447-8c5e-9cc7f7e3c389 on hv-cinder-82660 Oct 13 13:20:41.374098 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [req-383fd444-e33a-4597-aab0-8b15d312014f req-86e986b5-72a5-4f84-b8d0-ff936535b93b service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088956 Oct 13 13:20:41.374675 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 517/1016] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 13:20:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 13:20:41.985953 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-93694708-8177-4c37-b7e3-22b051596ebd tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Calling method '>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:20:41.986584 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-93694708-8177-4c37-b7e3-22b051596ebd tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] [instance: 5f41cc60-bad3-4447-8c5e-9cc7f7e3c389] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:20:41.993566 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-93694708-8177-4c37-b7e3-22b051596ebd tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:20:41.994045 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-93694708-8177-4c37-b7e3-22b051596ebd tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:20:41.994534 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-93694708-8177-4c37-b7e3-22b051596ebd tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:20:42.001488 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-93694708-8177-4c37-b7e3-22b051596ebd tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:20:42.001981 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-93694708-8177-4c37-b7e3-22b051596ebd tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:20:42.002416 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-93694708-8177-4c37-b7e3-22b051596ebd tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:20:42.130022 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-93694708-8177-4c37-b7e3-22b051596ebd tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd005dcc25944dfc9aeda1eb1468a0ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e1654782ac4100b0353d561496db51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:20:42.137561 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-93694708-8177-4c37-b7e3-22b051596ebd tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] 10.222.0.23 "GET /compute/v2.1/servers/5f41cc60-bad3-4447-8c5e-9cc7f7e3c389" status: 200 len: 1267 microversion: 2.1 time: 0.155550 Oct 13 13:20:42.138111 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 500/1017] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:20:41 2022] GET /compute/v2.1/servers/5f41cc60-bad3-4447-8c5e-9cc7f7e3c389 => generated 1267 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:20:43.161544 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-39c46a47-5929-4e58-abd3-cefbd8a2141f tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Calling method '>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:20:43.162151 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-39c46a47-5929-4e58-abd3-cefbd8a2141f tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] [instance: 5f41cc60-bad3-4447-8c5e-9cc7f7e3c389] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:20:43.168252 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-39c46a47-5929-4e58-abd3-cefbd8a2141f tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:20:43.168753 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-39c46a47-5929-4e58-abd3-cefbd8a2141f tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:20:43.169185 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-39c46a47-5929-4e58-abd3-cefbd8a2141f tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:20:43.169862 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-39c46a47-5929-4e58-abd3-cefbd8a2141f tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:20:43.170307 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-39c46a47-5929-4e58-abd3-cefbd8a2141f tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:20:43.170730 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-39c46a47-5929-4e58-abd3-cefbd8a2141f tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:20:43.299082 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-39c46a47-5929-4e58-abd3-cefbd8a2141f tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd005dcc25944dfc9aeda1eb1468a0ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e1654782ac4100b0353d561496db51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:20:43.306755 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-39c46a47-5929-4e58-abd3-cefbd8a2141f tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] 10.222.0.23 "GET /compute/v2.1/servers/5f41cc60-bad3-4447-8c5e-9cc7f7e3c389" status: 200 len: 1454 microversion: 2.1 time: 0.150562 Oct 13 13:20:43.307349 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 518/1018] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:20:43 2022] GET /compute/v2.1/servers/5f41cc60-bad3-4447-8c5e-9cc7f7e3c389 => generated 1454 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:20:43.328323 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-e2dd9f5d-334b-4770-8f02-43f661626cea tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Calling method '>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:20:43.328927 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-e2dd9f5d-334b-4770-8f02-43f661626cea tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] [instance: 5f41cc60-bad3-4447-8c5e-9cc7f7e3c389] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:20:43.335888 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-e2dd9f5d-334b-4770-8f02-43f661626cea tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:20:43.336375 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-e2dd9f5d-334b-4770-8f02-43f661626cea tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:20:43.336813 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-e2dd9f5d-334b-4770-8f02-43f661626cea tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:20:43.337508 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-e2dd9f5d-334b-4770-8f02-43f661626cea tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:20:43.337997 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-e2dd9f5d-334b-4770-8f02-43f661626cea tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:20:43.338425 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-e2dd9f5d-334b-4770-8f02-43f661626cea tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:20:43.473224 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-e2dd9f5d-334b-4770-8f02-43f661626cea tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd005dcc25944dfc9aeda1eb1468a0ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e1654782ac4100b0353d561496db51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:20:43.481011 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-e2dd9f5d-334b-4770-8f02-43f661626cea tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] 10.222.0.23 "GET /compute/v2.1/servers/5f41cc60-bad3-4447-8c5e-9cc7f7e3c389" status: 200 len: 1454 microversion: 2.1 time: 0.156461 Oct 13 13:20:43.481570 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 501/1019] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:20:43 2022] GET /compute/v2.1/servers/5f41cc60-bad3-4447-8c5e-9cc7f7e3c389 => generated 1454 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:20:45.279396 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [req-4fadd5de-cb5b-4b4a-9b2a-b2b5619a70e5 req-2b2bf513-43c7-4855-abea-5367f514be58 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5f41cc60-bad3-4447-8c5e-9cc7f7e3c389", "tag": "56d3063f-8418-4251-989d-cd1d0b565ff1"}]} {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 13:20:45.289072 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [req-4fadd5de-cb5b-4b4a-9b2a-b2b5619a70e5 req-2b2bf513-43c7-4855-abea-5367f514be58 service nova] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:20:45.289543 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [req-4fadd5de-cb5b-4b4a-9b2a-b2b5619a70e5 req-2b2bf513-43c7-4855-abea-5367f514be58 service nova] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:20:45.289969 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [req-4fadd5de-cb5b-4b4a-9b2a-b2b5619a70e5 req-2b2bf513-43c7-4855-abea-5367f514be58 service nova] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:20:45.301630 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.compute.server_external_events [req-4fadd5de-cb5b-4b4a-9b2a-b2b5619a70e5 req-2b2bf513-43c7-4855-abea-5367f514be58 service nova] Creating event network-changed:56d3063f-8418-4251-989d-cd1d0b565ff1 for instance 5f41cc60-bad3-4447-8c5e-9cc7f7e3c389 on hv-cinder-82660 Oct 13 13:20:45.306527 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [req-4fadd5de-cb5b-4b4a-9b2a-b2b5619a70e5 req-2b2bf513-43c7-4855-abea-5367f514be58 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030759 Oct 13 13:20:45.307128 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 519/1020] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 13:20:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 13:20:57.671732 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-a3308516-a77c-45ef-8261-a90ed9cb9976 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Calling method '>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:20:57.672303 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-a3308516-a77c-45ef-8261-a90ed9cb9976 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] [instance: dedc0f1d-af1d-4381-b1b2-6ee8cc8a5703] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:20:57.674203 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG dbcounter [-] [118815] Writing DB stats nova_api:SELECT=30,nova_api:INSERT=3 {{(pid=118815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:20:57.675039 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG dbcounter [-] [118815] Writing DB stats nova_cell1:SELECT=46 {{(pid=118815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:20:57.681739 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-a3308516-a77c-45ef-8261-a90ed9cb9976 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:20:57.682215 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-a3308516-a77c-45ef-8261-a90ed9cb9976 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:20:57.682645 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-a3308516-a77c-45ef-8261-a90ed9cb9976 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:20:57.683378 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-a3308516-a77c-45ef-8261-a90ed9cb9976 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:20:57.683828 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-a3308516-a77c-45ef-8261-a90ed9cb9976 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:20:57.684251 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-a3308516-a77c-45ef-8261-a90ed9cb9976 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:20:57.709960 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-a3308516-a77c-45ef-8261-a90ed9cb9976 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] 10.222.0.23 "GET /compute/v2.1/servers/dedc0f1d-af1d-4381-b1b2-6ee8cc8a5703/ips" status: 200 len: 151 microversion: 2.1 time: 0.042574 Oct 13 13:20:57.710513 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 502/1021] 10.222.0.23 () {58 vars in 1248 bytes} [Thu Oct 13 13:20:57 2022] GET /compute/v2.1/servers/dedc0f1d-af1d-4381-b1b2-6ee8cc8a5703/ips => generated 151 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 13:20:59.030714 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG dbcounter [-] [118814] Writing DB stats nova_api:SELECT=23 {{(pid=118814) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:20:59.031493 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG dbcounter [-] [118814] Writing DB stats nova_cell1:SELECT=43 {{(pid=118814) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:20:59.036353 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-03133e33-db49-474f-a728-6a50629670cf tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e25288bb-bfae-47ef-9203-265c8a6223b5"}} {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 13:20:59.038782 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-03133e33-db49-474f-a728-6a50629670cf tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] [instance: dedc0f1d-af1d-4381-b1b2-6ee8cc8a5703] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:20:59.045575 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-03133e33-db49-474f-a728-6a50629670cf tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:20:59.046320 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-03133e33-db49-474f-a728-6a50629670cf tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:20:59.046759 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-03133e33-db49-474f-a728-6a50629670cf tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:20:59.047478 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-03133e33-db49-474f-a728-6a50629670cf tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:20:59.047932 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-03133e33-db49-474f-a728-6a50629670cf tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:20:59.048358 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-03133e33-db49-474f-a728-6a50629670cf tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:20:59.283819 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-03133e33-db49-474f-a728-6a50629670cf tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] 10.222.0.23 "POST /compute/v2.1/servers/dedc0f1d-af1d-4381-b1b2-6ee8cc8a5703/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.254326 Oct 13 13:20:59.284432 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 520/1022] 10.222.0.23 () {60 vars in 1323 bytes} [Thu Oct 13 13:20:59 2022] POST /compute/v2.1/servers/dedc0f1d-af1d-4381-b1b2-6ee8cc8a5703/os-volume_attachments => generated 194 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 13:21:05.850236 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-825b6f3b-49e6-491a-a9cc-35fd10e35c60 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Calling method '>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:21:05.850809 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-825b6f3b-49e6-491a-a9cc-35fd10e35c60 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] [instance: dedc0f1d-af1d-4381-b1b2-6ee8cc8a5703] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:21:05.857355 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-825b6f3b-49e6-491a-a9cc-35fd10e35c60 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:21:05.857830 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-825b6f3b-49e6-491a-a9cc-35fd10e35c60 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:21:05.858261 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-825b6f3b-49e6-491a-a9cc-35fd10e35c60 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:21:05.858943 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-825b6f3b-49e6-491a-a9cc-35fd10e35c60 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:21:05.859423 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-825b6f3b-49e6-491a-a9cc-35fd10e35c60 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:21:05.859846 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-825b6f3b-49e6-491a-a9cc-35fd10e35c60 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:21:05.938972 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.objects.instance [None req-825b6f3b-49e6-491a-a9cc-35fd10e35c60 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Lazy-loading 'services' on Instance uuid dedc0f1d-af1d-4381-b1b2-6ee8cc8a5703 {{(pid=118815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 13 13:21:06.009071 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-825b6f3b-49e6-491a-a9cc-35fd10e35c60 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] 10.222.0.23 "DELETE /compute/v2.1/servers/dedc0f1d-af1d-4381-b1b2-6ee8cc8a5703/os-volume_attachments/e25288bb-bfae-47ef-9203-265c8a6223b5" status: 202 len: 0 microversion: 2.1 time: 0.164033 Oct 13 13:21:06.009675 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 503/1023] 10.222.0.23 () {58 vars in 1416 bytes} [Thu Oct 13 13:21:05 2022] DELETE /compute/v2.1/servers/dedc0f1d-af1d-4381-b1b2-6ee8cc8a5703/os-volume_attachments/e25288bb-bfae-47ef-9203-265c8a6223b5 => generated 0 bytes in 165 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 13 13:21:06.020415 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-7f31655b-b7c6-4762-abff-45443c5469ba tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Calling method '>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:21:06.022843 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-7f31655b-b7c6-4762-abff-45443c5469ba tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] [instance: dedc0f1d-af1d-4381-b1b2-6ee8cc8a5703] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:21:06.030100 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-7f31655b-b7c6-4762-abff-45443c5469ba tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:21:06.030591 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-7f31655b-b7c6-4762-abff-45443c5469ba tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:21:06.031283 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-7f31655b-b7c6-4762-abff-45443c5469ba tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:21:06.031988 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-7f31655b-b7c6-4762-abff-45443c5469ba tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:21:06.032453 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-7f31655b-b7c6-4762-abff-45443c5469ba tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:21:06.032887 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-7f31655b-b7c6-4762-abff-45443c5469ba tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:21:06.065070 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-7f31655b-b7c6-4762-abff-45443c5469ba tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] 10.222.0.23 "GET /compute/v2.1/servers/dedc0f1d-af1d-4381-b1b2-6ee8cc8a5703/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050242 Oct 13 13:21:06.065797 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 521/1024] 10.222.0.23 () {58 vars in 1302 bytes} [Thu Oct 13 13:21:06 2022] GET /compute/v2.1/servers/dedc0f1d-af1d-4381-b1b2-6ee8cc8a5703/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 13:21:07.078932 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-3cd53a5c-89c1-4a35-a7e7-5b12d5f1f432 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Calling method '>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:21:07.081303 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-3cd53a5c-89c1-4a35-a7e7-5b12d5f1f432 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] [instance: dedc0f1d-af1d-4381-b1b2-6ee8cc8a5703] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:21:07.087620 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-3cd53a5c-89c1-4a35-a7e7-5b12d5f1f432 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:21:07.088113 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-3cd53a5c-89c1-4a35-a7e7-5b12d5f1f432 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:21:07.088551 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-3cd53a5c-89c1-4a35-a7e7-5b12d5f1f432 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:21:07.089301 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-3cd53a5c-89c1-4a35-a7e7-5b12d5f1f432 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:21:07.089760 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-3cd53a5c-89c1-4a35-a7e7-5b12d5f1f432 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:21:07.090191 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-3cd53a5c-89c1-4a35-a7e7-5b12d5f1f432 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:21:07.119735 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-3cd53a5c-89c1-4a35-a7e7-5b12d5f1f432 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] 10.222.0.23 "GET /compute/v2.1/servers/dedc0f1d-af1d-4381-b1b2-6ee8cc8a5703/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045586 Oct 13 13:21:07.120312 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 504/1025] 10.222.0.23 () {58 vars in 1302 bytes} [Thu Oct 13 13:21:07 2022] GET /compute/v2.1/servers/dedc0f1d-af1d-4381-b1b2-6ee8cc8a5703/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 13 13:21:07.183378 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-8663d5da-6d47-40b4-a601-fccbeb2004ba tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Calling method '>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:21:07.183919 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-8663d5da-6d47-40b4-a601-fccbeb2004ba tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] [instance: dedc0f1d-af1d-4381-b1b2-6ee8cc8a5703] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:21:07.190346 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-8663d5da-6d47-40b4-a601-fccbeb2004ba tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:21:07.191033 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-8663d5da-6d47-40b4-a601-fccbeb2004ba tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:21:07.192048 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-8663d5da-6d47-40b4-a601-fccbeb2004ba tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:21:07.192750 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-8663d5da-6d47-40b4-a601-fccbeb2004ba tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:21:07.193214 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-8663d5da-6d47-40b4-a601-fccbeb2004ba tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:21:07.193656 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-8663d5da-6d47-40b4-a601-fccbeb2004ba tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:21:07.221059 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-8663d5da-6d47-40b4-a601-fccbeb2004ba tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] [instance: dedc0f1d-af1d-4381-b1b2-6ee8cc8a5703] Going to try to terminate instance {{(pid=118814) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 13 13:21:07.298714 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-8663d5da-6d47-40b4-a601-fccbeb2004ba tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] 10.222.0.23 "DELETE /compute/v2.1/servers/dedc0f1d-af1d-4381-b1b2-6ee8cc8a5703" status: 204 len: 0 microversion: 2.1 time: 0.118894 Oct 13 13:21:07.299676 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 522/1026] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Oct 13 13:21:07 2022] DELETE /compute/v2.1/servers/dedc0f1d-af1d-4381-b1b2-6ee8cc8a5703 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 13 13:21:07.308316 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-0e3e6658-df2b-4544-9bc9-f0c9f4786c9a tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Calling method '>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:21:07.308843 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-0e3e6658-df2b-4544-9bc9-f0c9f4786c9a tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] [instance: dedc0f1d-af1d-4381-b1b2-6ee8cc8a5703] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:21:07.314712 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-0e3e6658-df2b-4544-9bc9-f0c9f4786c9a tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:21:07.315247 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-0e3e6658-df2b-4544-9bc9-f0c9f4786c9a tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:21:07.315690 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-0e3e6658-df2b-4544-9bc9-f0c9f4786c9a tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:21:07.316952 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-0e3e6658-df2b-4544-9bc9-f0c9f4786c9a tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:21:07.317416 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-0e3e6658-df2b-4544-9bc9-f0c9f4786c9a tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:21:07.317845 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-0e3e6658-df2b-4544-9bc9-f0c9f4786c9a tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:21:07.444551 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-0e3e6658-df2b-4544-9bc9-f0c9f4786c9a tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd12070eb954d6880f925957184a288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da546353194342439f9bc3f98f6737e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:21:07.452226 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-0e3e6658-df2b-4544-9bc9-f0c9f4786c9a tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] 10.222.0.23 "GET /compute/v2.1/servers/dedc0f1d-af1d-4381-b1b2-6ee8cc8a5703" status: 200 len: 1684 microversion: 2.1 time: 0.147931 Oct 13 13:21:07.452788 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 505/1027] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:21:07 2022] GET /compute/v2.1/servers/dedc0f1d-af1d-4381-b1b2-6ee8cc8a5703 => generated 1684 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:21:08.476266 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-92ecfcf6-395d-4784-bc48-13bb3c35325b tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Calling method '>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:21:08.476960 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-92ecfcf6-395d-4784-bc48-13bb3c35325b tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] [instance: dedc0f1d-af1d-4381-b1b2-6ee8cc8a5703] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:21:08.483932 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-92ecfcf6-395d-4784-bc48-13bb3c35325b tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:21:08.484598 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-92ecfcf6-395d-4784-bc48-13bb3c35325b tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:21:08.485681 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-92ecfcf6-395d-4784-bc48-13bb3c35325b tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:21:08.486581 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-92ecfcf6-395d-4784-bc48-13bb3c35325b tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:21:08.487043 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-92ecfcf6-395d-4784-bc48-13bb3c35325b tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:21:08.487485 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-92ecfcf6-395d-4784-bc48-13bb3c35325b tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:21:08.623160 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-92ecfcf6-395d-4784-bc48-13bb3c35325b tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd12070eb954d6880f925957184a288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da546353194342439f9bc3f98f6737e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:21:08.631490 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-92ecfcf6-395d-4784-bc48-13bb3c35325b tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] 10.222.0.23 "GET /compute/v2.1/servers/dedc0f1d-af1d-4381-b1b2-6ee8cc8a5703" status: 200 len: 1684 microversion: 2.1 time: 0.159359 Oct 13 13:21:08.632050 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 523/1028] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:21:08 2022] GET /compute/v2.1/servers/dedc0f1d-af1d-4381-b1b2-6ee8cc8a5703 => generated 1684 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:21:09.604938 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [req-801b722b-d74e-4067-b066-5d9bd0c9ecaf req-c05d1e68-a871-4a4b-9da4-4d0fb958b658 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dedc0f1d-af1d-4381-b1b2-6ee8cc8a5703", "name": "network-vif-deleted", "tag": "0088f1ee-a58e-464b-b537-2a9b7046ee61"}]} {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 13:21:09.615651 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [req-801b722b-d74e-4067-b066-5d9bd0c9ecaf req-c05d1e68-a871-4a4b-9da4-4d0fb958b658 service nova] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:21:09.616444 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [req-801b722b-d74e-4067-b066-5d9bd0c9ecaf req-c05d1e68-a871-4a4b-9da4-4d0fb958b658 service nova] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:21:09.616890 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [req-801b722b-d74e-4067-b066-5d9bd0c9ecaf req-c05d1e68-a871-4a4b-9da4-4d0fb958b658 service nova] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:21:09.629471 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.compute.server_external_events [req-801b722b-d74e-4067-b066-5d9bd0c9ecaf req-c05d1e68-a871-4a4b-9da4-4d0fb958b658 service nova] Creating event network-vif-deleted:0088f1ee-a58e-464b-b537-2a9b7046ee61 for instance dedc0f1d-af1d-4381-b1b2-6ee8cc8a5703 on hv-cinder-82660 Oct 13 13:21:09.634163 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [req-801b722b-d74e-4067-b066-5d9bd0c9ecaf req-c05d1e68-a871-4a4b-9da4-4d0fb958b658 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033416 Oct 13 13:21:09.634753 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 506/1029] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 13:21:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 13:21:09.662898 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-48428b97-c040-4dec-af7a-8ce8d8b70b18 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Calling method '>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:21:09.663567 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-48428b97-c040-4dec-af7a-8ce8d8b70b18 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] [instance: dedc0f1d-af1d-4381-b1b2-6ee8cc8a5703] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:21:09.670497 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-48428b97-c040-4dec-af7a-8ce8d8b70b18 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:21:09.671101 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-48428b97-c040-4dec-af7a-8ce8d8b70b18 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:21:09.672122 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-48428b97-c040-4dec-af7a-8ce8d8b70b18 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:21:09.672700 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-48428b97-c040-4dec-af7a-8ce8d8b70b18 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:21:09.673385 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-48428b97-c040-4dec-af7a-8ce8d8b70b18 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:21:09.673904 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-48428b97-c040-4dec-af7a-8ce8d8b70b18 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:21:09.716074 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-48428b97-c040-4dec-af7a-8ce8d8b70b18 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:21:09.716817 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-48428b97-c040-4dec-af7a-8ce8d8b70b18 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:21:09.717883 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-48428b97-c040-4dec-af7a-8ce8d8b70b18 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:21:09.718629 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.objects.instance [None req-48428b97-c040-4dec-af7a-8ce8d8b70b18 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Lazy-loading 'fault' on Instance uuid dedc0f1d-af1d-4381-b1b2-6ee8cc8a5703 {{(pid=118814) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 13 13:21:09.766237 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-48428b97-c040-4dec-af7a-8ce8d8b70b18 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd12070eb954d6880f925957184a288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da546353194342439f9bc3f98f6737e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:21:09.781389 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-48428b97-c040-4dec-af7a-8ce8d8b70b18 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] 10.222.0.23 "GET /compute/v2.1/servers/dedc0f1d-af1d-4381-b1b2-6ee8cc8a5703" status: 200 len: 1332 microversion: 2.1 time: 0.126855 Oct 13 13:21:09.782116 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 524/1030] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:21:09 2022] GET /compute/v2.1/servers/dedc0f1d-af1d-4381-b1b2-6ee8cc8a5703 => generated 1332 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:21:10.806667 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-710d1932-e8c4-403b-9377-2dc99620564c tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Calling method '>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:21:10.807421 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-710d1932-e8c4-403b-9377-2dc99620564c tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] [instance: dedc0f1d-af1d-4381-b1b2-6ee8cc8a5703] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:21:10.813852 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-710d1932-e8c4-403b-9377-2dc99620564c tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:21:10.814363 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-710d1932-e8c4-403b-9377-2dc99620564c tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:21:10.814808 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-710d1932-e8c4-403b-9377-2dc99620564c tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:21:10.815541 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-710d1932-e8c4-403b-9377-2dc99620564c tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:21:10.816029 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-710d1932-e8c4-403b-9377-2dc99620564c tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:21:10.816478 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-710d1932-e8c4-403b-9377-2dc99620564c tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:21:10.830221 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.wsgi [None req-710d1932-e8c4-403b-9377-2dc99620564c tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] HTTP exception thrown: Instance dedc0f1d-af1d-4381-b1b2-6ee8cc8a5703 could not be found. Oct 13 13:21:10.832434 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-710d1932-e8c4-403b-9377-2dc99620564c tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Request method failure captured: Oct 13 13:21:10.832434 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: request: GET /compute/v2.1/servers/dedc0f1d-af1d-4381-b1b2-6ee8cc8a5703 HTTP/1.1 Oct 13 13:21:10.832434 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: Accept: application/json Oct 13 13:21:10.832434 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: Accept-Encoding: identity Oct 13 13:21:10.832434 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: Connection: close Oct 13 13:21:10.832434 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: Content-Length: 0 Oct 13 13:21:10.832434 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: Content-Type: application/json Oct 13 13:21:10.832434 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: Host: 10.222.0.23 Oct 13 13:21:10.832434 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: Openstack-System-Scope: None Oct 13 13:21:10.832434 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: User-Agent: python-urllib3/1.26.12 Oct 13 13:21:10.832434 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Auth-Token: gAAAAABjSA_IS5ItJrPpOSqy4xNBxVB2bfXfKkj6-lkJ6r6QG2PtZPEmBejUeMw_nAM6PkRJ3-xldl5YnRyFBnqFy7XGF_zAWWgWViC-gBZjak_p4jHlI99AK4eenYmKLRCqGrNs_2qG-o4USzMyv_nCGKRj4tT-7DEE83-B1Dxr5qLtXkKFmJs Oct 13 13:21:10.832434 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Domain-Id: None Oct 13 13:21:10.832434 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Domain-Name: None Oct 13 13:21:10.832434 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Identity-Status: Confirmed Oct 13 13:21:10.832434 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Is-Admin-Project: True Oct 13 13:21:10.832434 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Project-Domain-Id: default Oct 13 13:21:10.832434 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Project-Domain-Name: Default Oct 13 13:21:10.832434 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Project-Id: da546353194342439f9bc3f98f6737e0 Oct 13 13:21:10.832434 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Project-Name: tempest-AttachVolumeNegativeTest-1392517896 Oct 13 13:21:10.832434 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Role: reader,member Oct 13 13:21:10.832434 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Roles: reader,member Oct 13 13:21:10.834124 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_da546353194342439f9bc3f98f6737e0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/da546353194342439f9bc3f98f6737e0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/da546353194342439f9bc3f98f6737e0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/da546353194342439f9bc3f98f6737e0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}] Oct 13 13:21:10.834124 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Tenant: tempest-AttachVolumeNegativeTest-1392517896 Oct 13 13:21:10.834124 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Tenant-Id: da546353194342439f9bc3f98f6737e0 Oct 13 13:21:10.834124 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1392517896 Oct 13 13:21:10.834124 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-User: tempest-AttachVolumeNegativeTest-1392517896-project Oct 13 13:21:10.834124 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-User-Domain-Id: default Oct 13 13:21:10.834124 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-User-Domain-Name: Default Oct 13 13:21:10.834124 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-User-Id: 2cd12070eb954d6880f925957184a288 Oct 13 13:21:10.834124 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-User-Name: tempest-AttachVolumeNegativeTest-1392517896-project Oct 13 13:21:10.834124 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: method: > Oct 13 13:21:10.834124 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: exception: Instance dedc0f1d-af1d-4381-b1b2-6ee8cc8a5703 could not be found. Oct 13 13:21:10.834124 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: action_args: {'id': 'dedc0f1d-af1d-4381-b1b2-6ee8cc8a5703'} Oct 13 13:21:10.835254 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 13:21:10.835254 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 13:21:10.835254 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 13 13:21:10.835254 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 13 13:21:10.835254 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 13 13:21:10.835254 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 13 13:21:10.835254 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 13 13:21:10.835254 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 13 13:21:10.835254 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 13 13:21:10.835254 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 13 13:21:10.835254 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dedc0f1d-af1d-4381-b1b2-6ee8cc8a5703 could not be found. Oct 13 13:21:10.835254 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi Oct 13 13:21:10.835254 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 13:21:10.835254 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi Oct 13 13:21:10.835254 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 13:21:10.835254 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 13:21:10.835254 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 13:21:10.835254 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 13:21:10.835254 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 13:21:10.835254 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 13:21:10.836874 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 13:21:10.836874 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 13 13:21:10.836874 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 13 13:21:10.836874 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 13 13:21:10.836874 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 13 13:21:10.836874 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 13 13:21:10.836874 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 13 13:21:10.836874 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dedc0f1d-af1d-4381-b1b2-6ee8cc8a5703 could not be found. Oct 13 13:21:10.836874 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi Oct 13 13:21:10.836874 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 13:21:10.836874 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi Oct 13 13:21:10.836874 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 13:21:10.836874 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 13:21:10.836874 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 13:21:10.836874 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 13:21:10.836874 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 13:21:10.836874 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dedc0f1d-af1d-4381-b1b2-6ee8cc8a5703 could not be found. Oct 13 13:21:10.836874 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi Oct 13 13:21:10.838287 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-710d1932-e8c4-403b-9377-2dc99620564c tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Returning 404 to user: Instance dedc0f1d-af1d-4381-b1b2-6ee8cc8a5703 could not be found. {{(pid=118815) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 13:21:10.838287 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-710d1932-e8c4-403b-9377-2dc99620564c tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] 10.222.0.23 "GET /compute/v2.1/servers/dedc0f1d-af1d-4381-b1b2-6ee8cc8a5703" status: 404 len: 111 microversion: 2.1 time: 0.031945 Oct 13 13:21:10.838287 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 507/1031] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:21:10 2022] GET /compute/v2.1/servers/dedc0f1d-af1d-4381-b1b2-6ee8cc8a5703 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 13 13:21:10.842516 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-887e6ae0-5683-4f37-8a70-1ebb63d07caf tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Calling method '.version_select at 0x7f5093d35ca0>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:21:10.862629 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-887e6ae0-5683-4f37-8a70-1ebb63d07caf tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1695751037" status: 202 len: 0 microversion: 2.1 time: 0.023812 Oct 13 13:21:10.863288 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 525/1032] 10.222.0.23 () {58 vars in 1221 bytes} [Thu Oct 13 13:21:10 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1695751037 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 13 13:21:12.589541 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-c47cde65-d3fc-439c-a1f6-1cb52ba3bb62 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Calling method '>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:21:12.590032 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-c47cde65-d3fc-439c-a1f6-1cb52ba3bb62 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] [instance: dedc0f1d-af1d-4381-b1b2-6ee8cc8a5703] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:21:12.596314 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-c47cde65-d3fc-439c-a1f6-1cb52ba3bb62 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:21:12.596788 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-c47cde65-d3fc-439c-a1f6-1cb52ba3bb62 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:21:12.597220 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-c47cde65-d3fc-439c-a1f6-1cb52ba3bb62 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:21:12.598469 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-c47cde65-d3fc-439c-a1f6-1cb52ba3bb62 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:21:12.598919 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-c47cde65-d3fc-439c-a1f6-1cb52ba3bb62 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:21:12.599375 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-c47cde65-d3fc-439c-a1f6-1cb52ba3bb62 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:21:12.612224 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.wsgi [None req-c47cde65-d3fc-439c-a1f6-1cb52ba3bb62 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] HTTP exception thrown: Instance dedc0f1d-af1d-4381-b1b2-6ee8cc8a5703 could not be found. Oct 13 13:21:12.613764 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-c47cde65-d3fc-439c-a1f6-1cb52ba3bb62 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Request method failure captured: Oct 13 13:21:12.613764 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: request: DELETE /compute/v2.1/servers/dedc0f1d-af1d-4381-b1b2-6ee8cc8a5703 HTTP/1.1 Oct 13 13:21:12.613764 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: Accept: application/json Oct 13 13:21:12.613764 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: Accept-Encoding: identity Oct 13 13:21:12.613764 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: Connection: close Oct 13 13:21:12.613764 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: Content-Length: 0 Oct 13 13:21:12.613764 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: Content-Type: application/json Oct 13 13:21:12.613764 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: Host: 10.222.0.23 Oct 13 13:21:12.613764 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: Openstack-System-Scope: None Oct 13 13:21:12.613764 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: User-Agent: python-urllib3/1.26.12 Oct 13 13:21:12.613764 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Auth-Token: gAAAAABjSA_IS5ItJrPpOSqy4xNBxVB2bfXfKkj6-lkJ6r6QG2PtZPEmBejUeMw_nAM6PkRJ3-xldl5YnRyFBnqFy7XGF_zAWWgWViC-gBZjak_p4jHlI99AK4eenYmKLRCqGrNs_2qG-o4USzMyv_nCGKRj4tT-7DEE83-B1Dxr5qLtXkKFmJs Oct 13 13:21:12.613764 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Domain-Id: None Oct 13 13:21:12.613764 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Domain-Name: None Oct 13 13:21:12.613764 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Identity-Status: Confirmed Oct 13 13:21:12.613764 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Is-Admin-Project: True Oct 13 13:21:12.613764 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Project-Domain-Id: default Oct 13 13:21:12.613764 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Project-Domain-Name: Default Oct 13 13:21:12.613764 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Project-Id: da546353194342439f9bc3f98f6737e0 Oct 13 13:21:12.613764 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Project-Name: tempest-AttachVolumeNegativeTest-1392517896 Oct 13 13:21:12.613764 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Role: reader,member Oct 13 13:21:12.613764 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Roles: reader,member Oct 13 13:21:12.615377 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_da546353194342439f9bc3f98f6737e0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/da546353194342439f9bc3f98f6737e0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/da546353194342439f9bc3f98f6737e0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/da546353194342439f9bc3f98f6737e0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}] Oct 13 13:21:12.615377 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Tenant: tempest-AttachVolumeNegativeTest-1392517896 Oct 13 13:21:12.615377 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Tenant-Id: da546353194342439f9bc3f98f6737e0 Oct 13 13:21:12.615377 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1392517896 Oct 13 13:21:12.615377 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-User: tempest-AttachVolumeNegativeTest-1392517896-project Oct 13 13:21:12.615377 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-User-Domain-Id: default Oct 13 13:21:12.615377 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-User-Domain-Name: Default Oct 13 13:21:12.615377 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-User-Id: 2cd12070eb954d6880f925957184a288 Oct 13 13:21:12.615377 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-User-Name: tempest-AttachVolumeNegativeTest-1392517896-project Oct 13 13:21:12.615377 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: method: > Oct 13 13:21:12.615377 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: exception: Instance dedc0f1d-af1d-4381-b1b2-6ee8cc8a5703 could not be found. Oct 13 13:21:12.615377 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: action_args: {'id': 'dedc0f1d-af1d-4381-b1b2-6ee8cc8a5703'} Oct 13 13:21:12.616440 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 13:21:12.616440 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 13:21:12.616440 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 13 13:21:12.616440 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 13 13:21:12.616440 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 13 13:21:12.616440 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 13 13:21:12.616440 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 13 13:21:12.616440 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 13 13:21:12.616440 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 13 13:21:12.616440 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 13 13:21:12.616440 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dedc0f1d-af1d-4381-b1b2-6ee8cc8a5703 could not be found. Oct 13 13:21:12.616440 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi Oct 13 13:21:12.616440 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 13:21:12.616440 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi Oct 13 13:21:12.616440 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 13:21:12.616440 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 13:21:12.616440 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 13:21:12.616440 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 13:21:12.616440 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 13:21:12.616440 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 13:21:12.617668 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 13:21:12.617668 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 13 13:21:12.617668 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 13 13:21:12.617668 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 13 13:21:12.617668 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 13 13:21:12.617668 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 13 13:21:12.617668 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 13 13:21:12.617668 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 13 13:21:12.617668 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 13 13:21:12.617668 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dedc0f1d-af1d-4381-b1b2-6ee8cc8a5703 could not be found. Oct 13 13:21:12.617668 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi Oct 13 13:21:12.617668 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 13:21:12.617668 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi Oct 13 13:21:12.617668 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 13:21:12.617668 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 13:21:12.617668 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 13:21:12.617668 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 13:21:12.617668 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 13:21:12.617668 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dedc0f1d-af1d-4381-b1b2-6ee8cc8a5703 could not be found. Oct 13 13:21:12.617668 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi Oct 13 13:21:12.619122 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-c47cde65-d3fc-439c-a1f6-1cb52ba3bb62 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Returning 404 to user: Instance dedc0f1d-af1d-4381-b1b2-6ee8cc8a5703 could not be found. {{(pid=118815) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 13:21:12.619122 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-c47cde65-d3fc-439c-a1f6-1cb52ba3bb62 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] 10.222.0.23 "DELETE /compute/v2.1/servers/dedc0f1d-af1d-4381-b1b2-6ee8cc8a5703" status: 404 len: 111 microversion: 2.1 time: 0.029492 Oct 13 13:21:12.619122 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 508/1033] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Oct 13 13:21:12 2022] DELETE /compute/v2.1/servers/dedc0f1d-af1d-4381-b1b2-6ee8cc8a5703 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 13 13:21:12.623917 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-df563c88-c0ee-4ce3-a9d9-08cc518abd0c tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Calling method '>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:21:12.624531 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-df563c88-c0ee-4ce3-a9d9-08cc518abd0c tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] [instance: dedc0f1d-af1d-4381-b1b2-6ee8cc8a5703] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:21:12.630908 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-df563c88-c0ee-4ce3-a9d9-08cc518abd0c tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:21:12.631426 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-df563c88-c0ee-4ce3-a9d9-08cc518abd0c tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:21:12.631867 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-df563c88-c0ee-4ce3-a9d9-08cc518abd0c tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:21:12.632551 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-df563c88-c0ee-4ce3-a9d9-08cc518abd0c tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:21:12.633002 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-df563c88-c0ee-4ce3-a9d9-08cc518abd0c tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:21:12.633423 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-df563c88-c0ee-4ce3-a9d9-08cc518abd0c tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:21:12.646696 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.wsgi [None req-df563c88-c0ee-4ce3-a9d9-08cc518abd0c tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] HTTP exception thrown: Instance dedc0f1d-af1d-4381-b1b2-6ee8cc8a5703 could not be found. Oct 13 13:21:12.648325 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-df563c88-c0ee-4ce3-a9d9-08cc518abd0c tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Request method failure captured: Oct 13 13:21:12.648325 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: request: GET /compute/v2.1/servers/dedc0f1d-af1d-4381-b1b2-6ee8cc8a5703 HTTP/1.1 Oct 13 13:21:12.648325 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: Accept: application/json Oct 13 13:21:12.648325 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: Accept-Encoding: identity Oct 13 13:21:12.648325 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: Connection: close Oct 13 13:21:12.648325 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: Content-Length: 0 Oct 13 13:21:12.648325 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: Content-Type: application/json Oct 13 13:21:12.648325 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: Host: 10.222.0.23 Oct 13 13:21:12.648325 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: Openstack-System-Scope: None Oct 13 13:21:12.648325 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: User-Agent: python-urllib3/1.26.12 Oct 13 13:21:12.648325 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Auth-Token: gAAAAABjSA_IS5ItJrPpOSqy4xNBxVB2bfXfKkj6-lkJ6r6QG2PtZPEmBejUeMw_nAM6PkRJ3-xldl5YnRyFBnqFy7XGF_zAWWgWViC-gBZjak_p4jHlI99AK4eenYmKLRCqGrNs_2qG-o4USzMyv_nCGKRj4tT-7DEE83-B1Dxr5qLtXkKFmJs Oct 13 13:21:12.648325 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Domain-Id: None Oct 13 13:21:12.648325 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Domain-Name: None Oct 13 13:21:12.648325 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Identity-Status: Confirmed Oct 13 13:21:12.648325 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Is-Admin-Project: True Oct 13 13:21:12.648325 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Project-Domain-Id: default Oct 13 13:21:12.648325 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Project-Domain-Name: Default Oct 13 13:21:12.648325 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Project-Id: da546353194342439f9bc3f98f6737e0 Oct 13 13:21:12.648325 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Project-Name: tempest-AttachVolumeNegativeTest-1392517896 Oct 13 13:21:12.648325 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Role: reader,member Oct 13 13:21:12.648325 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Roles: reader,member Oct 13 13:21:12.649961 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_da546353194342439f9bc3f98f6737e0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/da546353194342439f9bc3f98f6737e0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/da546353194342439f9bc3f98f6737e0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/da546353194342439f9bc3f98f6737e0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}] Oct 13 13:21:12.649961 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Tenant: tempest-AttachVolumeNegativeTest-1392517896 Oct 13 13:21:12.649961 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Tenant-Id: da546353194342439f9bc3f98f6737e0 Oct 13 13:21:12.649961 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1392517896 Oct 13 13:21:12.649961 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-User: tempest-AttachVolumeNegativeTest-1392517896-project Oct 13 13:21:12.649961 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-User-Domain-Id: default Oct 13 13:21:12.649961 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-User-Domain-Name: Default Oct 13 13:21:12.649961 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-User-Id: 2cd12070eb954d6880f925957184a288 Oct 13 13:21:12.649961 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-User-Name: tempest-AttachVolumeNegativeTest-1392517896-project Oct 13 13:21:12.649961 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: method: > Oct 13 13:21:12.649961 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: exception: Instance dedc0f1d-af1d-4381-b1b2-6ee8cc8a5703 could not be found. Oct 13 13:21:12.649961 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: action_args: {'id': 'dedc0f1d-af1d-4381-b1b2-6ee8cc8a5703'} Oct 13 13:21:12.650882 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 13:21:12.650882 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 13:21:12.650882 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 13 13:21:12.650882 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 13 13:21:12.650882 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 13 13:21:12.650882 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 13 13:21:12.650882 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 13 13:21:12.650882 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 13 13:21:12.650882 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 13 13:21:12.650882 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 13 13:21:12.650882 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dedc0f1d-af1d-4381-b1b2-6ee8cc8a5703 could not be found. Oct 13 13:21:12.650882 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi Oct 13 13:21:12.650882 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 13:21:12.650882 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi Oct 13 13:21:12.650882 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 13:21:12.650882 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 13:21:12.650882 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 13:21:12.650882 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 13:21:12.650882 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 13:21:12.650882 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 13:21:12.652588 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 13:21:12.652588 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 13 13:21:12.652588 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 13 13:21:12.652588 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 13 13:21:12.652588 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 13 13:21:12.652588 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 13 13:21:12.652588 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 13 13:21:12.652588 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dedc0f1d-af1d-4381-b1b2-6ee8cc8a5703 could not be found. Oct 13 13:21:12.652588 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi Oct 13 13:21:12.652588 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 13:21:12.652588 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi Oct 13 13:21:12.652588 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 13:21:12.652588 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 13:21:12.652588 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 13:21:12.652588 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 13:21:12.652588 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 13:21:12.652588 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dedc0f1d-af1d-4381-b1b2-6ee8cc8a5703 could not be found. Oct 13 13:21:12.652588 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi Oct 13 13:21:12.653918 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-df563c88-c0ee-4ce3-a9d9-08cc518abd0c tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Returning 404 to user: Instance dedc0f1d-af1d-4381-b1b2-6ee8cc8a5703 could not be found. {{(pid=118814) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 13:21:12.653918 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-df563c88-c0ee-4ce3-a9d9-08cc518abd0c tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] 10.222.0.23 "GET /compute/v2.1/servers/dedc0f1d-af1d-4381-b1b2-6ee8cc8a5703" status: 404 len: 111 microversion: 2.1 time: 0.030150 Oct 13 13:21:12.653918 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 526/1034] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:21:12 2022] GET /compute/v2.1/servers/dedc0f1d-af1d-4381-b1b2-6ee8cc8a5703 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 13 13:21:13.794554 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-21160e52-a3f4-426f-9d6c-166cf37fb0b6 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Calling method '>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:21:13.795072 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-21160e52-a3f4-426f-9d6c-166cf37fb0b6 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] [instance: 4f38ccc6-b8fc-416e-ab19-a6c260441f76] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:21:13.802169 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-21160e52-a3f4-426f-9d6c-166cf37fb0b6 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:21:13.802650 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-21160e52-a3f4-426f-9d6c-166cf37fb0b6 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:21:13.803115 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-21160e52-a3f4-426f-9d6c-166cf37fb0b6 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:21:13.803839 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-21160e52-a3f4-426f-9d6c-166cf37fb0b6 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:21:13.804329 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-21160e52-a3f4-426f-9d6c-166cf37fb0b6 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:21:13.804758 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-21160e52-a3f4-426f-9d6c-166cf37fb0b6 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:21:13.818485 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.wsgi [None req-21160e52-a3f4-426f-9d6c-166cf37fb0b6 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] HTTP exception thrown: Instance 4f38ccc6-b8fc-416e-ab19-a6c260441f76 could not be found. Oct 13 13:21:13.820032 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-21160e52-a3f4-426f-9d6c-166cf37fb0b6 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Request method failure captured: Oct 13 13:21:13.820032 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: request: DELETE /compute/v2.1/servers/4f38ccc6-b8fc-416e-ab19-a6c260441f76 HTTP/1.1 Oct 13 13:21:13.820032 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: Accept: application/json Oct 13 13:21:13.820032 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: Accept-Encoding: identity Oct 13 13:21:13.820032 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: Connection: close Oct 13 13:21:13.820032 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: Content-Length: 0 Oct 13 13:21:13.820032 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: Content-Type: application/json Oct 13 13:21:13.820032 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: Host: 10.222.0.23 Oct 13 13:21:13.820032 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: Openstack-System-Scope: None Oct 13 13:21:13.820032 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: User-Agent: python-urllib3/1.26.12 Oct 13 13:21:13.820032 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Auth-Token: gAAAAABjSA_IS5ItJrPpOSqy4xNBxVB2bfXfKkj6-lkJ6r6QG2PtZPEmBejUeMw_nAM6PkRJ3-xldl5YnRyFBnqFy7XGF_zAWWgWViC-gBZjak_p4jHlI99AK4eenYmKLRCqGrNs_2qG-o4USzMyv_nCGKRj4tT-7DEE83-B1Dxr5qLtXkKFmJs Oct 13 13:21:13.820032 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Domain-Id: None Oct 13 13:21:13.820032 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Domain-Name: None Oct 13 13:21:13.820032 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Identity-Status: Confirmed Oct 13 13:21:13.820032 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Is-Admin-Project: True Oct 13 13:21:13.820032 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Project-Domain-Id: default Oct 13 13:21:13.820032 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Project-Domain-Name: Default Oct 13 13:21:13.820032 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Project-Id: da546353194342439f9bc3f98f6737e0 Oct 13 13:21:13.820032 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Project-Name: tempest-AttachVolumeNegativeTest-1392517896 Oct 13 13:21:13.820032 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Role: reader,member Oct 13 13:21:13.820032 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Roles: reader,member Oct 13 13:21:13.821464 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_da546353194342439f9bc3f98f6737e0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/da546353194342439f9bc3f98f6737e0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/da546353194342439f9bc3f98f6737e0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/da546353194342439f9bc3f98f6737e0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}] Oct 13 13:21:13.821464 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Tenant: tempest-AttachVolumeNegativeTest-1392517896 Oct 13 13:21:13.821464 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Tenant-Id: da546353194342439f9bc3f98f6737e0 Oct 13 13:21:13.821464 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1392517896 Oct 13 13:21:13.821464 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-User: tempest-AttachVolumeNegativeTest-1392517896-project Oct 13 13:21:13.821464 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-User-Domain-Id: default Oct 13 13:21:13.821464 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-User-Domain-Name: Default Oct 13 13:21:13.821464 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-User-Id: 2cd12070eb954d6880f925957184a288 Oct 13 13:21:13.821464 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-User-Name: tempest-AttachVolumeNegativeTest-1392517896-project Oct 13 13:21:13.821464 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: method: > Oct 13 13:21:13.821464 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: exception: Instance 4f38ccc6-b8fc-416e-ab19-a6c260441f76 could not be found. Oct 13 13:21:13.821464 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: action_args: {'id': '4f38ccc6-b8fc-416e-ab19-a6c260441f76'} Oct 13 13:21:13.822256 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 13:21:13.822256 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 13:21:13.822256 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 13 13:21:13.822256 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 13 13:21:13.822256 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 13 13:21:13.822256 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 13 13:21:13.822256 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 13 13:21:13.822256 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 13 13:21:13.822256 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 13 13:21:13.822256 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 13 13:21:13.822256 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4f38ccc6-b8fc-416e-ab19-a6c260441f76 could not be found. Oct 13 13:21:13.822256 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi Oct 13 13:21:13.822256 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 13:21:13.822256 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi Oct 13 13:21:13.822256 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 13:21:13.822256 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 13:21:13.822256 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 13:21:13.822256 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 13:21:13.822256 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 13:21:13.822256 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 13:21:13.823554 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 13:21:13.823554 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 13 13:21:13.823554 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 13 13:21:13.823554 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 13 13:21:13.823554 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 13 13:21:13.823554 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 13 13:21:13.823554 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 13 13:21:13.823554 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 13 13:21:13.823554 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 13 13:21:13.823554 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4f38ccc6-b8fc-416e-ab19-a6c260441f76 could not be found. Oct 13 13:21:13.823554 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi Oct 13 13:21:13.823554 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 13:21:13.823554 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi Oct 13 13:21:13.823554 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 13:21:13.823554 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 13:21:13.823554 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 13:21:13.823554 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 13:21:13.823554 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 13:21:13.823554 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4f38ccc6-b8fc-416e-ab19-a6c260441f76 could not be found. Oct 13 13:21:13.823554 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi Oct 13 13:21:13.824865 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-21160e52-a3f4-426f-9d6c-166cf37fb0b6 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Returning 404 to user: Instance 4f38ccc6-b8fc-416e-ab19-a6c260441f76 could not be found. {{(pid=118815) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 13:21:13.824865 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-21160e52-a3f4-426f-9d6c-166cf37fb0b6 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] 10.222.0.23 "DELETE /compute/v2.1/servers/4f38ccc6-b8fc-416e-ab19-a6c260441f76" status: 404 len: 111 microversion: 2.1 time: 0.030854 Oct 13 13:21:13.824865 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 509/1035] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Oct 13 13:21:13 2022] DELETE /compute/v2.1/servers/4f38ccc6-b8fc-416e-ab19-a6c260441f76 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 13 13:21:13.829749 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-e30ba7b2-7eb4-47f3-9efc-d64bfde93226 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Calling method '>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:21:13.830367 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-e30ba7b2-7eb4-47f3-9efc-d64bfde93226 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] [instance: 4f38ccc6-b8fc-416e-ab19-a6c260441f76] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:21:13.836858 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-e30ba7b2-7eb4-47f3-9efc-d64bfde93226 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:21:13.837341 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-e30ba7b2-7eb4-47f3-9efc-d64bfde93226 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:21:13.837782 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-e30ba7b2-7eb4-47f3-9efc-d64bfde93226 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:21:13.838472 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-e30ba7b2-7eb4-47f3-9efc-d64bfde93226 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:21:13.838928 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-e30ba7b2-7eb4-47f3-9efc-d64bfde93226 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:21:13.839388 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-e30ba7b2-7eb4-47f3-9efc-d64bfde93226 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:21:13.852741 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.wsgi [None req-e30ba7b2-7eb4-47f3-9efc-d64bfde93226 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] HTTP exception thrown: Instance 4f38ccc6-b8fc-416e-ab19-a6c260441f76 could not be found. Oct 13 13:21:13.854247 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-e30ba7b2-7eb4-47f3-9efc-d64bfde93226 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Request method failure captured: Oct 13 13:21:13.854247 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: request: GET /compute/v2.1/servers/4f38ccc6-b8fc-416e-ab19-a6c260441f76 HTTP/1.1 Oct 13 13:21:13.854247 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: Accept: application/json Oct 13 13:21:13.854247 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: Accept-Encoding: identity Oct 13 13:21:13.854247 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: Connection: close Oct 13 13:21:13.854247 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: Content-Length: 0 Oct 13 13:21:13.854247 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: Content-Type: application/json Oct 13 13:21:13.854247 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: Host: 10.222.0.23 Oct 13 13:21:13.854247 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: Openstack-System-Scope: None Oct 13 13:21:13.854247 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: User-Agent: python-urllib3/1.26.12 Oct 13 13:21:13.854247 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Auth-Token: gAAAAABjSA_IS5ItJrPpOSqy4xNBxVB2bfXfKkj6-lkJ6r6QG2PtZPEmBejUeMw_nAM6PkRJ3-xldl5YnRyFBnqFy7XGF_zAWWgWViC-gBZjak_p4jHlI99AK4eenYmKLRCqGrNs_2qG-o4USzMyv_nCGKRj4tT-7DEE83-B1Dxr5qLtXkKFmJs Oct 13 13:21:13.854247 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Domain-Id: None Oct 13 13:21:13.854247 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Domain-Name: None Oct 13 13:21:13.854247 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Identity-Status: Confirmed Oct 13 13:21:13.854247 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Is-Admin-Project: True Oct 13 13:21:13.854247 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Project-Domain-Id: default Oct 13 13:21:13.854247 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Project-Domain-Name: Default Oct 13 13:21:13.854247 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Project-Id: da546353194342439f9bc3f98f6737e0 Oct 13 13:21:13.854247 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Project-Name: tempest-AttachVolumeNegativeTest-1392517896 Oct 13 13:21:13.854247 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Role: reader,member Oct 13 13:21:13.854247 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Roles: reader,member Oct 13 13:21:13.856119 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_da546353194342439f9bc3f98f6737e0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/da546353194342439f9bc3f98f6737e0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/da546353194342439f9bc3f98f6737e0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/da546353194342439f9bc3f98f6737e0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}] Oct 13 13:21:13.856119 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Tenant: tempest-AttachVolumeNegativeTest-1392517896 Oct 13 13:21:13.856119 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Tenant-Id: da546353194342439f9bc3f98f6737e0 Oct 13 13:21:13.856119 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1392517896 Oct 13 13:21:13.856119 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-User: tempest-AttachVolumeNegativeTest-1392517896-project Oct 13 13:21:13.856119 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-User-Domain-Id: default Oct 13 13:21:13.856119 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-User-Domain-Name: Default Oct 13 13:21:13.856119 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-User-Id: 2cd12070eb954d6880f925957184a288 Oct 13 13:21:13.856119 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-User-Name: tempest-AttachVolumeNegativeTest-1392517896-project Oct 13 13:21:13.856119 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: method: > Oct 13 13:21:13.856119 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: exception: Instance 4f38ccc6-b8fc-416e-ab19-a6c260441f76 could not be found. Oct 13 13:21:13.856119 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: action_args: {'id': '4f38ccc6-b8fc-416e-ab19-a6c260441f76'} Oct 13 13:21:13.857012 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 13:21:13.857012 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 13:21:13.857012 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 13 13:21:13.857012 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 13 13:21:13.857012 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 13 13:21:13.857012 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 13 13:21:13.857012 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 13 13:21:13.857012 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 13 13:21:13.857012 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 13 13:21:13.857012 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 13 13:21:13.857012 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4f38ccc6-b8fc-416e-ab19-a6c260441f76 could not be found. Oct 13 13:21:13.857012 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi Oct 13 13:21:13.857012 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 13:21:13.857012 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi Oct 13 13:21:13.857012 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 13:21:13.857012 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 13:21:13.857012 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 13:21:13.857012 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 13:21:13.857012 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 13:21:13.857012 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 13:21:13.858553 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 13:21:13.858553 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 13 13:21:13.858553 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 13 13:21:13.858553 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 13 13:21:13.858553 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 13 13:21:13.858553 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 13 13:21:13.858553 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 13 13:21:13.858553 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4f38ccc6-b8fc-416e-ab19-a6c260441f76 could not be found. Oct 13 13:21:13.858553 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi Oct 13 13:21:13.858553 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 13:21:13.858553 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi Oct 13 13:21:13.858553 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 13:21:13.858553 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 13:21:13.858553 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 13:21:13.858553 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 13:21:13.858553 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 13:21:13.858553 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4f38ccc6-b8fc-416e-ab19-a6c260441f76 could not be found. Oct 13 13:21:13.858553 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi Oct 13 13:21:13.860058 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-e30ba7b2-7eb4-47f3-9efc-d64bfde93226 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Returning 404 to user: Instance 4f38ccc6-b8fc-416e-ab19-a6c260441f76 could not be found. {{(pid=118814) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 13:21:13.860058 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-e30ba7b2-7eb4-47f3-9efc-d64bfde93226 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] 10.222.0.23 "GET /compute/v2.1/servers/4f38ccc6-b8fc-416e-ab19-a6c260441f76" status: 404 len: 111 microversion: 2.1 time: 0.029703 Oct 13 13:21:13.860058 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 527/1036] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:21:13 2022] GET /compute/v2.1/servers/4f38ccc6-b8fc-416e-ab19-a6c260441f76 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 13 13:21:13.864431 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-d5c9bf54-90a6-4f98-b5da-d76ae1ab4593 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Calling method '>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:21:13.864929 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-d5c9bf54-90a6-4f98-b5da-d76ae1ab4593 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] [instance: b18f33d7-defb-4cea-9e29-20d49213f35c] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:21:13.870751 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-d5c9bf54-90a6-4f98-b5da-d76ae1ab4593 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:21:13.871273 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-d5c9bf54-90a6-4f98-b5da-d76ae1ab4593 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:21:13.871716 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-d5c9bf54-90a6-4f98-b5da-d76ae1ab4593 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:21:13.872406 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-d5c9bf54-90a6-4f98-b5da-d76ae1ab4593 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:21:13.872865 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-d5c9bf54-90a6-4f98-b5da-d76ae1ab4593 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:21:13.873293 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-d5c9bf54-90a6-4f98-b5da-d76ae1ab4593 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:21:13.887140 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.wsgi [None req-d5c9bf54-90a6-4f98-b5da-d76ae1ab4593 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] HTTP exception thrown: Instance b18f33d7-defb-4cea-9e29-20d49213f35c could not be found. Oct 13 13:21:13.888662 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-d5c9bf54-90a6-4f98-b5da-d76ae1ab4593 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Request method failure captured: Oct 13 13:21:13.888662 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: request: DELETE /compute/v2.1/servers/b18f33d7-defb-4cea-9e29-20d49213f35c HTTP/1.1 Oct 13 13:21:13.888662 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: Accept: application/json Oct 13 13:21:13.888662 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: Accept-Encoding: identity Oct 13 13:21:13.888662 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: Connection: close Oct 13 13:21:13.888662 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: Content-Length: 0 Oct 13 13:21:13.888662 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: Content-Type: application/json Oct 13 13:21:13.888662 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: Host: 10.222.0.23 Oct 13 13:21:13.888662 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: Openstack-System-Scope: None Oct 13 13:21:13.888662 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: User-Agent: python-urllib3/1.26.12 Oct 13 13:21:13.888662 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Auth-Token: gAAAAABjSA_IS5ItJrPpOSqy4xNBxVB2bfXfKkj6-lkJ6r6QG2PtZPEmBejUeMw_nAM6PkRJ3-xldl5YnRyFBnqFy7XGF_zAWWgWViC-gBZjak_p4jHlI99AK4eenYmKLRCqGrNs_2qG-o4USzMyv_nCGKRj4tT-7DEE83-B1Dxr5qLtXkKFmJs Oct 13 13:21:13.888662 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Domain-Id: None Oct 13 13:21:13.888662 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Domain-Name: None Oct 13 13:21:13.888662 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Identity-Status: Confirmed Oct 13 13:21:13.888662 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Is-Admin-Project: True Oct 13 13:21:13.888662 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Project-Domain-Id: default Oct 13 13:21:13.888662 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Project-Domain-Name: Default Oct 13 13:21:13.888662 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Project-Id: da546353194342439f9bc3f98f6737e0 Oct 13 13:21:13.888662 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Project-Name: tempest-AttachVolumeNegativeTest-1392517896 Oct 13 13:21:13.888662 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Role: reader,member Oct 13 13:21:13.888662 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Roles: reader,member Oct 13 13:21:13.890253 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_da546353194342439f9bc3f98f6737e0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/da546353194342439f9bc3f98f6737e0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/da546353194342439f9bc3f98f6737e0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/da546353194342439f9bc3f98f6737e0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}] Oct 13 13:21:13.890253 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Tenant: tempest-AttachVolumeNegativeTest-1392517896 Oct 13 13:21:13.890253 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Tenant-Id: da546353194342439f9bc3f98f6737e0 Oct 13 13:21:13.890253 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1392517896 Oct 13 13:21:13.890253 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-User: tempest-AttachVolumeNegativeTest-1392517896-project Oct 13 13:21:13.890253 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-User-Domain-Id: default Oct 13 13:21:13.890253 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-User-Domain-Name: Default Oct 13 13:21:13.890253 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-User-Id: 2cd12070eb954d6880f925957184a288 Oct 13 13:21:13.890253 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-User-Name: tempest-AttachVolumeNegativeTest-1392517896-project Oct 13 13:21:13.890253 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: method: > Oct 13 13:21:13.890253 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: exception: Instance b18f33d7-defb-4cea-9e29-20d49213f35c could not be found. Oct 13 13:21:13.890253 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: action_args: {'id': 'b18f33d7-defb-4cea-9e29-20d49213f35c'} Oct 13 13:21:13.891211 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 13:21:13.891211 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 13:21:13.891211 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 13 13:21:13.891211 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 13 13:21:13.891211 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 13 13:21:13.891211 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 13 13:21:13.891211 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 13 13:21:13.891211 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 13 13:21:13.891211 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 13 13:21:13.891211 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 13 13:21:13.891211 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b18f33d7-defb-4cea-9e29-20d49213f35c could not be found. Oct 13 13:21:13.891211 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi Oct 13 13:21:13.891211 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 13:21:13.891211 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi Oct 13 13:21:13.891211 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 13:21:13.891211 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 13:21:13.891211 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 13:21:13.891211 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 13:21:13.891211 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 13:21:13.891211 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 13:21:13.892724 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 13:21:13.892724 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 13 13:21:13.892724 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 13 13:21:13.892724 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 13 13:21:13.892724 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 13 13:21:13.892724 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 13 13:21:13.892724 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 13 13:21:13.892724 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 13 13:21:13.892724 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 13 13:21:13.892724 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b18f33d7-defb-4cea-9e29-20d49213f35c could not be found. Oct 13 13:21:13.892724 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi Oct 13 13:21:13.892724 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 13:21:13.892724 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi Oct 13 13:21:13.892724 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 13:21:13.892724 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 13:21:13.892724 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 13:21:13.892724 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 13:21:13.892724 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 13:21:13.892724 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b18f33d7-defb-4cea-9e29-20d49213f35c could not be found. Oct 13 13:21:13.892724 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi Oct 13 13:21:13.894291 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-d5c9bf54-90a6-4f98-b5da-d76ae1ab4593 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Returning 404 to user: Instance b18f33d7-defb-4cea-9e29-20d49213f35c could not be found. {{(pid=118815) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 13:21:13.894291 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-d5c9bf54-90a6-4f98-b5da-d76ae1ab4593 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] 10.222.0.23 "DELETE /compute/v2.1/servers/b18f33d7-defb-4cea-9e29-20d49213f35c" status: 404 len: 111 microversion: 2.1 time: 0.029934 Oct 13 13:21:13.894291 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 510/1037] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Oct 13 13:21:13 2022] DELETE /compute/v2.1/servers/b18f33d7-defb-4cea-9e29-20d49213f35c => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 13 13:21:13.898415 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-ff59658f-481d-4682-a326-f7b9a52f3375 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Calling method '>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:21:13.899027 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-ff59658f-481d-4682-a326-f7b9a52f3375 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] [instance: b18f33d7-defb-4cea-9e29-20d49213f35c] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:21:13.904995 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-ff59658f-481d-4682-a326-f7b9a52f3375 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:21:13.905494 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-ff59658f-481d-4682-a326-f7b9a52f3375 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:21:13.906077 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-ff59658f-481d-4682-a326-f7b9a52f3375 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:21:13.906781 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-ff59658f-481d-4682-a326-f7b9a52f3375 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:21:13.907276 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-ff59658f-481d-4682-a326-f7b9a52f3375 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:21:13.907709 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-ff59658f-481d-4682-a326-f7b9a52f3375 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:21:13.921622 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.wsgi [None req-ff59658f-481d-4682-a326-f7b9a52f3375 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] HTTP exception thrown: Instance b18f33d7-defb-4cea-9e29-20d49213f35c could not be found. Oct 13 13:21:13.923205 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-ff59658f-481d-4682-a326-f7b9a52f3375 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Request method failure captured: Oct 13 13:21:13.923205 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: request: GET /compute/v2.1/servers/b18f33d7-defb-4cea-9e29-20d49213f35c HTTP/1.1 Oct 13 13:21:13.923205 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: Accept: application/json Oct 13 13:21:13.923205 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: Accept-Encoding: identity Oct 13 13:21:13.923205 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: Connection: close Oct 13 13:21:13.923205 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: Content-Length: 0 Oct 13 13:21:13.923205 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: Content-Type: application/json Oct 13 13:21:13.923205 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: Host: 10.222.0.23 Oct 13 13:21:13.923205 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: Openstack-System-Scope: None Oct 13 13:21:13.923205 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: User-Agent: python-urllib3/1.26.12 Oct 13 13:21:13.923205 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Auth-Token: gAAAAABjSA_IS5ItJrPpOSqy4xNBxVB2bfXfKkj6-lkJ6r6QG2PtZPEmBejUeMw_nAM6PkRJ3-xldl5YnRyFBnqFy7XGF_zAWWgWViC-gBZjak_p4jHlI99AK4eenYmKLRCqGrNs_2qG-o4USzMyv_nCGKRj4tT-7DEE83-B1Dxr5qLtXkKFmJs Oct 13 13:21:13.923205 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Domain-Id: None Oct 13 13:21:13.923205 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Domain-Name: None Oct 13 13:21:13.923205 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Identity-Status: Confirmed Oct 13 13:21:13.923205 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Is-Admin-Project: True Oct 13 13:21:13.923205 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Project-Domain-Id: default Oct 13 13:21:13.923205 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Project-Domain-Name: Default Oct 13 13:21:13.923205 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Project-Id: da546353194342439f9bc3f98f6737e0 Oct 13 13:21:13.923205 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Project-Name: tempest-AttachVolumeNegativeTest-1392517896 Oct 13 13:21:13.923205 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Role: reader,member Oct 13 13:21:13.923205 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Roles: reader,member Oct 13 13:21:13.924885 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_da546353194342439f9bc3f98f6737e0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/da546353194342439f9bc3f98f6737e0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/da546353194342439f9bc3f98f6737e0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/da546353194342439f9bc3f98f6737e0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}] Oct 13 13:21:13.924885 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Tenant: tempest-AttachVolumeNegativeTest-1392517896 Oct 13 13:21:13.924885 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Tenant-Id: da546353194342439f9bc3f98f6737e0 Oct 13 13:21:13.924885 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1392517896 Oct 13 13:21:13.924885 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-User: tempest-AttachVolumeNegativeTest-1392517896-project Oct 13 13:21:13.924885 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-User-Domain-Id: default Oct 13 13:21:13.924885 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-User-Domain-Name: Default Oct 13 13:21:13.924885 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-User-Id: 2cd12070eb954d6880f925957184a288 Oct 13 13:21:13.924885 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-User-Name: tempest-AttachVolumeNegativeTest-1392517896-project Oct 13 13:21:13.924885 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: method: > Oct 13 13:21:13.924885 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: exception: Instance b18f33d7-defb-4cea-9e29-20d49213f35c could not be found. Oct 13 13:21:13.924885 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: action_args: {'id': 'b18f33d7-defb-4cea-9e29-20d49213f35c'} Oct 13 13:21:13.926027 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 13:21:13.926027 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 13:21:13.926027 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 13 13:21:13.926027 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 13 13:21:13.926027 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 13 13:21:13.926027 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 13 13:21:13.926027 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 13 13:21:13.926027 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 13 13:21:13.926027 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 13 13:21:13.926027 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 13 13:21:13.926027 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b18f33d7-defb-4cea-9e29-20d49213f35c could not be found. Oct 13 13:21:13.926027 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi Oct 13 13:21:13.926027 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 13:21:13.926027 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi Oct 13 13:21:13.926027 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 13:21:13.926027 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 13:21:13.926027 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 13:21:13.926027 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 13:21:13.926027 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 13:21:13.926027 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 13:21:13.928160 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 13:21:13.928160 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 13 13:21:13.928160 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 13 13:21:13.928160 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 13 13:21:13.928160 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 13 13:21:13.928160 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 13 13:21:13.928160 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 13 13:21:13.928160 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b18f33d7-defb-4cea-9e29-20d49213f35c could not be found. Oct 13 13:21:13.928160 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi Oct 13 13:21:13.928160 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 13:21:13.928160 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi Oct 13 13:21:13.928160 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 13:21:13.928160 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 13:21:13.928160 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 13:21:13.928160 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 13:21:13.928160 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 13:21:13.928160 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b18f33d7-defb-4cea-9e29-20d49213f35c could not be found. Oct 13 13:21:13.928160 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi Oct 13 13:21:13.929640 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-ff59658f-481d-4682-a326-f7b9a52f3375 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Returning 404 to user: Instance b18f33d7-defb-4cea-9e29-20d49213f35c could not be found. {{(pid=118814) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 13:21:13.929640 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-ff59658f-481d-4682-a326-f7b9a52f3375 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] 10.222.0.23 "GET /compute/v2.1/servers/b18f33d7-defb-4cea-9e29-20d49213f35c" status: 404 len: 111 microversion: 2.1 time: 0.030004 Oct 13 13:21:13.929640 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 528/1038] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:21:13 2022] GET /compute/v2.1/servers/b18f33d7-defb-4cea-9e29-20d49213f35c => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 13 13:21:15.063086 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-2a38bc35-4e72-49a0-bc3c-960d54a6ee81 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Calling method '>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:21:15.063591 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-2a38bc35-4e72-49a0-bc3c-960d54a6ee81 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] [instance: 8a4e6f19-21f2-4ff8-af3d-bf93ec2488aa] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:21:15.070378 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-2a38bc35-4e72-49a0-bc3c-960d54a6ee81 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:21:15.070861 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-2a38bc35-4e72-49a0-bc3c-960d54a6ee81 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:21:15.071340 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-2a38bc35-4e72-49a0-bc3c-960d54a6ee81 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:21:15.072063 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-2a38bc35-4e72-49a0-bc3c-960d54a6ee81 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:21:15.072523 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-2a38bc35-4e72-49a0-bc3c-960d54a6ee81 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:21:15.072953 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-2a38bc35-4e72-49a0-bc3c-960d54a6ee81 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:21:15.088301 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.wsgi [None req-2a38bc35-4e72-49a0-bc3c-960d54a6ee81 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] HTTP exception thrown: Instance 8a4e6f19-21f2-4ff8-af3d-bf93ec2488aa could not be found. Oct 13 13:21:15.089834 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-2a38bc35-4e72-49a0-bc3c-960d54a6ee81 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Request method failure captured: Oct 13 13:21:15.089834 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: request: DELETE /compute/v2.1/servers/8a4e6f19-21f2-4ff8-af3d-bf93ec2488aa HTTP/1.1 Oct 13 13:21:15.089834 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: Accept: application/json Oct 13 13:21:15.089834 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: Accept-Encoding: identity Oct 13 13:21:15.089834 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: Connection: close Oct 13 13:21:15.089834 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: Content-Length: 0 Oct 13 13:21:15.089834 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: Content-Type: application/json Oct 13 13:21:15.089834 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: Host: 10.222.0.23 Oct 13 13:21:15.089834 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: Openstack-System-Scope: None Oct 13 13:21:15.089834 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: User-Agent: python-urllib3/1.26.12 Oct 13 13:21:15.089834 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Auth-Token: gAAAAABjSA_IS5ItJrPpOSqy4xNBxVB2bfXfKkj6-lkJ6r6QG2PtZPEmBejUeMw_nAM6PkRJ3-xldl5YnRyFBnqFy7XGF_zAWWgWViC-gBZjak_p4jHlI99AK4eenYmKLRCqGrNs_2qG-o4USzMyv_nCGKRj4tT-7DEE83-B1Dxr5qLtXkKFmJs Oct 13 13:21:15.089834 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Domain-Id: None Oct 13 13:21:15.089834 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Domain-Name: None Oct 13 13:21:15.089834 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Identity-Status: Confirmed Oct 13 13:21:15.089834 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Is-Admin-Project: True Oct 13 13:21:15.089834 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Project-Domain-Id: default Oct 13 13:21:15.089834 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Project-Domain-Name: Default Oct 13 13:21:15.089834 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Project-Id: da546353194342439f9bc3f98f6737e0 Oct 13 13:21:15.089834 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Project-Name: tempest-AttachVolumeNegativeTest-1392517896 Oct 13 13:21:15.089834 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Role: reader,member Oct 13 13:21:15.089834 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Roles: reader,member Oct 13 13:21:15.091319 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_da546353194342439f9bc3f98f6737e0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/da546353194342439f9bc3f98f6737e0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/da546353194342439f9bc3f98f6737e0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/da546353194342439f9bc3f98f6737e0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}] Oct 13 13:21:15.091319 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Tenant: tempest-AttachVolumeNegativeTest-1392517896 Oct 13 13:21:15.091319 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Tenant-Id: da546353194342439f9bc3f98f6737e0 Oct 13 13:21:15.091319 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1392517896 Oct 13 13:21:15.091319 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-User: tempest-AttachVolumeNegativeTest-1392517896-project Oct 13 13:21:15.091319 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-User-Domain-Id: default Oct 13 13:21:15.091319 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-User-Domain-Name: Default Oct 13 13:21:15.091319 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-User-Id: 2cd12070eb954d6880f925957184a288 Oct 13 13:21:15.091319 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-User-Name: tempest-AttachVolumeNegativeTest-1392517896-project Oct 13 13:21:15.091319 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: method: > Oct 13 13:21:15.091319 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: exception: Instance 8a4e6f19-21f2-4ff8-af3d-bf93ec2488aa could not be found. Oct 13 13:21:15.091319 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: action_args: {'id': '8a4e6f19-21f2-4ff8-af3d-bf93ec2488aa'} Oct 13 13:21:15.092088 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 13:21:15.092088 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 13:21:15.092088 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 13 13:21:15.092088 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 13 13:21:15.092088 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 13 13:21:15.092088 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 13 13:21:15.092088 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 13 13:21:15.092088 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 13 13:21:15.092088 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 13 13:21:15.092088 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 13 13:21:15.092088 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8a4e6f19-21f2-4ff8-af3d-bf93ec2488aa could not be found. Oct 13 13:21:15.092088 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi Oct 13 13:21:15.092088 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 13:21:15.092088 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi Oct 13 13:21:15.092088 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 13:21:15.092088 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 13:21:15.092088 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 13:21:15.092088 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 13:21:15.092088 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 13:21:15.092088 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 13:21:15.093320 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 13:21:15.093320 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 13 13:21:15.093320 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 13 13:21:15.093320 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 13 13:21:15.093320 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 13 13:21:15.093320 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 13 13:21:15.093320 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 13 13:21:15.093320 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 13 13:21:15.093320 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 13 13:21:15.093320 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8a4e6f19-21f2-4ff8-af3d-bf93ec2488aa could not be found. Oct 13 13:21:15.093320 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi Oct 13 13:21:15.093320 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 13:21:15.093320 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi Oct 13 13:21:15.093320 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 13:21:15.093320 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 13:21:15.093320 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 13:21:15.093320 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 13:21:15.093320 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 13:21:15.093320 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8a4e6f19-21f2-4ff8-af3d-bf93ec2488aa could not be found. Oct 13 13:21:15.093320 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi Oct 13 13:21:15.094574 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-2a38bc35-4e72-49a0-bc3c-960d54a6ee81 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Returning 404 to user: Instance 8a4e6f19-21f2-4ff8-af3d-bf93ec2488aa could not be found. {{(pid=118815) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 13:21:15.094574 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-2a38bc35-4e72-49a0-bc3c-960d54a6ee81 tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] 10.222.0.23 "DELETE /compute/v2.1/servers/8a4e6f19-21f2-4ff8-af3d-bf93ec2488aa" status: 404 len: 111 microversion: 2.1 time: 0.031973 Oct 13 13:21:15.094574 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 511/1039] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Oct 13 13:21:15 2022] DELETE /compute/v2.1/servers/8a4e6f19-21f2-4ff8-af3d-bf93ec2488aa => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 13 13:21:15.099880 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-6d319787-11c3-467f-9c0a-2cb1ca9553dd tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Calling method '>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:21:15.100624 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-6d319787-11c3-467f-9c0a-2cb1ca9553dd tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] [instance: 8a4e6f19-21f2-4ff8-af3d-bf93ec2488aa] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:21:15.107232 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-6d319787-11c3-467f-9c0a-2cb1ca9553dd tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:21:15.107721 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-6d319787-11c3-467f-9c0a-2cb1ca9553dd tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:21:15.108169 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-6d319787-11c3-467f-9c0a-2cb1ca9553dd tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:21:15.108862 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-6d319787-11c3-467f-9c0a-2cb1ca9553dd tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:21:15.109347 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-6d319787-11c3-467f-9c0a-2cb1ca9553dd tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:21:15.109775 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-6d319787-11c3-467f-9c0a-2cb1ca9553dd tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:21:15.123206 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.wsgi [None req-6d319787-11c3-467f-9c0a-2cb1ca9553dd tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] HTTP exception thrown: Instance 8a4e6f19-21f2-4ff8-af3d-bf93ec2488aa could not be found. Oct 13 13:21:15.124724 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-6d319787-11c3-467f-9c0a-2cb1ca9553dd tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Request method failure captured: Oct 13 13:21:15.124724 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: request: GET /compute/v2.1/servers/8a4e6f19-21f2-4ff8-af3d-bf93ec2488aa HTTP/1.1 Oct 13 13:21:15.124724 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: Accept: application/json Oct 13 13:21:15.124724 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: Accept-Encoding: identity Oct 13 13:21:15.124724 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: Connection: close Oct 13 13:21:15.124724 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: Content-Length: 0 Oct 13 13:21:15.124724 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: Content-Type: application/json Oct 13 13:21:15.124724 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: Host: 10.222.0.23 Oct 13 13:21:15.124724 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: Openstack-System-Scope: None Oct 13 13:21:15.124724 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: User-Agent: python-urllib3/1.26.12 Oct 13 13:21:15.124724 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Auth-Token: gAAAAABjSA_IS5ItJrPpOSqy4xNBxVB2bfXfKkj6-lkJ6r6QG2PtZPEmBejUeMw_nAM6PkRJ3-xldl5YnRyFBnqFy7XGF_zAWWgWViC-gBZjak_p4jHlI99AK4eenYmKLRCqGrNs_2qG-o4USzMyv_nCGKRj4tT-7DEE83-B1Dxr5qLtXkKFmJs Oct 13 13:21:15.124724 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Domain-Id: None Oct 13 13:21:15.124724 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Domain-Name: None Oct 13 13:21:15.124724 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Identity-Status: Confirmed Oct 13 13:21:15.124724 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Is-Admin-Project: True Oct 13 13:21:15.124724 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Project-Domain-Id: default Oct 13 13:21:15.124724 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Project-Domain-Name: Default Oct 13 13:21:15.124724 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Project-Id: da546353194342439f9bc3f98f6737e0 Oct 13 13:21:15.124724 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Project-Name: tempest-AttachVolumeNegativeTest-1392517896 Oct 13 13:21:15.124724 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Role: reader,member Oct 13 13:21:15.124724 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Roles: reader,member Oct 13 13:21:15.126397 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_da546353194342439f9bc3f98f6737e0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/da546353194342439f9bc3f98f6737e0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/da546353194342439f9bc3f98f6737e0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/da546353194342439f9bc3f98f6737e0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}] Oct 13 13:21:15.126397 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Tenant: tempest-AttachVolumeNegativeTest-1392517896 Oct 13 13:21:15.126397 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Tenant-Id: da546353194342439f9bc3f98f6737e0 Oct 13 13:21:15.126397 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1392517896 Oct 13 13:21:15.126397 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-User: tempest-AttachVolumeNegativeTest-1392517896-project Oct 13 13:21:15.126397 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-User-Domain-Id: default Oct 13 13:21:15.126397 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-User-Domain-Name: Default Oct 13 13:21:15.126397 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-User-Id: 2cd12070eb954d6880f925957184a288 Oct 13 13:21:15.126397 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-User-Name: tempest-AttachVolumeNegativeTest-1392517896-project Oct 13 13:21:15.126397 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: method: > Oct 13 13:21:15.126397 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: exception: Instance 8a4e6f19-21f2-4ff8-af3d-bf93ec2488aa could not be found. Oct 13 13:21:15.126397 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: action_args: {'id': '8a4e6f19-21f2-4ff8-af3d-bf93ec2488aa'} Oct 13 13:21:15.127363 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 13:21:15.127363 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 13:21:15.127363 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 13 13:21:15.127363 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 13 13:21:15.127363 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 13 13:21:15.127363 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 13 13:21:15.127363 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 13 13:21:15.127363 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 13 13:21:15.127363 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 13 13:21:15.127363 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 13 13:21:15.127363 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8a4e6f19-21f2-4ff8-af3d-bf93ec2488aa could not be found. Oct 13 13:21:15.127363 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi Oct 13 13:21:15.127363 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 13:21:15.127363 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi Oct 13 13:21:15.127363 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 13:21:15.127363 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 13:21:15.127363 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 13:21:15.127363 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 13:21:15.127363 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 13:21:15.127363 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 13:21:15.128954 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 13:21:15.128954 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 13 13:21:15.128954 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 13 13:21:15.128954 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 13 13:21:15.128954 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 13 13:21:15.128954 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 13 13:21:15.128954 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 13 13:21:15.128954 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8a4e6f19-21f2-4ff8-af3d-bf93ec2488aa could not be found. Oct 13 13:21:15.128954 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi Oct 13 13:21:15.128954 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 13:21:15.128954 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi Oct 13 13:21:15.128954 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 13:21:15.128954 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 13:21:15.128954 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 13:21:15.128954 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 13:21:15.128954 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 13:21:15.128954 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8a4e6f19-21f2-4ff8-af3d-bf93ec2488aa could not be found. Oct 13 13:21:15.128954 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi Oct 13 13:21:15.131033 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-6d319787-11c3-467f-9c0a-2cb1ca9553dd tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] Returning 404 to user: Instance 8a4e6f19-21f2-4ff8-af3d-bf93ec2488aa could not be found. {{(pid=118814) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 13:21:15.131033 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-6d319787-11c3-467f-9c0a-2cb1ca9553dd tempest-AttachVolumeNegativeTest-1392517896 tempest-AttachVolumeNegativeTest-1392517896-project] 10.222.0.23 "GET /compute/v2.1/servers/8a4e6f19-21f2-4ff8-af3d-bf93ec2488aa" status: 404 len: 111 microversion: 2.1 time: 0.030221 Oct 13 13:21:15.131033 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 529/1040] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:21:15 2022] GET /compute/v2.1/servers/8a4e6f19-21f2-4ff8-af3d-bf93ec2488aa => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 13 13:22:18.305837 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG dbcounter [-] [118815] Writing DB stats nova_api:SELECT=20 {{(pid=118815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:22:18.306571 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG dbcounter [-] [118815] Writing DB stats nova_cell1:SELECT=37,nova_cell1:INSERT=1 {{(pid=118815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:22:18.308385 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 13 13:22:18.308528 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: Thu Oct 13 13:22:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.23) !!! Oct 13 13:22:18.312706 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-a6a7b78b-79d2-4e35-9da3-32ddc5e47ed1 tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1486817524", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1602157845", "security_groups": [{"name": "tempest-secgroup-smoke-1972725413"}], "block_device_mapping_v2": [{"uuid": "b58cbd0d-340c-4acd-af67-a0946cc7cf84", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "2fc51ab6-7e9b-491d-a490-ff80ae554bf0"}]}} {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 13:22:18.427515 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.network.neutron [None req-a6a7b78b-79d2-4e35-9da3-32ddc5e47ed1 tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] validate_networks() for [('2fc51ab6-7e9b-491d-a490-ff80ae554bf0', None, None, None, None, None)] {{(pid=118815) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 13 13:22:18.877872 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.virt.hardware [None req-a6a7b78b-79d2-4e35-9da3-32ddc5e47ed1 tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Flavor limits 0:0:0 {{(pid=118815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 13 13:22:18.878295 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.virt.hardware [None req-a6a7b78b-79d2-4e35-9da3-32ddc5e47ed1 tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Image limits 0:0:0 {{(pid=118815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 13 13:22:18.878768 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.virt.hardware [None req-a6a7b78b-79d2-4e35-9da3-32ddc5e47ed1 tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Flavor pref 0:0:0 {{(pid=118815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 13 13:22:18.879202 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.virt.hardware [None req-a6a7b78b-79d2-4e35-9da3-32ddc5e47ed1 tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Image pref 0:0:0 {{(pid=118815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 13 13:22:18.879646 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.virt.hardware [None req-a6a7b78b-79d2-4e35-9da3-32ddc5e47ed1 tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 13 13:22:18.888574 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-a6a7b78b-79d2-4e35-9da3-32ddc5e47ed1 tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:22:18.889048 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-a6a7b78b-79d2-4e35-9da3-32ddc5e47ed1 tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:22:18.889519 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-a6a7b78b-79d2-4e35-9da3-32ddc5e47ed1 tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:22:18.890239 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-a6a7b78b-79d2-4e35-9da3-32ddc5e47ed1 tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:22:18.890693 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-a6a7b78b-79d2-4e35-9da3-32ddc5e47ed1 tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:22:18.891141 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-a6a7b78b-79d2-4e35-9da3-32ddc5e47ed1 tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:22:18.907857 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.quota [None req-a6a7b78b-79d2-4e35-9da3-32ddc5e47ed1 tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Getting quotas for project 17e1654782ac4100b0353d561496db51. Resources: {'instances', 'cores', 'ram'} {{(pid=118815) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 13 13:22:18.911932 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.quota [None req-a6a7b78b-79d2-4e35-9da3-32ddc5e47ed1 tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Getting quotas for user cd005dcc25944dfc9aeda1eb1468a0ea and project 17e1654782ac4100b0353d561496db51. Resources: {'instances', 'cores', 'ram'} {{(pid=118815) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 13 13:22:18.969062 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-a6a7b78b-79d2-4e35-9da3-32ddc5e47ed1 tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Going to run 1 instances... {{(pid=118815) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 13 13:22:18.971217 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-a6a7b78b-79d2-4e35-9da3-32ddc5e47ed1 tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] [instance: 08eed5b2-2b11-4226-9b0b-621fa4255408] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='b58cbd0d-340c-4acd-af67-a0946cc7cf84',volume_size=None,volume_type=None)] {{(pid=118815) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 13 13:22:19.097092 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-a6a7b78b-79d2-4e35-9da3-32ddc5e47ed1 tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.792971 Oct 13 13:22:19.097915 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 512/1041] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Oct 13 13:22:18 2022] POST /compute/v2.1/servers => generated 406 bytes in 794 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 13 13:22:19.106922 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG dbcounter [-] [118814] Writing DB stats nova_api:SELECT=28,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=118814) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:22:19.107884 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG dbcounter [-] [118814] Writing DB stats nova_cell1:SELECT=53,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=118814) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:22:19.112641 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-b92dadf1-6f9f-4574-b924-fb09beed5775 tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Calling method '>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:22:19.113828 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-b92dadf1-6f9f-4574-b924-fb09beed5775 tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] [instance: 08eed5b2-2b11-4226-9b0b-621fa4255408] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:22:19.169925 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-b92dadf1-6f9f-4574-b924-fb09beed5775 tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd005dcc25944dfc9aeda1eb1468a0ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e1654782ac4100b0353d561496db51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:22:19.177082 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-b92dadf1-6f9f-4574-b924-fb09beed5775 tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] 10.222.0.23 "GET /compute/v2.1/servers/08eed5b2-2b11-4226-9b0b-621fa4255408" status: 200 len: 1095 microversion: 2.1 time: 0.072109 Oct 13 13:22:19.177847 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 530/1042] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:22:19 2022] GET /compute/v2.1/servers/08eed5b2-2b11-4226-9b0b-621fa4255408 => generated 1095 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:22:20.201217 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-ae6c4d31-c899-4b19-a092-c4a7cafa91dd tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Calling method '>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:22:20.201903 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-ae6c4d31-c899-4b19-a092-c4a7cafa91dd tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] [instance: 08eed5b2-2b11-4226-9b0b-621fa4255408] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:22:20.209829 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-ae6c4d31-c899-4b19-a092-c4a7cafa91dd tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:22:20.210404 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-ae6c4d31-c899-4b19-a092-c4a7cafa91dd tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:22:20.210906 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-ae6c4d31-c899-4b19-a092-c4a7cafa91dd tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:22:20.211969 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-ae6c4d31-c899-4b19-a092-c4a7cafa91dd tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:22:20.212159 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-ae6c4d31-c899-4b19-a092-c4a7cafa91dd tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:22:20.212678 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-ae6c4d31-c899-4b19-a092-c4a7cafa91dd tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:22:20.273624 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-ae6c4d31-c899-4b19-a092-c4a7cafa91dd tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd005dcc25944dfc9aeda1eb1468a0ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e1654782ac4100b0353d561496db51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:22:20.281853 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-ae6c4d31-c899-4b19-a092-c4a7cafa91dd tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] 10.222.0.23 "GET /compute/v2.1/servers/08eed5b2-2b11-4226-9b0b-621fa4255408" status: 200 len: 1211 microversion: 2.1 time: 0.085022 Oct 13 13:22:20.282413 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 513/1043] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:22:20 2022] GET /compute/v2.1/servers/08eed5b2-2b11-4226-9b0b-621fa4255408 => generated 1211 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:22:21.305673 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-e2e4bddd-4eef-409e-9550-8c48b8debbb0 tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Calling method '>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:22:21.306386 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-e2e4bddd-4eef-409e-9550-8c48b8debbb0 tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] [instance: 08eed5b2-2b11-4226-9b0b-621fa4255408] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:22:21.315300 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-e2e4bddd-4eef-409e-9550-8c48b8debbb0 tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:22:21.315876 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-e2e4bddd-4eef-409e-9550-8c48b8debbb0 tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:22:21.316391 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-e2e4bddd-4eef-409e-9550-8c48b8debbb0 tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:22:21.317184 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-e2e4bddd-4eef-409e-9550-8c48b8debbb0 tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:22:21.317715 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-e2e4bddd-4eef-409e-9550-8c48b8debbb0 tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:22:21.318214 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-e2e4bddd-4eef-409e-9550-8c48b8debbb0 tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:22:21.453786 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-e2e4bddd-4eef-409e-9550-8c48b8debbb0 tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd005dcc25944dfc9aeda1eb1468a0ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e1654782ac4100b0353d561496db51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:22:21.461846 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-e2e4bddd-4eef-409e-9550-8c48b8debbb0 tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] 10.222.0.23 "GET /compute/v2.1/servers/08eed5b2-2b11-4226-9b0b-621fa4255408" status: 200 len: 1267 microversion: 2.1 time: 0.160001 Oct 13 13:22:21.462532 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 531/1044] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:22:21 2022] GET /compute/v2.1/servers/08eed5b2-2b11-4226-9b0b-621fa4255408 => generated 1267 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:22:21.648783 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [req-2434059e-1e7a-40c0-9e5d-e5ebd27fe33b req-7e57901e-c443-4f35-8313-e57e49dcd6b7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "08eed5b2-2b11-4226-9b0b-621fa4255408", "tag": "d04332e6-6994-4b34-bd50-ecba43d7de0a"}]} {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 13:22:21.661054 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [req-2434059e-1e7a-40c0-9e5d-e5ebd27fe33b req-7e57901e-c443-4f35-8313-e57e49dcd6b7 service nova] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:22:21.661578 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [req-2434059e-1e7a-40c0-9e5d-e5ebd27fe33b req-7e57901e-c443-4f35-8313-e57e49dcd6b7 service nova] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:22:21.662014 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [req-2434059e-1e7a-40c0-9e5d-e5ebd27fe33b req-7e57901e-c443-4f35-8313-e57e49dcd6b7 service nova] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:22:21.676365 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.compute.server_external_events [req-2434059e-1e7a-40c0-9e5d-e5ebd27fe33b req-7e57901e-c443-4f35-8313-e57e49dcd6b7 service nova] Creating event network-changed:d04332e6-6994-4b34-bd50-ecba43d7de0a for instance 08eed5b2-2b11-4226-9b0b-621fa4255408 on hv-cinder-82660 Oct 13 13:22:21.681931 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [req-2434059e-1e7a-40c0-9e5d-e5ebd27fe33b req-7e57901e-c443-4f35-8313-e57e49dcd6b7 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037214 Oct 13 13:22:21.682853 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 514/1045] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 13:22:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 13:22:22.485237 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-4a65097f-210e-4054-9b23-154472382ef4 tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Calling method '>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:22:22.485849 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-4a65097f-210e-4054-9b23-154472382ef4 tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] [instance: 08eed5b2-2b11-4226-9b0b-621fa4255408] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:22:22.492306 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-4a65097f-210e-4054-9b23-154472382ef4 tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:22:22.492791 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-4a65097f-210e-4054-9b23-154472382ef4 tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:22:22.493226 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-4a65097f-210e-4054-9b23-154472382ef4 tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:22:22.493911 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-4a65097f-210e-4054-9b23-154472382ef4 tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:22:22.494380 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-4a65097f-210e-4054-9b23-154472382ef4 tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:22:22.494788 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-4a65097f-210e-4054-9b23-154472382ef4 tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:22:22.623973 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-4a65097f-210e-4054-9b23-154472382ef4 tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd005dcc25944dfc9aeda1eb1468a0ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e1654782ac4100b0353d561496db51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:22:22.631838 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-4a65097f-210e-4054-9b23-154472382ef4 tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] 10.222.0.23 "GET /compute/v2.1/servers/08eed5b2-2b11-4226-9b0b-621fa4255408" status: 200 len: 1267 microversion: 2.1 time: 0.150427 Oct 13 13:22:22.632503 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 532/1046] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:22:22 2022] GET /compute/v2.1/servers/08eed5b2-2b11-4226-9b0b-621fa4255408 => generated 1267 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:22:23.655196 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-28332f4f-183d-4dd2-8bad-70377d846acc tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Calling method '>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:22:23.655890 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-28332f4f-183d-4dd2-8bad-70377d846acc tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] [instance: 08eed5b2-2b11-4226-9b0b-621fa4255408] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:22:23.662009 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-28332f4f-183d-4dd2-8bad-70377d846acc tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:22:23.662485 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-28332f4f-183d-4dd2-8bad-70377d846acc tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:22:23.662919 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-28332f4f-183d-4dd2-8bad-70377d846acc tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:22:23.663626 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-28332f4f-183d-4dd2-8bad-70377d846acc tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:22:23.664077 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-28332f4f-183d-4dd2-8bad-70377d846acc tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:22:23.664496 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-28332f4f-183d-4dd2-8bad-70377d846acc tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:22:23.796668 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-28332f4f-183d-4dd2-8bad-70377d846acc tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd005dcc25944dfc9aeda1eb1468a0ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e1654782ac4100b0353d561496db51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:22:23.804627 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-28332f4f-183d-4dd2-8bad-70377d846acc tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] 10.222.0.23 "GET /compute/v2.1/servers/08eed5b2-2b11-4226-9b0b-621fa4255408" status: 200 len: 1267 microversion: 2.1 time: 0.154170 Oct 13 13:22:23.805179 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 515/1047] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:22:23 2022] GET /compute/v2.1/servers/08eed5b2-2b11-4226-9b0b-621fa4255408 => generated 1267 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:22:24.828770 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-d146b8e4-183c-45ed-993d-9365752719a0 tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Calling method '>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:22:24.829388 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-d146b8e4-183c-45ed-993d-9365752719a0 tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] [instance: 08eed5b2-2b11-4226-9b0b-621fa4255408] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:22:24.835810 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-d146b8e4-183c-45ed-993d-9365752719a0 tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:22:24.836291 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-d146b8e4-183c-45ed-993d-9365752719a0 tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:22:24.836728 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-d146b8e4-183c-45ed-993d-9365752719a0 tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:22:24.837414 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-d146b8e4-183c-45ed-993d-9365752719a0 tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:22:24.837889 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-d146b8e4-183c-45ed-993d-9365752719a0 tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:22:24.838313 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-d146b8e4-183c-45ed-993d-9365752719a0 tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:22:24.973891 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-d146b8e4-183c-45ed-993d-9365752719a0 tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd005dcc25944dfc9aeda1eb1468a0ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e1654782ac4100b0353d561496db51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:22:24.982133 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-d146b8e4-183c-45ed-993d-9365752719a0 tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] 10.222.0.23 "GET /compute/v2.1/servers/08eed5b2-2b11-4226-9b0b-621fa4255408" status: 200 len: 1267 microversion: 2.1 time: 0.157281 Oct 13 13:22:24.982692 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 533/1048] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:22:24 2022] GET /compute/v2.1/servers/08eed5b2-2b11-4226-9b0b-621fa4255408 => generated 1267 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:22:26.005432 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-ea83c85e-89a7-4e63-8e29-03af9f0e832e tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Calling method '>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:22:26.006051 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-ea83c85e-89a7-4e63-8e29-03af9f0e832e tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] [instance: 08eed5b2-2b11-4226-9b0b-621fa4255408] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:22:26.012946 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-ea83c85e-89a7-4e63-8e29-03af9f0e832e tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:22:26.013432 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-ea83c85e-89a7-4e63-8e29-03af9f0e832e tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:22:26.013874 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-ea83c85e-89a7-4e63-8e29-03af9f0e832e tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:22:26.014564 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-ea83c85e-89a7-4e63-8e29-03af9f0e832e tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:22:26.015023 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-ea83c85e-89a7-4e63-8e29-03af9f0e832e tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:22:26.015488 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-ea83c85e-89a7-4e63-8e29-03af9f0e832e tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:22:26.141479 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-ea83c85e-89a7-4e63-8e29-03af9f0e832e tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd005dcc25944dfc9aeda1eb1468a0ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e1654782ac4100b0353d561496db51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:22:26.149090 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-ea83c85e-89a7-4e63-8e29-03af9f0e832e tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] 10.222.0.23 "GET /compute/v2.1/servers/08eed5b2-2b11-4226-9b0b-621fa4255408" status: 200 len: 1267 microversion: 2.1 time: 0.147542 Oct 13 13:22:26.149649 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 516/1049] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:22:26 2022] GET /compute/v2.1/servers/08eed5b2-2b11-4226-9b0b-621fa4255408 => generated 1267 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:22:27.171544 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-1ce55980-abfe-45a3-822f-5145256b8af5 tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Calling method '>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:22:27.172088 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-1ce55980-abfe-45a3-822f-5145256b8af5 tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] [instance: 08eed5b2-2b11-4226-9b0b-621fa4255408] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:22:27.178897 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-1ce55980-abfe-45a3-822f-5145256b8af5 tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:22:27.179477 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-1ce55980-abfe-45a3-822f-5145256b8af5 tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:22:27.179912 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-1ce55980-abfe-45a3-822f-5145256b8af5 tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:22:27.180600 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-1ce55980-abfe-45a3-822f-5145256b8af5 tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:22:27.181064 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-1ce55980-abfe-45a3-822f-5145256b8af5 tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:22:27.181485 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-1ce55980-abfe-45a3-822f-5145256b8af5 tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:22:27.312477 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-1ce55980-abfe-45a3-822f-5145256b8af5 tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd005dcc25944dfc9aeda1eb1468a0ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e1654782ac4100b0353d561496db51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:22:27.320138 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-1ce55980-abfe-45a3-822f-5145256b8af5 tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] 10.222.0.23 "GET /compute/v2.1/servers/08eed5b2-2b11-4226-9b0b-621fa4255408" status: 200 len: 1267 microversion: 2.1 time: 0.153210 Oct 13 13:22:27.320700 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 534/1050] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:22:27 2022] GET /compute/v2.1/servers/08eed5b2-2b11-4226-9b0b-621fa4255408 => generated 1267 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:22:28.343146 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-123297bc-e1af-4bfd-8601-a5f298f4c807 tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Calling method '>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:22:28.343773 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-123297bc-e1af-4bfd-8601-a5f298f4c807 tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] [instance: 08eed5b2-2b11-4226-9b0b-621fa4255408] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:22:28.350135 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-123297bc-e1af-4bfd-8601-a5f298f4c807 tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:22:28.350614 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-123297bc-e1af-4bfd-8601-a5f298f4c807 tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:22:28.351065 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-123297bc-e1af-4bfd-8601-a5f298f4c807 tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:22:28.351765 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-123297bc-e1af-4bfd-8601-a5f298f4c807 tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:22:28.352224 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-123297bc-e1af-4bfd-8601-a5f298f4c807 tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:22:28.352651 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-123297bc-e1af-4bfd-8601-a5f298f4c807 tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:22:28.482362 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-123297bc-e1af-4bfd-8601-a5f298f4c807 tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd005dcc25944dfc9aeda1eb1468a0ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e1654782ac4100b0353d561496db51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:22:28.490042 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-123297bc-e1af-4bfd-8601-a5f298f4c807 tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] 10.222.0.23 "GET /compute/v2.1/servers/08eed5b2-2b11-4226-9b0b-621fa4255408" status: 200 len: 1267 microversion: 2.1 time: 0.150759 Oct 13 13:22:28.490601 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 517/1051] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:22:28 2022] GET /compute/v2.1/servers/08eed5b2-2b11-4226-9b0b-621fa4255408 => generated 1267 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:22:29.513311 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-05739735-1416-436f-8d20-cec5aa6941b0 tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Calling method '>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:22:29.513860 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-05739735-1416-436f-8d20-cec5aa6941b0 tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] [instance: 08eed5b2-2b11-4226-9b0b-621fa4255408] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:22:29.516243 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG dbcounter [-] [118814] Writing DB stats nova_cell0:SELECT=2 {{(pid=118814) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:22:29.521687 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-05739735-1416-436f-8d20-cec5aa6941b0 tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:22:29.522319 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-05739735-1416-436f-8d20-cec5aa6941b0 tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:22:29.522748 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-05739735-1416-436f-8d20-cec5aa6941b0 tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:22:29.523472 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-05739735-1416-436f-8d20-cec5aa6941b0 tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:22:29.523921 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-05739735-1416-436f-8d20-cec5aa6941b0 tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:22:29.524372 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-05739735-1416-436f-8d20-cec5aa6941b0 tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:22:29.654951 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-05739735-1416-436f-8d20-cec5aa6941b0 tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd005dcc25944dfc9aeda1eb1468a0ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e1654782ac4100b0353d561496db51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:22:29.662670 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-05739735-1416-436f-8d20-cec5aa6941b0 tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] 10.222.0.23 "GET /compute/v2.1/servers/08eed5b2-2b11-4226-9b0b-621fa4255408" status: 200 len: 1267 microversion: 2.1 time: 0.153912 Oct 13 13:22:29.663276 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 535/1052] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:22:29 2022] GET /compute/v2.1/servers/08eed5b2-2b11-4226-9b0b-621fa4255408 => generated 1267 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:22:30.685483 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-0ed6e43c-2afa-4586-9e6c-0609345335ac tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Calling method '>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:22:30.686105 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-0ed6e43c-2afa-4586-9e6c-0609345335ac tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] [instance: 08eed5b2-2b11-4226-9b0b-621fa4255408] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:22:30.688085 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG dbcounter [-] [118815] Writing DB stats nova_cell0:SELECT=2 {{(pid=118815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:22:30.688737 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG dbcounter [-] [118815] Writing DB stats nova_cell0:SELECT=6 {{(pid=118815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:22:30.695495 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-0ed6e43c-2afa-4586-9e6c-0609345335ac tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:22:30.695976 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-0ed6e43c-2afa-4586-9e6c-0609345335ac tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:22:30.696414 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-0ed6e43c-2afa-4586-9e6c-0609345335ac tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:22:30.697117 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-0ed6e43c-2afa-4586-9e6c-0609345335ac tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:22:30.697602 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-0ed6e43c-2afa-4586-9e6c-0609345335ac tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:22:30.697976 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-0ed6e43c-2afa-4586-9e6c-0609345335ac tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:22:30.829678 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-0ed6e43c-2afa-4586-9e6c-0609345335ac tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd005dcc25944dfc9aeda1eb1468a0ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e1654782ac4100b0353d561496db51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:22:30.837367 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-0ed6e43c-2afa-4586-9e6c-0609345335ac tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] 10.222.0.23 "GET /compute/v2.1/servers/08eed5b2-2b11-4226-9b0b-621fa4255408" status: 200 len: 1267 microversion: 2.1 time: 0.155936 Oct 13 13:22:30.837926 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 518/1053] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:22:30 2022] GET /compute/v2.1/servers/08eed5b2-2b11-4226-9b0b-621fa4255408 => generated 1267 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:22:31.803243 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [req-cb3e9cc4-7ec5-455e-b9c1-51bd2f3f48dd req-b43cb098-2e70-4b0a-a158-94aea6596edf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "08eed5b2-2b11-4226-9b0b-621fa4255408", "name": "network-vif-plugged", "status": "completed", "tag": "d04332e6-6994-4b34-bd50-ecba43d7de0a"}]} {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 13:22:31.813310 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [req-cb3e9cc4-7ec5-455e-b9c1-51bd2f3f48dd req-b43cb098-2e70-4b0a-a158-94aea6596edf service nova] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:22:31.813796 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [req-cb3e9cc4-7ec5-455e-b9c1-51bd2f3f48dd req-b43cb098-2e70-4b0a-a158-94aea6596edf service nova] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:22:31.814371 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [req-cb3e9cc4-7ec5-455e-b9c1-51bd2f3f48dd req-b43cb098-2e70-4b0a-a158-94aea6596edf service nova] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:22:31.825499 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.compute.server_external_events [req-cb3e9cc4-7ec5-455e-b9c1-51bd2f3f48dd req-b43cb098-2e70-4b0a-a158-94aea6596edf service nova] Creating event network-vif-plugged:d04332e6-6994-4b34-bd50-ecba43d7de0a for instance 08eed5b2-2b11-4226-9b0b-621fa4255408 on hv-cinder-82660 Oct 13 13:22:31.830483 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [req-cb3e9cc4-7ec5-455e-b9c1-51bd2f3f48dd req-b43cb098-2e70-4b0a-a158-94aea6596edf service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031369 Oct 13 13:22:31.831089 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 536/1054] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 13:22:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 13 13:22:31.860390 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-039e5196-5d5a-4cb2-9e94-2a5bdfd9ed84 tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Calling method '>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:22:31.861010 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-039e5196-5d5a-4cb2-9e94-2a5bdfd9ed84 tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] [instance: 08eed5b2-2b11-4226-9b0b-621fa4255408] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:22:31.868177 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-039e5196-5d5a-4cb2-9e94-2a5bdfd9ed84 tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:22:31.868668 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-039e5196-5d5a-4cb2-9e94-2a5bdfd9ed84 tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:22:31.869110 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-039e5196-5d5a-4cb2-9e94-2a5bdfd9ed84 tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:22:31.869815 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-039e5196-5d5a-4cb2-9e94-2a5bdfd9ed84 tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:22:31.870276 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-039e5196-5d5a-4cb2-9e94-2a5bdfd9ed84 tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:22:31.870776 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-039e5196-5d5a-4cb2-9e94-2a5bdfd9ed84 tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:22:32.005935 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-039e5196-5d5a-4cb2-9e94-2a5bdfd9ed84 tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd005dcc25944dfc9aeda1eb1468a0ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e1654782ac4100b0353d561496db51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:22:32.013850 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-039e5196-5d5a-4cb2-9e94-2a5bdfd9ed84 tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] 10.222.0.23 "GET /compute/v2.1/servers/08eed5b2-2b11-4226-9b0b-621fa4255408" status: 200 len: 1267 microversion: 2.1 time: 0.157445 Oct 13 13:22:32.014623 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 519/1055] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:22:31 2022] GET /compute/v2.1/servers/08eed5b2-2b11-4226-9b0b-621fa4255408 => generated 1267 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:22:33.039694 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-92c9e09d-c12a-4746-be66-f8143a818399 tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Calling method '>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:22:33.040513 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-92c9e09d-c12a-4746-be66-f8143a818399 tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] [instance: 08eed5b2-2b11-4226-9b0b-621fa4255408] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:22:33.047339 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-92c9e09d-c12a-4746-be66-f8143a818399 tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:22:33.047835 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-92c9e09d-c12a-4746-be66-f8143a818399 tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:22:33.048277 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-92c9e09d-c12a-4746-be66-f8143a818399 tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:22:33.048991 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-92c9e09d-c12a-4746-be66-f8143a818399 tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:22:33.049438 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-92c9e09d-c12a-4746-be66-f8143a818399 tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:22:33.050118 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-92c9e09d-c12a-4746-be66-f8143a818399 tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:22:33.182270 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-92c9e09d-c12a-4746-be66-f8143a818399 tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd005dcc25944dfc9aeda1eb1468a0ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e1654782ac4100b0353d561496db51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:22:33.190746 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-92c9e09d-c12a-4746-be66-f8143a818399 tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] 10.222.0.23 "GET /compute/v2.1/servers/08eed5b2-2b11-4226-9b0b-621fa4255408" status: 200 len: 1267 microversion: 2.1 time: 0.156905 Oct 13 13:22:33.191335 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 537/1056] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:22:33 2022] GET /compute/v2.1/servers/08eed5b2-2b11-4226-9b0b-621fa4255408 => generated 1267 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:22:34.213517 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-a625fb11-aa8d-4a34-bcc2-5395e8b68703 tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Calling method '>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:22:34.214041 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-a625fb11-aa8d-4a34-bcc2-5395e8b68703 tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] [instance: 08eed5b2-2b11-4226-9b0b-621fa4255408] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:22:34.220412 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-a625fb11-aa8d-4a34-bcc2-5395e8b68703 tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:22:34.220898 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-a625fb11-aa8d-4a34-bcc2-5395e8b68703 tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:22:34.221344 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-a625fb11-aa8d-4a34-bcc2-5395e8b68703 tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:22:34.222039 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-a625fb11-aa8d-4a34-bcc2-5395e8b68703 tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:22:34.222497 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-a625fb11-aa8d-4a34-bcc2-5395e8b68703 tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:22:34.222924 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-a625fb11-aa8d-4a34-bcc2-5395e8b68703 tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:22:34.348970 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-a625fb11-aa8d-4a34-bcc2-5395e8b68703 tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd005dcc25944dfc9aeda1eb1468a0ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e1654782ac4100b0353d561496db51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:22:34.357221 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-a625fb11-aa8d-4a34-bcc2-5395e8b68703 tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] 10.222.0.23 "GET /compute/v2.1/servers/08eed5b2-2b11-4226-9b0b-621fa4255408" status: 200 len: 1455 microversion: 2.1 time: 0.147655 Oct 13 13:22:34.357779 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 520/1057] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:22:34 2022] GET /compute/v2.1/servers/08eed5b2-2b11-4226-9b0b-621fa4255408 => generated 1455 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:22:34.379494 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-31aab2c4-1868-43b2-b510-46a432aab5ab tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Calling method '>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:22:34.380107 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-31aab2c4-1868-43b2-b510-46a432aab5ab tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] [instance: 08eed5b2-2b11-4226-9b0b-621fa4255408] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:22:34.386525 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-31aab2c4-1868-43b2-b510-46a432aab5ab tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:22:34.387011 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-31aab2c4-1868-43b2-b510-46a432aab5ab tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:22:34.387480 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-31aab2c4-1868-43b2-b510-46a432aab5ab tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:22:34.388171 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-31aab2c4-1868-43b2-b510-46a432aab5ab tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:22:34.388626 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-31aab2c4-1868-43b2-b510-46a432aab5ab tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:22:34.389052 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-31aab2c4-1868-43b2-b510-46a432aab5ab tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:22:34.521189 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-31aab2c4-1868-43b2-b510-46a432aab5ab tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd005dcc25944dfc9aeda1eb1468a0ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e1654782ac4100b0353d561496db51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:22:34.528946 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-31aab2c4-1868-43b2-b510-46a432aab5ab tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] 10.222.0.23 "GET /compute/v2.1/servers/08eed5b2-2b11-4226-9b0b-621fa4255408" status: 200 len: 1455 microversion: 2.1 time: 0.153412 Oct 13 13:22:34.529509 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 538/1058] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:22:34 2022] GET /compute/v2.1/servers/08eed5b2-2b11-4226-9b0b-621fa4255408 => generated 1455 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:22:36.421459 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [req-143bd3c1-a983-460a-aa7f-5025c86897ca req-457d62be-06de-436a-a6dc-6930b7535943 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "08eed5b2-2b11-4226-9b0b-621fa4255408", "tag": "d04332e6-6994-4b34-bd50-ecba43d7de0a"}]} {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 13:22:36.430995 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [req-143bd3c1-a983-460a-aa7f-5025c86897ca req-457d62be-06de-436a-a6dc-6930b7535943 service nova] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:22:36.431515 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [req-143bd3c1-a983-460a-aa7f-5025c86897ca req-457d62be-06de-436a-a6dc-6930b7535943 service nova] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:22:36.431951 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [req-143bd3c1-a983-460a-aa7f-5025c86897ca req-457d62be-06de-436a-a6dc-6930b7535943 service nova] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:22:36.443266 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.compute.server_external_events [req-143bd3c1-a983-460a-aa7f-5025c86897ca req-457d62be-06de-436a-a6dc-6930b7535943 service nova] Creating event network-changed:d04332e6-6994-4b34-bd50-ecba43d7de0a for instance 08eed5b2-2b11-4226-9b0b-621fa4255408 on hv-cinder-82660 Oct 13 13:22:36.448264 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [req-143bd3c1-a983-460a-aa7f-5025c86897ca req-457d62be-06de-436a-a6dc-6930b7535943 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.148556 Oct 13 13:22:36.449457 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 521/1059] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 13:22:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 13:24:16.020856 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG dbcounter [-] [118814] Writing DB stats nova_api:SELECT=20 {{(pid=118814) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:24:16.022451 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG dbcounter [-] [118814] Writing DB stats nova_cell1:SELECT=44 {{(pid=118814) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:24:16.024171 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 13 13:24:16.024354 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: Thu Oct 13 13:24:16 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/08eed5b2-2b11-4226-9b0b-621fa4255408 (ip 10.222.0.23) !!! Oct 13 13:24:16.025375 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG dbcounter [-] [118815] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=3 {{(pid=118815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:24:16.026669 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG dbcounter [-] [118815] Writing DB stats nova_cell1:SELECT=48 {{(pid=118815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 13:24:16.028755 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-54246c2d-3671-409d-abed-5f0cb4b51d3a tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Calling method '>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:24:16.030216 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-54246c2d-3671-409d-abed-5f0cb4b51d3a tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] [instance: 08eed5b2-2b11-4226-9b0b-621fa4255408] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:24:16.034258 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [req-002e35d0-43b0-4473-aa76-c0bcb07f505d req-6d538962-bc9a-453b-bf6c-5c95b0855801 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "08eed5b2-2b11-4226-9b0b-621fa4255408", "tag": "d04332e6-6994-4b34-bd50-ecba43d7de0a"}]} {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 13:24:16.040577 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-54246c2d-3671-409d-abed-5f0cb4b51d3a tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:24:16.041071 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-54246c2d-3671-409d-abed-5f0cb4b51d3a tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:24:16.041509 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-54246c2d-3671-409d-abed-5f0cb4b51d3a tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:24:16.042209 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-54246c2d-3671-409d-abed-5f0cb4b51d3a tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:24:16.042854 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-54246c2d-3671-409d-abed-5f0cb4b51d3a tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:24:16.043406 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-54246c2d-3671-409d-abed-5f0cb4b51d3a tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:24:16.047861 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [req-002e35d0-43b0-4473-aa76-c0bcb07f505d req-6d538962-bc9a-453b-bf6c-5c95b0855801 service nova] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:24:16.048625 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [req-002e35d0-43b0-4473-aa76-c0bcb07f505d req-6d538962-bc9a-453b-bf6c-5c95b0855801 service nova] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:24:16.049285 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [req-002e35d0-43b0-4473-aa76-c0bcb07f505d req-6d538962-bc9a-453b-bf6c-5c95b0855801 service nova] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:24:16.061444 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.compute.server_external_events [req-002e35d0-43b0-4473-aa76-c0bcb07f505d req-6d538962-bc9a-453b-bf6c-5c95b0855801 service nova] Creating event network-changed:d04332e6-6994-4b34-bd50-ecba43d7de0a for instance 08eed5b2-2b11-4226-9b0b-621fa4255408 on hv-cinder-82660 Oct 13 13:24:16.066703 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [req-002e35d0-43b0-4473-aa76-c0bcb07f505d req-6d538962-bc9a-453b-bf6c-5c95b0855801 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044534 Oct 13 13:24:16.067916 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 522/1060] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 13:24:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 13 13:24:16.073279 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-54246c2d-3671-409d-abed-5f0cb4b51d3a tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] [instance: 08eed5b2-2b11-4226-9b0b-621fa4255408] Going to try to terminate instance {{(pid=118814) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 13 13:24:16.167452 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-54246c2d-3671-409d-abed-5f0cb4b51d3a tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] 10.222.0.23 "DELETE /compute/v2.1/servers/08eed5b2-2b11-4226-9b0b-621fa4255408" status: 204 len: 0 microversion: 2.1 time: 0.148576 Oct 13 13:24:16.168154 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 539/1061] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Oct 13 13:24:16 2022] DELETE /compute/v2.1/servers/08eed5b2-2b11-4226-9b0b-621fa4255408 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 13 13:24:16.177190 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-0639d3fc-de2c-4fc6-b485-1d6b340c7f13 tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Calling method '>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:24:16.179317 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-0639d3fc-de2c-4fc6-b485-1d6b340c7f13 tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] [instance: 08eed5b2-2b11-4226-9b0b-621fa4255408] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:24:16.185326 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-0639d3fc-de2c-4fc6-b485-1d6b340c7f13 tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:24:16.185882 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-0639d3fc-de2c-4fc6-b485-1d6b340c7f13 tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:24:16.186384 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-0639d3fc-de2c-4fc6-b485-1d6b340c7f13 tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:24:16.187169 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-0639d3fc-de2c-4fc6-b485-1d6b340c7f13 tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:24:16.188097 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-0639d3fc-de2c-4fc6-b485-1d6b340c7f13 tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:24:16.188097 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-0639d3fc-de2c-4fc6-b485-1d6b340c7f13 tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:24:16.327845 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-0639d3fc-de2c-4fc6-b485-1d6b340c7f13 tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd005dcc25944dfc9aeda1eb1468a0ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e1654782ac4100b0353d561496db51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:24:16.336983 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-0639d3fc-de2c-4fc6-b485-1d6b340c7f13 tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] 10.222.0.23 "GET /compute/v2.1/servers/08eed5b2-2b11-4226-9b0b-621fa4255408" status: 200 len: 1580 microversion: 2.1 time: 0.164256 Oct 13 13:24:16.337546 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 523/1062] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:24:16 2022] GET /compute/v2.1/servers/08eed5b2-2b11-4226-9b0b-621fa4255408 => generated 1580 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:24:17.360711 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-5f00e2a6-6d5b-4231-b7e7-8cd83a5c3455 tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Calling method '>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:24:17.361409 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-5f00e2a6-6d5b-4231-b7e7-8cd83a5c3455 tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] [instance: 08eed5b2-2b11-4226-9b0b-621fa4255408] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:24:17.368585 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-5f00e2a6-6d5b-4231-b7e7-8cd83a5c3455 tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:24:17.369095 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-5f00e2a6-6d5b-4231-b7e7-8cd83a5c3455 tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:24:17.369558 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-5f00e2a6-6d5b-4231-b7e7-8cd83a5c3455 tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:24:17.370243 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-5f00e2a6-6d5b-4231-b7e7-8cd83a5c3455 tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:24:17.370693 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-5f00e2a6-6d5b-4231-b7e7-8cd83a5c3455 tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:24:17.371135 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-5f00e2a6-6d5b-4231-b7e7-8cd83a5c3455 tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:24:17.499249 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-5f00e2a6-6d5b-4231-b7e7-8cd83a5c3455 tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd005dcc25944dfc9aeda1eb1468a0ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e1654782ac4100b0353d561496db51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:24:17.508059 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-5f00e2a6-6d5b-4231-b7e7-8cd83a5c3455 tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] 10.222.0.23 "GET /compute/v2.1/servers/08eed5b2-2b11-4226-9b0b-621fa4255408" status: 200 len: 1580 microversion: 2.1 time: 0.151583 Oct 13 13:24:17.508630 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 540/1063] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:24:17 2022] GET /compute/v2.1/servers/08eed5b2-2b11-4226-9b0b-621fa4255408 => generated 1580 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:24:18.106068 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [req-5e05ae56-6949-49a4-b457-4b088f43cf84 req-8e41934a-cdb6-43a4-8683-fe3632605945 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "08eed5b2-2b11-4226-9b0b-621fa4255408", "name": "network-vif-deleted", "tag": "d04332e6-6994-4b34-bd50-ecba43d7de0a"}]} {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 13:24:18.116607 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [req-5e05ae56-6949-49a4-b457-4b088f43cf84 req-8e41934a-cdb6-43a4-8683-fe3632605945 service nova] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:24:18.117083 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [req-5e05ae56-6949-49a4-b457-4b088f43cf84 req-8e41934a-cdb6-43a4-8683-fe3632605945 service nova] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:24:18.117515 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [req-5e05ae56-6949-49a4-b457-4b088f43cf84 req-8e41934a-cdb6-43a4-8683-fe3632605945 service nova] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:24:18.129513 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.compute.server_external_events [req-5e05ae56-6949-49a4-b457-4b088f43cf84 req-8e41934a-cdb6-43a4-8683-fe3632605945 service nova] Creating event network-vif-deleted:d04332e6-6994-4b34-bd50-ecba43d7de0a for instance 08eed5b2-2b11-4226-9b0b-621fa4255408 on hv-cinder-82660 Oct 13 13:24:18.134960 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [req-5e05ae56-6949-49a4-b457-4b088f43cf84 req-8e41934a-cdb6-43a4-8683-fe3632605945 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032487 Oct 13 13:24:18.135742 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 524/1064] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 13:24:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 13:24:18.531406 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-24226dfe-b3c4-48a0-b9be-a349829cfbff tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Calling method '>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:24:18.532016 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-24226dfe-b3c4-48a0-b9be-a349829cfbff tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] [instance: 08eed5b2-2b11-4226-9b0b-621fa4255408] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:24:18.538996 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-24226dfe-b3c4-48a0-b9be-a349829cfbff tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:24:18.539511 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-24226dfe-b3c4-48a0-b9be-a349829cfbff tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:24:18.539943 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-24226dfe-b3c4-48a0-b9be-a349829cfbff tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:24:18.540623 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-24226dfe-b3c4-48a0-b9be-a349829cfbff tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:24:18.541070 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-24226dfe-b3c4-48a0-b9be-a349829cfbff tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:24:18.541486 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-24226dfe-b3c4-48a0-b9be-a349829cfbff tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:24:18.572698 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-24226dfe-b3c4-48a0-b9be-a349829cfbff tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:24:18.573175 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-24226dfe-b3c4-48a0-b9be-a349829cfbff tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:24:18.573603 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-24226dfe-b3c4-48a0-b9be-a349829cfbff tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:24:18.574044 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.objects.instance [None req-24226dfe-b3c4-48a0-b9be-a349829cfbff tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Lazy-loading 'fault' on Instance uuid 08eed5b2-2b11-4226-9b0b-621fa4255408 {{(pid=118814) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 13 13:24:18.617152 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-24226dfe-b3c4-48a0-b9be-a349829cfbff tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd005dcc25944dfc9aeda1eb1468a0ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e1654782ac4100b0353d561496db51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:24:18.624782 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-24226dfe-b3c4-48a0-b9be-a349829cfbff tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] 10.222.0.23 "GET /compute/v2.1/servers/08eed5b2-2b11-4226-9b0b-621fa4255408" status: 200 len: 1231 microversion: 2.1 time: 0.097396 Oct 13 13:24:18.625297 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 541/1065] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:24:18 2022] GET /compute/v2.1/servers/08eed5b2-2b11-4226-9b0b-621fa4255408 => generated 1231 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:24:19.649478 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-870ee54b-50bd-4e31-b348-dfb0a92182e6 tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Calling method '>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:24:19.650095 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-870ee54b-50bd-4e31-b348-dfb0a92182e6 tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] [instance: 08eed5b2-2b11-4226-9b0b-621fa4255408] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:24:19.656135 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-870ee54b-50bd-4e31-b348-dfb0a92182e6 tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:24:19.656614 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-870ee54b-50bd-4e31-b348-dfb0a92182e6 tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:24:19.657045 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-870ee54b-50bd-4e31-b348-dfb0a92182e6 tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:24:19.657729 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-870ee54b-50bd-4e31-b348-dfb0a92182e6 tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:24:19.658179 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-870ee54b-50bd-4e31-b348-dfb0a92182e6 tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:24:19.658594 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-870ee54b-50bd-4e31-b348-dfb0a92182e6 tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:24:19.672069 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.wsgi [None req-870ee54b-50bd-4e31-b348-dfb0a92182e6 tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] HTTP exception thrown: Instance 08eed5b2-2b11-4226-9b0b-621fa4255408 could not be found. Oct 13 13:24:19.673663 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-870ee54b-50bd-4e31-b348-dfb0a92182e6 tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Request method failure captured: Oct 13 13:24:19.673663 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: request: GET /compute/v2.1/servers/08eed5b2-2b11-4226-9b0b-621fa4255408 HTTP/1.1 Oct 13 13:24:19.673663 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: Accept: application/json Oct 13 13:24:19.673663 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: Accept-Encoding: identity Oct 13 13:24:19.673663 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: Connection: close Oct 13 13:24:19.673663 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: Content-Length: 0 Oct 13 13:24:19.673663 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: Content-Type: application/json Oct 13 13:24:19.673663 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: Host: 10.222.0.23 Oct 13 13:24:19.673663 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: Openstack-System-Scope: None Oct 13 13:24:19.673663 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: User-Agent: python-urllib3/1.26.12 Oct 13 13:24:19.673663 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Auth-Token: gAAAAABjSA_1FCQ67PHpjpU4Wwc6CXFHNinbU83FmzKFriOepDUfokfzZ8id4uD7J0tYysw9XZE5sD7lOQs-pUs-McO_QDy1XHV3SLgefdIJs_OYz-KVMIn65gwYa7fW86ZY2c6BS06BR5XLWvyN9CN4lK-VptUWMmUug9azR6ncWFuFfapFN_M Oct 13 13:24:19.673663 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Domain-Id: None Oct 13 13:24:19.673663 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Domain-Name: None Oct 13 13:24:19.673663 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Identity-Status: Confirmed Oct 13 13:24:19.673663 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Is-Admin-Project: True Oct 13 13:24:19.673663 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Project-Domain-Id: default Oct 13 13:24:19.673663 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Project-Domain-Name: Default Oct 13 13:24:19.673663 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Project-Id: 17e1654782ac4100b0353d561496db51 Oct 13 13:24:19.673663 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Project-Name: tempest-TestVolumeBootPattern-1022162848 Oct 13 13:24:19.673663 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Role: reader,member Oct 13 13:24:19.673663 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Roles: reader,member Oct 13 13:24:19.675517 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_17e1654782ac4100b0353d561496db51"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/17e1654782ac4100b0353d561496db51"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/17e1654782ac4100b0353d561496db51"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/17e1654782ac4100b0353d561496db51"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}] Oct 13 13:24:19.675517 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Tenant: tempest-TestVolumeBootPattern-1022162848 Oct 13 13:24:19.675517 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Tenant-Id: 17e1654782ac4100b0353d561496db51 Oct 13 13:24:19.675517 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Tenant-Name: tempest-TestVolumeBootPattern-1022162848 Oct 13 13:24:19.675517 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-User: tempest-TestVolumeBootPattern-1022162848-project Oct 13 13:24:19.675517 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-User-Domain-Id: default Oct 13 13:24:19.675517 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-User-Domain-Name: Default Oct 13 13:24:19.675517 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-User-Id: cd005dcc25944dfc9aeda1eb1468a0ea Oct 13 13:24:19.675517 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-User-Name: tempest-TestVolumeBootPattern-1022162848-project Oct 13 13:24:19.675517 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: method: > Oct 13 13:24:19.675517 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: exception: Instance 08eed5b2-2b11-4226-9b0b-621fa4255408 could not be found. Oct 13 13:24:19.675517 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: action_args: {'id': '08eed5b2-2b11-4226-9b0b-621fa4255408'} Oct 13 13:24:19.676511 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 13:24:19.676511 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 13:24:19.676511 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 13 13:24:19.676511 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 13 13:24:19.676511 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 13 13:24:19.676511 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 13 13:24:19.676511 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 13 13:24:19.676511 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 13 13:24:19.676511 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 13 13:24:19.676511 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 13 13:24:19.676511 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 08eed5b2-2b11-4226-9b0b-621fa4255408 could not be found. Oct 13 13:24:19.676511 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi Oct 13 13:24:19.676511 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 13:24:19.676511 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi Oct 13 13:24:19.676511 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 13:24:19.676511 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 13:24:19.676511 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 13:24:19.676511 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 13:24:19.676511 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 13:24:19.676511 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 13:24:19.678224 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 13:24:19.678224 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 13 13:24:19.678224 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 13 13:24:19.678224 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 13 13:24:19.678224 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 13 13:24:19.678224 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 13 13:24:19.678224 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 13 13:24:19.678224 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 08eed5b2-2b11-4226-9b0b-621fa4255408 could not be found. Oct 13 13:24:19.678224 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi Oct 13 13:24:19.678224 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 13:24:19.678224 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi Oct 13 13:24:19.678224 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 13:24:19.678224 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 13:24:19.678224 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 13:24:19.678224 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 13:24:19.678224 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 13:24:19.678224 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 08eed5b2-2b11-4226-9b0b-621fa4255408 could not be found. Oct 13 13:24:19.678224 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi Oct 13 13:24:19.679979 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-870ee54b-50bd-4e31-b348-dfb0a92182e6 tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Returning 404 to user: Instance 08eed5b2-2b11-4226-9b0b-621fa4255408 could not be found. {{(pid=118815) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 13:24:19.679979 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-870ee54b-50bd-4e31-b348-dfb0a92182e6 tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] 10.222.0.23 "GET /compute/v2.1/servers/08eed5b2-2b11-4226-9b0b-621fa4255408" status: 404 len: 111 microversion: 2.1 time: 0.030831 Oct 13 13:24:19.679979 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 525/1066] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:24:19 2022] GET /compute/v2.1/servers/08eed5b2-2b11-4226-9b0b-621fa4255408 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 13 13:24:22.710617 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-1a26deb9-88c8-483a-8693-013fcc850646 tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Calling method '>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:24:22.711162 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-1a26deb9-88c8-483a-8693-013fcc850646 tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] [instance: 5f41cc60-bad3-4447-8c5e-9cc7f7e3c389] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:24:22.713124 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [req-aff1ef19-dbef-4751-8032-5c366c894640 req-813a3a03-db0d-4c01-9bba-c851e3dc60ff service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5f41cc60-bad3-4447-8c5e-9cc7f7e3c389", "tag": "56d3063f-8418-4251-989d-cd1d0b565ff1"}]} {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 13:24:22.717692 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-1a26deb9-88c8-483a-8693-013fcc850646 tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:24:22.718177 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-1a26deb9-88c8-483a-8693-013fcc850646 tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:24:22.718613 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-1a26deb9-88c8-483a-8693-013fcc850646 tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:24:22.719823 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-1a26deb9-88c8-483a-8693-013fcc850646 tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:24:22.720464 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-1a26deb9-88c8-483a-8693-013fcc850646 tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:24:22.720915 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-1a26deb9-88c8-483a-8693-013fcc850646 tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:24:22.723910 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [req-aff1ef19-dbef-4751-8032-5c366c894640 req-813a3a03-db0d-4c01-9bba-c851e3dc60ff service nova] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:24:22.724381 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [req-aff1ef19-dbef-4751-8032-5c366c894640 req-813a3a03-db0d-4c01-9bba-c851e3dc60ff service nova] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:24:22.724808 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [req-aff1ef19-dbef-4751-8032-5c366c894640 req-813a3a03-db0d-4c01-9bba-c851e3dc60ff service nova] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:24:22.736043 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.compute.server_external_events [req-aff1ef19-dbef-4751-8032-5c366c894640 req-813a3a03-db0d-4c01-9bba-c851e3dc60ff service nova] Creating event network-changed:56d3063f-8418-4251-989d-cd1d0b565ff1 for instance 5f41cc60-bad3-4447-8c5e-9cc7f7e3c389 on hv-cinder-82660 Oct 13 13:24:22.741938 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [req-aff1ef19-dbef-4751-8032-5c366c894640 req-813a3a03-db0d-4c01-9bba-c851e3dc60ff service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032314 Oct 13 13:24:22.742784 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 526/1067] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 13:24:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 13 13:24:22.749498 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-1a26deb9-88c8-483a-8693-013fcc850646 tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] [instance: 5f41cc60-bad3-4447-8c5e-9cc7f7e3c389] Going to try to terminate instance {{(pid=118814) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 13 13:24:22.832419 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-1a26deb9-88c8-483a-8693-013fcc850646 tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] 10.222.0.23 "DELETE /compute/v2.1/servers/5f41cc60-bad3-4447-8c5e-9cc7f7e3c389" status: 204 len: 0 microversion: 2.1 time: 0.124884 Oct 13 13:24:22.833203 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 542/1068] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Oct 13 13:24:22 2022] DELETE /compute/v2.1/servers/5f41cc60-bad3-4447-8c5e-9cc7f7e3c389 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 13 13:24:22.844277 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-1e37a627-2e9b-4378-8fbe-e16638d69f03 tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Calling method '>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:24:22.845002 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-1e37a627-2e9b-4378-8fbe-e16638d69f03 tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] [instance: 5f41cc60-bad3-4447-8c5e-9cc7f7e3c389] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:24:22.852065 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-1e37a627-2e9b-4378-8fbe-e16638d69f03 tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:24:22.852550 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-1e37a627-2e9b-4378-8fbe-e16638d69f03 tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:24:22.853130 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-1e37a627-2e9b-4378-8fbe-e16638d69f03 tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:24:22.853833 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-1e37a627-2e9b-4378-8fbe-e16638d69f03 tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:24:22.854285 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-1e37a627-2e9b-4378-8fbe-e16638d69f03 tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:24:22.854708 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-1e37a627-2e9b-4378-8fbe-e16638d69f03 tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:24:23.003560 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.policy [None req-1e37a627-2e9b-4378-8fbe-e16638d69f03 tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd005dcc25944dfc9aeda1eb1468a0ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e1654782ac4100b0353d561496db51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118815) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:24:23.011529 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-1e37a627-2e9b-4378-8fbe-e16638d69f03 tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] 10.222.0.23 "GET /compute/v2.1/servers/5f41cc60-bad3-4447-8c5e-9cc7f7e3c389" status: 200 len: 1578 microversion: 2.1 time: 0.172998 Oct 13 13:24:23.012092 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 527/1069] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:24:22 2022] GET /compute/v2.1/servers/5f41cc60-bad3-4447-8c5e-9cc7f7e3c389 => generated 1578 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:24:24.034367 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-b9f13c70-c4b0-44e2-9f29-0a0a694d27fe tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Calling method '>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:24:24.035076 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-b9f13c70-c4b0-44e2-9f29-0a0a694d27fe tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] [instance: 5f41cc60-bad3-4447-8c5e-9cc7f7e3c389] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:24:24.041495 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-b9f13c70-c4b0-44e2-9f29-0a0a694d27fe tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:24:24.041969 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-b9f13c70-c4b0-44e2-9f29-0a0a694d27fe tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:24:24.042407 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-b9f13c70-c4b0-44e2-9f29-0a0a694d27fe tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:24:24.043116 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-b9f13c70-c4b0-44e2-9f29-0a0a694d27fe tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:24:24.043570 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-b9f13c70-c4b0-44e2-9f29-0a0a694d27fe tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:24:24.043991 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-b9f13c70-c4b0-44e2-9f29-0a0a694d27fe tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:24:24.174350 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-b9f13c70-c4b0-44e2-9f29-0a0a694d27fe tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd005dcc25944dfc9aeda1eb1468a0ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e1654782ac4100b0353d561496db51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:24:24.182783 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-b9f13c70-c4b0-44e2-9f29-0a0a694d27fe tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] 10.222.0.23 "GET /compute/v2.1/servers/5f41cc60-bad3-4447-8c5e-9cc7f7e3c389" status: 200 len: 1578 microversion: 2.1 time: 0.152795 Oct 13 13:24:24.183379 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 543/1070] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:24:24 2022] GET /compute/v2.1/servers/5f41cc60-bad3-4447-8c5e-9cc7f7e3c389 => generated 1578 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:24:24.972138 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [req-382fb9a4-48c7-4a48-a60a-d367bd567691 req-87299679-f2b8-4381-87d2-03adb398e611 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5f41cc60-bad3-4447-8c5e-9cc7f7e3c389", "name": "network-vif-deleted", "tag": "56d3063f-8418-4251-989d-cd1d0b565ff1"}]} {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 13:24:24.985437 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [req-382fb9a4-48c7-4a48-a60a-d367bd567691 req-87299679-f2b8-4381-87d2-03adb398e611 service nova] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:24:24.985926 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [req-382fb9a4-48c7-4a48-a60a-d367bd567691 req-87299679-f2b8-4381-87d2-03adb398e611 service nova] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:24:24.986364 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [req-382fb9a4-48c7-4a48-a60a-d367bd567691 req-87299679-f2b8-4381-87d2-03adb398e611 service nova] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:24:25.000555 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.compute.server_external_events [req-382fb9a4-48c7-4a48-a60a-d367bd567691 req-87299679-f2b8-4381-87d2-03adb398e611 service nova] Creating event network-vif-deleted:56d3063f-8418-4251-989d-cd1d0b565ff1 for instance 5f41cc60-bad3-4447-8c5e-9cc7f7e3c389 on hv-cinder-82660 Oct 13 13:24:25.007604 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [req-382fb9a4-48c7-4a48-a60a-d367bd567691 req-87299679-f2b8-4381-87d2-03adb398e611 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039176 Oct 13 13:24:25.008352 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 528/1071] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 13:24:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 13:24:25.206083 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-1a23bee1-dde5-4db6-ac2b-3ab264723a67 tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Calling method '>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:24:25.206729 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-1a23bee1-dde5-4db6-ac2b-3ab264723a67 tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] [instance: 5f41cc60-bad3-4447-8c5e-9cc7f7e3c389] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:24:25.213822 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-1a23bee1-dde5-4db6-ac2b-3ab264723a67 tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:24:25.214351 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-1a23bee1-dde5-4db6-ac2b-3ab264723a67 tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:24:25.214741 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-1a23bee1-dde5-4db6-ac2b-3ab264723a67 tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:24:25.215466 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-1a23bee1-dde5-4db6-ac2b-3ab264723a67 tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:24:25.215922 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-1a23bee1-dde5-4db6-ac2b-3ab264723a67 tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:24:25.216344 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-1a23bee1-dde5-4db6-ac2b-3ab264723a67 tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:24:25.247454 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-1a23bee1-dde5-4db6-ac2b-3ab264723a67 tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:24:25.247953 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-1a23bee1-dde5-4db6-ac2b-3ab264723a67 tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:24:25.248382 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-1a23bee1-dde5-4db6-ac2b-3ab264723a67 tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:24:25.248830 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.objects.instance [None req-1a23bee1-dde5-4db6-ac2b-3ab264723a67 tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Lazy-loading 'fault' on Instance uuid 5f41cc60-bad3-4447-8c5e-9cc7f7e3c389 {{(pid=118814) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 13 13:24:25.295687 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.policy [None req-1a23bee1-dde5-4db6-ac2b-3ab264723a67 tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd005dcc25944dfc9aeda1eb1468a0ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e1654782ac4100b0353d561496db51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118814) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 13:24:25.305169 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-1a23bee1-dde5-4db6-ac2b-3ab264723a67 tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] 10.222.0.23 "GET /compute/v2.1/servers/5f41cc60-bad3-4447-8c5e-9cc7f7e3c389" status: 200 len: 1231 microversion: 2.1 time: 0.102948 Oct 13 13:24:25.305740 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 544/1072] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:24:25 2022] GET /compute/v2.1/servers/5f41cc60-bad3-4447-8c5e-9cc7f7e3c389 => generated 1231 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 13:24:26.329965 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-4d018557-6c86-46fd-8c16-c9caf11a8dd7 tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Calling method '>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:24:26.330671 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-4d018557-6c86-46fd-8c16-c9caf11a8dd7 tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] [instance: 5f41cc60-bad3-4447-8c5e-9cc7f7e3c389] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:24:26.337927 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-4d018557-6c86-46fd-8c16-c9caf11a8dd7 tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:24:26.338405 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-4d018557-6c86-46fd-8c16-c9caf11a8dd7 tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:24:26.338844 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-4d018557-6c86-46fd-8c16-c9caf11a8dd7 tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:24:26.339562 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-4d018557-6c86-46fd-8c16-c9caf11a8dd7 tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:24:26.340017 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-4d018557-6c86-46fd-8c16-c9caf11a8dd7 tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:24:26.340440 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-4d018557-6c86-46fd-8c16-c9caf11a8dd7 tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:24:26.354090 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.wsgi [None req-4d018557-6c86-46fd-8c16-c9caf11a8dd7 tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] HTTP exception thrown: Instance 5f41cc60-bad3-4447-8c5e-9cc7f7e3c389 could not be found. Oct 13 13:24:26.355698 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-4d018557-6c86-46fd-8c16-c9caf11a8dd7 tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Request method failure captured: Oct 13 13:24:26.355698 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: request: GET /compute/v2.1/servers/5f41cc60-bad3-4447-8c5e-9cc7f7e3c389 HTTP/1.1 Oct 13 13:24:26.355698 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: Accept: application/json Oct 13 13:24:26.355698 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: Accept-Encoding: identity Oct 13 13:24:26.355698 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: Connection: close Oct 13 13:24:26.355698 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: Content-Length: 0 Oct 13 13:24:26.355698 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: Content-Type: application/json Oct 13 13:24:26.355698 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: Host: 10.222.0.23 Oct 13 13:24:26.355698 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: Openstack-System-Scope: None Oct 13 13:24:26.355698 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: User-Agent: python-urllib3/1.26.12 Oct 13 13:24:26.355698 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Auth-Token: gAAAAABjSA_1FCQ67PHpjpU4Wwc6CXFHNinbU83FmzKFriOepDUfokfzZ8id4uD7J0tYysw9XZE5sD7lOQs-pUs-McO_QDy1XHV3SLgefdIJs_OYz-KVMIn65gwYa7fW86ZY2c6BS06BR5XLWvyN9CN4lK-VptUWMmUug9azR6ncWFuFfapFN_M Oct 13 13:24:26.355698 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Domain-Id: None Oct 13 13:24:26.355698 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Domain-Name: None Oct 13 13:24:26.355698 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Identity-Status: Confirmed Oct 13 13:24:26.355698 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Is-Admin-Project: True Oct 13 13:24:26.355698 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Project-Domain-Id: default Oct 13 13:24:26.355698 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Project-Domain-Name: Default Oct 13 13:24:26.355698 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Project-Id: 17e1654782ac4100b0353d561496db51 Oct 13 13:24:26.355698 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Project-Name: tempest-TestVolumeBootPattern-1022162848 Oct 13 13:24:26.355698 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Role: reader,member Oct 13 13:24:26.355698 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Roles: reader,member Oct 13 13:24:26.357566 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_17e1654782ac4100b0353d561496db51"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/17e1654782ac4100b0353d561496db51"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/17e1654782ac4100b0353d561496db51"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/17e1654782ac4100b0353d561496db51"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}] Oct 13 13:24:26.357566 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Tenant: tempest-TestVolumeBootPattern-1022162848 Oct 13 13:24:26.357566 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Tenant-Id: 17e1654782ac4100b0353d561496db51 Oct 13 13:24:26.357566 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Tenant-Name: tempest-TestVolumeBootPattern-1022162848 Oct 13 13:24:26.357566 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-User: tempest-TestVolumeBootPattern-1022162848-project Oct 13 13:24:26.357566 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-User-Domain-Id: default Oct 13 13:24:26.357566 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-User-Domain-Name: Default Oct 13 13:24:26.357566 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-User-Id: cd005dcc25944dfc9aeda1eb1468a0ea Oct 13 13:24:26.357566 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-User-Name: tempest-TestVolumeBootPattern-1022162848-project Oct 13 13:24:26.357566 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: method: > Oct 13 13:24:26.357566 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: exception: Instance 5f41cc60-bad3-4447-8c5e-9cc7f7e3c389 could not be found. Oct 13 13:24:26.357566 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: action_args: {'id': '5f41cc60-bad3-4447-8c5e-9cc7f7e3c389'} Oct 13 13:24:26.358554 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 13:24:26.358554 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 13:24:26.358554 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 13 13:24:26.358554 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 13 13:24:26.358554 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 13 13:24:26.358554 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 13 13:24:26.358554 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 13 13:24:26.358554 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 13 13:24:26.358554 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 13 13:24:26.358554 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 13 13:24:26.358554 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5f41cc60-bad3-4447-8c5e-9cc7f7e3c389 could not be found. Oct 13 13:24:26.358554 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi Oct 13 13:24:26.358554 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 13:24:26.358554 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi Oct 13 13:24:26.358554 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 13:24:26.358554 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 13:24:26.358554 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 13:24:26.358554 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 13:24:26.358554 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 13:24:26.358554 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 13:24:26.360281 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 13:24:26.360281 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 13 13:24:26.360281 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 13 13:24:26.360281 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 13 13:24:26.360281 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 13 13:24:26.360281 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 13 13:24:26.360281 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 13 13:24:26.360281 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5f41cc60-bad3-4447-8c5e-9cc7f7e3c389 could not be found. Oct 13 13:24:26.360281 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi Oct 13 13:24:26.360281 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 13:24:26.360281 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi Oct 13 13:24:26.360281 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 13:24:26.360281 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 13:24:26.360281 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 13:24:26.360281 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 13:24:26.360281 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 13:24:26.360281 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5f41cc60-bad3-4447-8c5e-9cc7f7e3c389 could not be found. Oct 13 13:24:26.360281 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi Oct 13 13:24:26.361884 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-4d018557-6c86-46fd-8c16-c9caf11a8dd7 tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Returning 404 to user: Instance 5f41cc60-bad3-4447-8c5e-9cc7f7e3c389 could not be found. {{(pid=118815) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 13:24:26.361884 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-4d018557-6c86-46fd-8c16-c9caf11a8dd7 tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] 10.222.0.23 "GET /compute/v2.1/servers/5f41cc60-bad3-4447-8c5e-9cc7f7e3c389" status: 404 len: 111 microversion: 2.1 time: 0.031661 Oct 13 13:24:26.361884 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 529/1073] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:24:26 2022] GET /compute/v2.1/servers/5f41cc60-bad3-4447-8c5e-9cc7f7e3c389 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 13 13:24:26.792532 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-013d0f98-8119-4f65-b24e-d1d044d6efa8 tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Calling method '>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:24:26.793031 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.compute.api [None req-013d0f98-8119-4f65-b24e-d1d044d6efa8 tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] [instance: ebf57cc9-d371-41c8-b3a4-82b67889d57d] Fetching instance by UUID {{(pid=118814) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:24:26.799734 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-013d0f98-8119-4f65-b24e-d1d044d6efa8 tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:24:26.800216 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-013d0f98-8119-4f65-b24e-d1d044d6efa8 tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:24:26.800646 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-013d0f98-8119-4f65-b24e-d1d044d6efa8 tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:24:26.801358 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-013d0f98-8119-4f65-b24e-d1d044d6efa8 tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:24:26.801833 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-013d0f98-8119-4f65-b24e-d1d044d6efa8 tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:24:26.802257 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG oslo_concurrency.lockutils [None req-013d0f98-8119-4f65-b24e-d1d044d6efa8 tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:24:26.815634 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.wsgi [None req-013d0f98-8119-4f65-b24e-d1d044d6efa8 tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] HTTP exception thrown: Instance ebf57cc9-d371-41c8-b3a4-82b67889d57d could not be found. Oct 13 13:24:26.817309 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-013d0f98-8119-4f65-b24e-d1d044d6efa8 tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Request method failure captured: Oct 13 13:24:26.817309 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: request: DELETE /compute/v2.1/servers/ebf57cc9-d371-41c8-b3a4-82b67889d57d HTTP/1.1 Oct 13 13:24:26.817309 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: Accept: application/json Oct 13 13:24:26.817309 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: Accept-Encoding: identity Oct 13 13:24:26.817309 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: Connection: close Oct 13 13:24:26.817309 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: Content-Length: 0 Oct 13 13:24:26.817309 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: Content-Type: application/json Oct 13 13:24:26.817309 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: Host: 10.222.0.23 Oct 13 13:24:26.817309 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: Openstack-System-Scope: None Oct 13 13:24:26.817309 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: User-Agent: python-urllib3/1.26.12 Oct 13 13:24:26.817309 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Auth-Token: gAAAAABjSA_1FCQ67PHpjpU4Wwc6CXFHNinbU83FmzKFriOepDUfokfzZ8id4uD7J0tYysw9XZE5sD7lOQs-pUs-McO_QDy1XHV3SLgefdIJs_OYz-KVMIn65gwYa7fW86ZY2c6BS06BR5XLWvyN9CN4lK-VptUWMmUug9azR6ncWFuFfapFN_M Oct 13 13:24:26.817309 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Domain-Id: None Oct 13 13:24:26.817309 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Domain-Name: None Oct 13 13:24:26.817309 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Identity-Status: Confirmed Oct 13 13:24:26.817309 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Is-Admin-Project: True Oct 13 13:24:26.817309 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Project-Domain-Id: default Oct 13 13:24:26.817309 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Project-Domain-Name: Default Oct 13 13:24:26.817309 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Project-Id: 17e1654782ac4100b0353d561496db51 Oct 13 13:24:26.817309 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Project-Name: tempest-TestVolumeBootPattern-1022162848 Oct 13 13:24:26.817309 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Role: reader,member Oct 13 13:24:26.817309 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Roles: reader,member Oct 13 13:24:26.819534 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_17e1654782ac4100b0353d561496db51"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/17e1654782ac4100b0353d561496db51"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/17e1654782ac4100b0353d561496db51"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/17e1654782ac4100b0353d561496db51"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}] Oct 13 13:24:26.819534 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Tenant: tempest-TestVolumeBootPattern-1022162848 Oct 13 13:24:26.819534 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Tenant-Id: 17e1654782ac4100b0353d561496db51 Oct 13 13:24:26.819534 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-Tenant-Name: tempest-TestVolumeBootPattern-1022162848 Oct 13 13:24:26.819534 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-User: tempest-TestVolumeBootPattern-1022162848-project Oct 13 13:24:26.819534 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-User-Domain-Id: default Oct 13 13:24:26.819534 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-User-Domain-Name: Default Oct 13 13:24:26.819534 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-User-Id: cd005dcc25944dfc9aeda1eb1468a0ea Oct 13 13:24:26.819534 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: X-User-Name: tempest-TestVolumeBootPattern-1022162848-project Oct 13 13:24:26.819534 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: method: > Oct 13 13:24:26.819534 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: exception: Instance ebf57cc9-d371-41c8-b3a4-82b67889d57d could not be found. Oct 13 13:24:26.819534 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: action_args: {'id': 'ebf57cc9-d371-41c8-b3a4-82b67889d57d'} Oct 13 13:24:26.820535 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 13:24:26.820535 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 13:24:26.820535 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 13 13:24:26.820535 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 13 13:24:26.820535 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 13 13:24:26.820535 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 13 13:24:26.820535 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 13 13:24:26.820535 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 13 13:24:26.820535 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 13 13:24:26.820535 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 13 13:24:26.820535 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ebf57cc9-d371-41c8-b3a4-82b67889d57d could not be found. Oct 13 13:24:26.820535 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi Oct 13 13:24:26.820535 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 13:24:26.820535 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi Oct 13 13:24:26.820535 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 13:24:26.820535 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 13:24:26.820535 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 13:24:26.820535 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 13:24:26.820535 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 13:24:26.820535 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 13:24:26.821905 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 13:24:26.821905 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 13 13:24:26.821905 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 13 13:24:26.821905 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 13 13:24:26.821905 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 13 13:24:26.821905 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 13 13:24:26.821905 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 13 13:24:26.821905 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 13 13:24:26.821905 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 13 13:24:26.821905 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ebf57cc9-d371-41c8-b3a4-82b67889d57d could not be found. Oct 13 13:24:26.821905 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi Oct 13 13:24:26.821905 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 13:24:26.821905 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi Oct 13 13:24:26.821905 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 13:24:26.821905 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 13:24:26.821905 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 13:24:26.821905 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 13:24:26.821905 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 13:24:26.821905 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ebf57cc9-d371-41c8-b3a4-82b67889d57d could not be found. Oct 13 13:24:26.821905 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: ERROR nova.api.openstack.wsgi Oct 13 13:24:26.823480 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-013d0f98-8119-4f65-b24e-d1d044d6efa8 tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Returning 404 to user: Instance ebf57cc9-d371-41c8-b3a4-82b67889d57d could not be found. {{(pid=118814) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 13:24:26.823480 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-013d0f98-8119-4f65-b24e-d1d044d6efa8 tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] 10.222.0.23 "DELETE /compute/v2.1/servers/ebf57cc9-d371-41c8-b3a4-82b67889d57d" status: 404 len: 111 microversion: 2.1 time: 0.030096 Oct 13 13:24:26.823480 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 545/1074] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Oct 13 13:24:26 2022] DELETE /compute/v2.1/servers/ebf57cc9-d371-41c8-b3a4-82b67889d57d => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 13 13:24:26.827721 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-6e260bd7-633c-45e1-a9cc-119fa3f0d079 tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Calling method '>' {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:24:26.828326 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.compute.api [None req-6e260bd7-633c-45e1-a9cc-119fa3f0d079 tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] [instance: ebf57cc9-d371-41c8-b3a4-82b67889d57d] Fetching instance by UUID {{(pid=118815) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 13:24:26.834264 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-6e260bd7-633c-45e1-a9cc-119fa3f0d079 tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:24:26.835382 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-6e260bd7-633c-45e1-a9cc-119fa3f0d079 tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:24:26.835826 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-6e260bd7-633c-45e1-a9cc-119fa3f0d079 tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:24:26.836507 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-6e260bd7-633c-45e1-a9cc-119fa3f0d079 tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Acquiring lock "0819204c-42d8-4282-8b98-8f0b36a44d37" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 13:24:26.836962 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-6e260bd7-633c-45e1-a9cc-119fa3f0d079 tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 13:24:26.837384 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG oslo_concurrency.lockutils [None req-6e260bd7-633c-45e1-a9cc-119fa3f0d079 tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Lock "0819204c-42d8-4282-8b98-8f0b36a44d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 13:24:26.851924 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.wsgi [None req-6e260bd7-633c-45e1-a9cc-119fa3f0d079 tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] HTTP exception thrown: Instance ebf57cc9-d371-41c8-b3a4-82b67889d57d could not be found. Oct 13 13:24:26.853497 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-6e260bd7-633c-45e1-a9cc-119fa3f0d079 tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Request method failure captured: Oct 13 13:24:26.853497 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: request: GET /compute/v2.1/servers/ebf57cc9-d371-41c8-b3a4-82b67889d57d HTTP/1.1 Oct 13 13:24:26.853497 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: Accept: application/json Oct 13 13:24:26.853497 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: Accept-Encoding: identity Oct 13 13:24:26.853497 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: Connection: close Oct 13 13:24:26.853497 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: Content-Length: 0 Oct 13 13:24:26.853497 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: Content-Type: application/json Oct 13 13:24:26.853497 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: Host: 10.222.0.23 Oct 13 13:24:26.853497 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: Openstack-System-Scope: None Oct 13 13:24:26.853497 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: User-Agent: python-urllib3/1.26.12 Oct 13 13:24:26.853497 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Auth-Token: gAAAAABjSA_1FCQ67PHpjpU4Wwc6CXFHNinbU83FmzKFriOepDUfokfzZ8id4uD7J0tYysw9XZE5sD7lOQs-pUs-McO_QDy1XHV3SLgefdIJs_OYz-KVMIn65gwYa7fW86ZY2c6BS06BR5XLWvyN9CN4lK-VptUWMmUug9azR6ncWFuFfapFN_M Oct 13 13:24:26.853497 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Domain-Id: None Oct 13 13:24:26.853497 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Domain-Name: None Oct 13 13:24:26.853497 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Identity-Status: Confirmed Oct 13 13:24:26.853497 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Is-Admin-Project: True Oct 13 13:24:26.853497 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Project-Domain-Id: default Oct 13 13:24:26.853497 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Project-Domain-Name: Default Oct 13 13:24:26.853497 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Project-Id: 17e1654782ac4100b0353d561496db51 Oct 13 13:24:26.853497 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Project-Name: tempest-TestVolumeBootPattern-1022162848 Oct 13 13:24:26.853497 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Role: reader,member Oct 13 13:24:26.853497 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Roles: reader,member Oct 13 13:24:26.855286 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_17e1654782ac4100b0353d561496db51"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/17e1654782ac4100b0353d561496db51"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/17e1654782ac4100b0353d561496db51"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/17e1654782ac4100b0353d561496db51"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}] Oct 13 13:24:26.855286 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Tenant: tempest-TestVolumeBootPattern-1022162848 Oct 13 13:24:26.855286 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Tenant-Id: 17e1654782ac4100b0353d561496db51 Oct 13 13:24:26.855286 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-Tenant-Name: tempest-TestVolumeBootPattern-1022162848 Oct 13 13:24:26.855286 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-User: tempest-TestVolumeBootPattern-1022162848-project Oct 13 13:24:26.855286 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-User-Domain-Id: default Oct 13 13:24:26.855286 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-User-Domain-Name: Default Oct 13 13:24:26.855286 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-User-Id: cd005dcc25944dfc9aeda1eb1468a0ea Oct 13 13:24:26.855286 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: X-User-Name: tempest-TestVolumeBootPattern-1022162848-project Oct 13 13:24:26.855286 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: method: > Oct 13 13:24:26.855286 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: exception: Instance ebf57cc9-d371-41c8-b3a4-82b67889d57d could not be found. Oct 13 13:24:26.855286 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: action_args: {'id': 'ebf57cc9-d371-41c8-b3a4-82b67889d57d'} Oct 13 13:24:26.856246 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: {{(pid=118815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 13:24:26.856246 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 13:24:26.856246 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 13 13:24:26.856246 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 13 13:24:26.856246 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 13 13:24:26.856246 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 13 13:24:26.856246 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 13 13:24:26.856246 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 13 13:24:26.856246 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 13 13:24:26.856246 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 13 13:24:26.856246 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ebf57cc9-d371-41c8-b3a4-82b67889d57d could not be found. Oct 13 13:24:26.856246 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi Oct 13 13:24:26.856246 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 13:24:26.856246 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi Oct 13 13:24:26.856246 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 13:24:26.856246 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 13:24:26.856246 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 13:24:26.856246 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 13:24:26.856246 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 13:24:26.856246 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 13:24:26.858184 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 13:24:26.858184 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 13 13:24:26.858184 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 13 13:24:26.858184 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 13 13:24:26.858184 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 13 13:24:26.858184 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 13 13:24:26.858184 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 13 13:24:26.858184 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ebf57cc9-d371-41c8-b3a4-82b67889d57d could not be found. Oct 13 13:24:26.858184 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi Oct 13 13:24:26.858184 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 13:24:26.858184 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi Oct 13 13:24:26.858184 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 13:24:26.858184 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 13:24:26.858184 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 13:24:26.858184 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 13:24:26.858184 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 13:24:26.858184 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ebf57cc9-d371-41c8-b3a4-82b67889d57d could not be found. Oct 13 13:24:26.858184 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: ERROR nova.api.openstack.wsgi Oct 13 13:24:26.860190 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: DEBUG nova.api.openstack.wsgi [None req-6e260bd7-633c-45e1-a9cc-119fa3f0d079 tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Returning 404 to user: Instance ebf57cc9-d371-41c8-b3a4-82b67889d57d could not be found. {{(pid=118815) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 13:24:26.860190 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: INFO nova.api.openstack.requestlog [None req-6e260bd7-633c-45e1-a9cc-119fa3f0d079 tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] 10.222.0.23 "GET /compute/v2.1/servers/ebf57cc9-d371-41c8-b3a4-82b67889d57d" status: 404 len: 111 microversion: 2.1 time: 0.031066 Oct 13 13:24:26.860190 dv-cinder-826607-8-iscsi devstack@n-api.service[118815]: [pid: 118815|app: 0|req: 530/1075] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 13:24:26 2022] GET /compute/v2.1/servers/ebf57cc9-d371-41c8-b3a4-82b67889d57d => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 13 13:24:28.153589 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: DEBUG nova.api.openstack.wsgi [None req-c282783e-fcad-4f95-8c09-edc1bb19952a tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] Calling method '.version_select at 0x7f5093dccc10>' {{(pid=118814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 13:24:28.178553 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: INFO nova.api.openstack.requestlog [None req-c282783e-fcad-4f95-8c09-edc1bb19952a tempest-TestVolumeBootPattern-1022162848 tempest-TestVolumeBootPattern-1022162848-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1602157845" status: 202 len: 0 microversion: 2.1 time: 0.028597 Oct 13 13:24:28.179253 dv-cinder-826607-8-iscsi devstack@n-api.service[118814]: [pid: 118814|app: 0|req: 546/1076] 10.222.0.23 () {58 vars in 1263 bytes} [Thu Oct 13 13:24:28 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1602157845 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0)